-- Logs begin at Thu 2022-08-25 11:42:13 UTC, end at Thu 2022-08-25 14:51:17 UTC. -- Aug 25 12:18:11.719718 n-d-850468-18 systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 12:18:11.731250 n-d-850468-18 devstack@n-api.service[106537]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 12:18:11 2022] *** Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: nodename: n-d-850468-18 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: machine: x86_64 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: clock source: unix Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: pcre jit disabled Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: detected number of CPU cores: 4 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: current working directory: / Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: detected binary path: /usr/bin/uwsgi-core Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: your processes number limit is 47680 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: your memory page size is 4096 bytes Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: detected max file descriptor number: 2048 Aug 25 12:18:11.735096 n-d-850468-18 devstack@n-api.service[106537]: lock engine: pthread robust mutexes Aug 25 12:18:11.736590 n-d-850468-18 devstack@n-api.service[106537]: thunder lock: enabled Aug 25 12:18:11.736590 n-d-850468-18 devstack@n-api.service[106537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 12:18:11.736590 n-d-850468-18 devstack@n-api.service[106537]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 12:18:11.777112 n-d-850468-18 devstack@n-api.service[106537]: Python main interpreter initialized at 0x564f1f5029c0 Aug 25 12:18:11.777112 n-d-850468-18 devstack@n-api.service[106537]: python threads support enabled Aug 25 12:18:11.777112 n-d-850468-18 devstack@n-api.service[106537]: your server socket listen backlog is limited to 100 connections Aug 25 12:18:11.777112 n-d-850468-18 devstack@n-api.service[106537]: your mercy for graceful operations on workers is 90 seconds Aug 25 12:18:11.777621 n-d-850468-18 devstack@n-api.service[106537]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 12:18:11.777621 n-d-850468-18 devstack@n-api.service[106537]: *** Operational MODE: preforking *** Aug 25 12:18:11.777835 n-d-850468-18 devstack@n-api.service[106537]: *** uWSGI is running in multiple interpreter mode *** Aug 25 12:18:11.777835 n-d-850468-18 devstack@n-api.service[106537]: spawned uWSGI master process (pid: 106537) Aug 25 12:18:11.778075 n-d-850468-18 systemd[1]: Started Devstack devstack@n-api.service. Aug 25 12:18:11.779075 n-d-850468-18 devstack@n-api.service[106537]: spawned uWSGI worker 1 (pid: 106538, cores: 1) Aug 25 12:18:11.779075 n-d-850468-18 devstack@n-api.service[106537]: spawned uWSGI worker 2 (pid: 106539, cores: 1) Aug 25 12:18:11.779371 n-d-850468-18 devstack@n-api.service[106537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 12:18:12.526376 n-d-850468-18 devstack@n-api.service[106539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:18:12.544212 n-d-850468-18 devstack@n-api.service[106538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:18:13.731361 n-d-850468-18 devstack@n-api.service[106539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:18:13.731361 n-d-850468-18 devstack@n-api.service[106539]: from cryptography.utils import int_from_bytes Aug 25 12:18:13.732261 n-d-850468-18 devstack@n-api.service[106539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:18:13.732261 n-d-850468-18 devstack@n-api.service[106539]: from cryptography.utils import int_from_bytes Aug 25 12:18:13.791356 n-d-850468-18 devstack@n-api.service[106538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:18:13.791356 n-d-850468-18 devstack@n-api.service[106538]: from cryptography.utils import int_from_bytes Aug 25 12:18:13.792182 n-d-850468-18 devstack@n-api.service[106538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:18:13.792182 n-d-850468-18 devstack@n-api.service[106538]: from cryptography.utils import int_from_bytes Aug 25 12:18:16.547342 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:18:16.548042 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:18:16.548042 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:18:16.548437 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:18:16.548696 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:18:16.549098 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.549475 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.549799 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.550120 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.550477 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.550861 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.551247 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.551572 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.551908 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.552199 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.552526 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.552870 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-18 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.553193 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.553525 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.553872 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.554197 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.554529 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.554839 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.555147 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.555661 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.556104 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.556455 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.556786 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.557122 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.557520 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.557755 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.558090 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.558392 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.558730 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.559036 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.559465 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-18 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.559775 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.560088 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.560429 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.560882 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.561207 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.562084 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.562416 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.562640 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:18:16.563512 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.563755 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:18:16.563909 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.563909 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.564364 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:18:16.564486 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.564626 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:18:16.564729 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.564817 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:18:16.564892 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.564892 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565091 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565215 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565309 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565410 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565552 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565705 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.565853 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566002 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566142 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566299 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566448 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566593 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.566769 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.567191 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.567348 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.567520 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.567792 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.567963 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568184 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568361 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568519 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568672 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568672 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.568970 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-18 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569148 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569322 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569482 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569638 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569805 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.569948 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570090 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570244 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570385 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570541 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570694 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.570884 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571034 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571262 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571779 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.571940 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.572134 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.572265 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.572492 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.572732 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.572878 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573015 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573149 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573337 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573686 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573833 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.573982 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.574128 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.574277 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.574506 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.574506 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.574872 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.575014 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.575158 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.575403 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.575549 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.575742 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576003 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-18 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576196 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576342 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576511 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576739 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.576900 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.577045 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.577360 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.577360 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.577805 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.577955 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578099 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578246 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578384 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578532 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578683 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578836 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.578988 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579221 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579369 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579525 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579669 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579810 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.579810 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580140 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580376 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580545 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580689 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580841 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.580998 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.581190 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.581353 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.581645 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.581796 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.581941 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.582090 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.582359 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.582522 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.582652 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.582798 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583042 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583207 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583351 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583548 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583702 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583844 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.583844 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584108 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584339 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584503 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584658 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584810 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.584956 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585103 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585266 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585407 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585552 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585709 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.585871 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586025 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586190 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586326 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586463 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586684 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586837 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.586985 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587228 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587425 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587559 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587683 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587828 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.587981 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588201 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588341 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588493 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588623 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588747 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.588883 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589027 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589169 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589324 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589467 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589707 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.589868 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590046 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590190 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590339 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590339 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590700 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590856 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.590998 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.591191 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.591343 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.591575 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.591778 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.591949 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.592205 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.592350 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.593074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.593350 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.593505 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.593803 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.593803 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594068 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594230 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594367 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594515 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594793 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.594929 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595160 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595310 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595464 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595648 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595793 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.595941 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.596088 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.596088 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.596493 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.596649 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.596800 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.596959 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.597110 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.597287 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.597457 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.597741 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.597909 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.598063 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.598204 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.598344 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.598535 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.598693 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.598896 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.599039 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.599172 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.599298 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.599444 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.599644 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.599794 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.599932 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.600175 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.600327 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.600482 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.600704 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.600853 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.600853 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.601148 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.601389 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.601550 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.601692 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.601844 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.602051 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.602201 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.602367 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.602542 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.602696 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.602850 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.603072 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.603226 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.603446 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.603606 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.603748 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.603998 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.604218 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.604363 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.604650 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.604792 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.604933 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.605074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.605287 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.605469 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.605649 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.605872 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.606006 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.606134 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.606312 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.606449 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.606642 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.606786 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.606927 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.607160 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.607319 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.607467 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.607605 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.607786 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.607915 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.608276 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.609026 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.609026 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.609679 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.609832 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.610004 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.610157 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.610401 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.610570 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.610715 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.611031 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.611196 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.611352 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.611497 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.611680 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.611828 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.611972 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.612137 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.612424 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.612593 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.612749 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.612891 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.613063 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.613204 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.613554 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.613701 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.613859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.614006 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.614135 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.614292 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.614430 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.614674 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.614877 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615093 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:18:16.615240 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615412 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615825 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.615977 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616162 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616326 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616469 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616625 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616770 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.616911 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617054 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617198 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617340 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617495 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617665 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.617809 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618008 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618158 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618158 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618441 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618598 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618752 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.618907 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619049 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619199 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619344 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619481 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619624 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.619936 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620085 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620407 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620543 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620682 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620819 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.620959 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621113 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621267 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621411 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621565 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621743 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.621888 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622029 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622242 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622402 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622554 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622705 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.622860 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623022 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623167 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623322 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623465 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623759 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.623914 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.625281 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.625437 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.625582 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.625728 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.625873 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626029 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626194 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626349 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626500 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626643 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626787 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.626944 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627102 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627256 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627256 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627682 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627828 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.627982 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.628579 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.628728 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.628872 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629010 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629146 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629298 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629428 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629597 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.629740 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630026 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630170 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630447 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630606 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630751 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.630946 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631093 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631235 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631535 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631671 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631801 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.631934 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.632239 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.632569 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.632738 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.632885 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.633029 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.633259 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.633422 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.633779 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.633918 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634054 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634191 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634354 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634490 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634631 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634759 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.634882 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635004 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635138 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635347 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635521 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635652 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635800 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.635951 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636086 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636319 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636603 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636752 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636883 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.636883 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.637118 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.637251 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.637436 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.637629 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.637929 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.638082 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.638294 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.638493 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.638640 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.638925 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.639074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.639407 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.639566 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.639737 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.639870 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640093 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640273 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640398 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640523 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.640991 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.641156 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.641301 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.641428 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.641588 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.641855 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642042 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642182 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642323 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642536 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642749 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.642895 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643034 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643207 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643350 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643635 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643635 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.643979 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.644220 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.644385 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.644542 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.644724 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645043 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645195 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645327 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645462 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645588 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645729 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.645852 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646010 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646166 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646459 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646610 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646777 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.646907 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647050 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647187 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647365 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647532 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647689 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.647998 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.648165 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.648400 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.648546 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.648836 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649001 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649147 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649332 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649569 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649732 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.649732 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650147 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650291 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650432 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650432 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650723 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.650876 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.651018 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.651277 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.651413 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.651690 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.651846 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.652006 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.652201 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.652348 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.652592 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.652823 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.653122 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.653286 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.653431 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.653614 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.653761 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654016 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654236 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654531 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654683 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654820 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.654820 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.655691 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.655906 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.656090 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.656571 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.656751 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.656901 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657060 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657255 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657401 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657544 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657834 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.657998 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658144 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658308 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658652 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658801 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.658943 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659100 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659254 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659254 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659521 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659663 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659796 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.659946 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660086 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660259 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660402 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660540 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660677 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660809 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.660943 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661082 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661224 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661365 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661504 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661663 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661804 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.661939 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662075 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662244 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662398 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662561 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662698 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662904 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.662904 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.663391 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.663644 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.663790 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.663932 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664077 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664317 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664468 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664626 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664769 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.664910 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665053 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665207 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665381 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665829 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.665984 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.666272 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.666272 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.666573 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.666718 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.666876 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.667079 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.667239 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.667483 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.667644 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.667929 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.668074 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.668298 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.668454 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.668650 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.668860 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669024 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669170 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669315 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669441 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669730 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.669881 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.670039 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.670161 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.670296 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.670471 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.670741 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.671590 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.672438 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.672595 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.672810 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.673862 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674020 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674168 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674338 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674490 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674646 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674786 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.674786 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675066 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675222 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675366 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675506 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675655 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675795 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.675953 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676106 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676308 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676450 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676608 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676751 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.676892 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677031 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677158 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677301 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677439 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677593 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677744 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.677897 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678051 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678191 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678315 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678452 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678604 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678744 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.678911 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.679033 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.679167 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.679353 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.679606 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.679759 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680057 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680235 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680379 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680540 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680681 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.680808 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681144 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681299 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681438 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681598 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681746 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.681921 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682211 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682367 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682526 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682668 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682808 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682948 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.682948 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.683203 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.683417 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.683565 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.683720 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.683874 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.684019 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.684310 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.684624 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.684814 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.684965 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.685116 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.685254 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.685395 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.685714 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.685872 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.686054 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.686208 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.687048 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.687298 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.687431 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.687728 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.687879 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.688025 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.688273 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.688440 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.688609 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.688753 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689035 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689192 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689316 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689724 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689852 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689997 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.689997 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.690297 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.690561 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.690693 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.690860 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.691152 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.691318 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.691318 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.691779 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.691925 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.692053 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.692205 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.692353 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.692618 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.692875 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.693034 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.693034 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.693468 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.693598 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.693945 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694109 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694249 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694439 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694580 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694782 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.694950 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695087 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695211 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695482 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695632 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695777 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.695932 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696074 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696224 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696352 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696523 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696663 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.696961 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697123 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697254 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697392 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697523 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697672 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697799 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.697960 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698082 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698215 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698215 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698601 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698735 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698863 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.698993 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699121 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699246 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699408 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699538 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699809 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.699946 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700070 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700313 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700455 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700583 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700712 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.700866 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701133 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701133 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701398 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701398 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701656 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701839 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.701984 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.702383 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.702535 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.702677 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.702834 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.702997 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.703143 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.703331 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.703477 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.703828 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.703975 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704141 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704141 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704447 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704690 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704839 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.704967 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.705109 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.705515 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.705660 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.705812 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.705957 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706111 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706252 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706415 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706560 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706705 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706846 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.706988 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707129 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707285 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707428 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707569 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707721 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.707869 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708006 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708196 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708337 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708480 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708624 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708767 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.708936 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709072 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709210 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709347 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709483 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709622 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709782 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.709922 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710131 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710305 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710458 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710603 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710758 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.710895 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711033 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711174 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711327 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711469 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711469 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711745 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711745 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711989 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.711989 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.712354 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.712497 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.712671 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.712829 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.712984 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.713164 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.713326 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.713480 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.713777 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.713906 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.714033 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.714343 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.714519 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.714675 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.714820 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.715018 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.715151 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.715545 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.715713 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.715857 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716001 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716196 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716359 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716518 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716518 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.716950 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.717077 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.717201 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.717376 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718049 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718192 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718312 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718468 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718609 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718767 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.718907 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719102 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719318 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719458 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719602 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719760 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.719905 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.720357 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.720648 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.720790 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.720946 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721109 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721246 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721399 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721556 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721732 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.721889 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722042 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722298 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722468 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722468 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722755 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.722922 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.723066 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.723066 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.723404 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.723404 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.723818 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.724211 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.724499 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.724647 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.724788 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.724974 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725136 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725333 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725491 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725491 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725785 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.725924 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.726293 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.726468 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.726776 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.726931 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727084 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727232 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727394 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727576 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727728 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.727896 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728044 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728214 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728383 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728530 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728834 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.728982 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.729140 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.729301 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.729562 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.729754 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.729973 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.730171 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.730487 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.730714 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.731070 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.731221 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.731556 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.731717 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.732291 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.732467 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.732799 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.732956 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.733867 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.734019 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.734019 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.734565 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.734716 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.734871 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.735047 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.735297 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.735521 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.735823 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.735970 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.736136 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.736311 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.736311 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.736755 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.736909 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737069 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737215 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737365 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.737963 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.738217 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.738410 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.738555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.738699 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.738856 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.739001 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.739175 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.739477 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.739813 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.739813 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.740163 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.740475 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.740643 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.740773 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.740913 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.741077 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.741374 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.741533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.741533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.741862 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742008 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742153 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742299 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742455 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742610 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742766 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.742911 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743066 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743374 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743539 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743684 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743841 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.743985 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744150 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744279 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744500 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744648 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744648 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.744968 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.745265 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.745416 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.745574 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.745574 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.745844 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746001 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746001 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746283 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746410 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746410 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746685 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746831 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.746979 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747135 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747135 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747405 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747666 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747666 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.747927 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748258 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748258 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748258 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748640 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748947 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.748947 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.749250 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.749395 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.749538 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.749938 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.749938 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750341 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750769 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750945 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.750945 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.751375 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.751717 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.751866 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.752025 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.752025 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.752506 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.752867 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.752867 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.753358 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.753646 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.753646 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.753919 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.754077 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.754077 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.754541 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.754681 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.754681 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.755002 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.755306 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.755453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.755706 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.755706 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756156 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756321 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756321 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756631 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756775 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.756919 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.757071 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.757071 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.757952 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.758140 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.758140 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.758460 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.758619 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.758776 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759073 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759073 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759360 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759505 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759505 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759833 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759976 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.759976 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.760508 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.760653 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.760653 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.760940 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.761185 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.761347 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.761487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.761487 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.761777 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762071 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762071 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762338 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762500 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762500 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.762870 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.763056 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.763267 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.763415 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.763415 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.763704 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764026 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764026 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764339 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764531 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764531 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764801 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.764930 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765366 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765366 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765651 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765828 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.765828 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.766216 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.766362 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.766664 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.766824 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.766968 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767112 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767112 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767353 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767493 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767493 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767797 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.767943 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768256 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768403 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768403 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768688 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768832 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.768832 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769093 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769233 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769233 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769513 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769655 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769798 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769940 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.769940 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.770270 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.770563 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.770563 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.770854 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.770999 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.771222 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.771452 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.771610 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.771906 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.771906 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772226 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772393 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772393 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772691 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772837 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.772837 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773120 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773276 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773276 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773537 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773682 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773836 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773977 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.773977 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.774265 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.774407 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.774407 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.774830 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775042 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775042 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775410 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.775794 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.776106 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.776415 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.776598 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.776598 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.776862 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777178 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777178 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777465 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777641 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777641 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.777907 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778051 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778365 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778522 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778681 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.778859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.779385 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.779533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.779533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.779811 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.780488 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.780488 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.780775 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.780933 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781077 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781366 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781366 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781804 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781971 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.781971 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.782389 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.782533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.782533 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.782948 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.783111 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.783257 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.783431 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.783431 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.783873 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.784031 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.784031 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.784410 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.784588 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.784733 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785031 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785260 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785423 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785423 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785697 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785874 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.785874 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.786307 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.786458 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.786458 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.786721 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.786865 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787008 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787167 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787167 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787628 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.787628 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.788386 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.788535 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.788535 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.789578 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.789727 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.789727 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.790265 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.790415 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.790561 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.790763 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.790763 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791031 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791191 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791191 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791453 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791597 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791597 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791854 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791983 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.791983 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792258 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792385 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792525 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792668 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792668 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.792928 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793054 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793054 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793305 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793463 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793463 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793709 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793856 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.793982 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794125 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794125 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794373 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794499 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794499 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794738 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794879 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.794879 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.795113 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.795254 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.795382 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.795508 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.795508 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.796324 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798090 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798090 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798375 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798521 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798521 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798779 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798922 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.798922 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799161 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799301 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799432 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799569 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799569 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799803 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799932 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.799932 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800233 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800370 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800370 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800651 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800798 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.800798 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801043 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801190 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801190 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801441 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.801860 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802003 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802003 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802249 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802390 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802528 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802670 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802670 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.802920 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803062 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803062 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803305 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803443 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803443 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803684 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803810 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.803810 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804082 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804235 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804235 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804519 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804646 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804852 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804986 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.804986 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805217 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805345 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805559 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805714 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805714 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.805976 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806122 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806122 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806403 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806546 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806674 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806800 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.806800 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807045 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807188 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807188 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807456 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807601 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807601 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.807855 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808011 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808186 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808337 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808337 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808600 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808742 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808742 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.808990 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809144 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809144 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809422 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809719 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.809859 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810091 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810231 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810231 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810462 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810589 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810713 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810837 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.810837 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.811080 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.812328 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.812328 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.812603 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.812746 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.812884 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813008 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813008 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813250 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813389 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813389 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813630 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813757 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813757 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.813988 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814115 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814115 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814374 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814515 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814640 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814778 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.814778 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815033 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815157 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815157 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815388 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815514 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815514 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815755 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815888 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.815888 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816154 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816282 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816282 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816533 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816679 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:18:16.816806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.816806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.817458 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.817458 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.817957 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.818334 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.818744 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.819172 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.819582 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.819991 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.820485 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.820942 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.821628 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.822077 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.822492 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.822924 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.823492 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.823857 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.824331 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.824786 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.825192 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.825598 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.826043 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.826459 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.826921 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.827834 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.828280 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.828674 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.829049 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.829433 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.829818 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.830212 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.830592 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.830974 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.831353 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.831732 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.832130 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.832524 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.832900 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.833399 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.833953 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.834252 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.834632 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.835009 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.835390 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.835765 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.836186 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.836686 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.837149 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.837641 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.838074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.838530 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.838965 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.839424 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.839863 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.840349 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.840803 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.841228 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.841911 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.842342 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.842790 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.843238 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.843675 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.844190 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.844589 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.844990 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.845410 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.845816 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.846288 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.846712 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.847123 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.847583 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.847969 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.848495 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.848958 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.849370 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.849778 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.850209 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.850616 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.851034 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.851451 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.851884 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.852427 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.852910 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.853326 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.853744 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.854240 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.854668 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.855073 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.855480 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.855940 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.856455 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.856891 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.857299 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.857700 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.858284 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.858691 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.859158 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.859546 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.859986 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.860399 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.860806 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.861197 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.861591 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.861970 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.862363 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.862778 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.863256 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.863650 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.864057 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.864539 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.864918 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.865325 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.865721 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.866101 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.866498 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.866920 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.867320 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.867714 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.868090 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.868513 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.868886 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.869267 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.869640 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.870015 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.870391 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.870776 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.871152 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.871540 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.871922 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.872337 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.872722 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.873099 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.873541 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.875118 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.875927 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.876103 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.876580 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.877075 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.877492 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.877917 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.878394 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.878828 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.879264 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.879694 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.880104 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.880591 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.881005 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.881425 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.881844 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.882255 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.882669 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.883087 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.883525 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.883960 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.884422 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.884840 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.885272 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.885740 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.886155 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.886579 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.887028 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.887442 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.887850 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.888313 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.888731 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.889170 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.890358 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.890782 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.891302 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.891693 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.892059 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.892480 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.892856 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.893215 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.893584 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.893957 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.894364 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.894767 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.895168 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.895629 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.896021 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.896448 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.896825 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:18:16.897146 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:18:16.970010 n-d-850468-18 devstack@n-api.service[106538]: INFO dbcounter [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Registered counter for database nova_api Aug 25 12:18:16.993536 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.001790 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writer thread running {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.063640 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.context [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=106538) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:18:17.067747 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:18:17.068383 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:18:17.069943 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:18:17.070792 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:18:17.071172 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:18:17.073325 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:18:17.075628 n-d-850468-18 devstack@n-api.service[106538]: INFO dbcounter [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Registered counter for database nova_cell0 Aug 25 12:18:17.081983 n-d-850468-18 devstack@n-api.service[106538]: INFO dbcounter [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Registered counter for database nova_cell1 Aug 25 12:18:17.094134 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.095199 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.110669 n-d-850468-18 devstack@n-api.service[106539]: INFO dbcounter [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Registered counter for database nova_api Aug 25 12:18:17.112238 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writer thread running {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.114401 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writer thread running {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.143084 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_db.sqlalchemy.engines [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.151662 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writer thread running {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.216366 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.context [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=106539) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:18:17.221371 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:18:17.221892 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:18:17.223548 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:18:17.224407 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:18:17.224853 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:18:17.227160 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_concurrency.lockutils [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:18:17.229316 n-d-850468-18 devstack@n-api.service[106539]: INFO dbcounter [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Registered counter for database nova_cell0 Aug 25 12:18:17.235949 n-d-850468-18 devstack@n-api.service[106539]: INFO dbcounter [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Registered counter for database nova_cell1 Aug 25 12:18:17.244805 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_db.sqlalchemy.engines [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.249875 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_db.sqlalchemy.engines [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.251791 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writer thread running {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.267814 n-d-850468-18 devstack@n-api.service[106538]: INFO dbcounter [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Registered counter for database nova_cell0 Aug 25 12:18:17.279141 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.285444 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writer thread running {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.421695 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writer thread running {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.433836 n-d-850468-18 devstack@n-api.service[106539]: INFO dbcounter [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Registered counter for database nova_cell0 Aug 25 12:18:17.447074 n-d-850468-18 devstack@n-api.service[106539]: DEBUG oslo_db.sqlalchemy.engines [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:18:17.456973 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writer thread running {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:18:17.695760 n-d-850468-18 devstack@n-api.service[106538]: WARNING keystonemiddleware.auth_token [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:18:17.704192 n-d-850468-18 devstack@n-api.service[106538]: WARNING keystonemiddleware.auth_token [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:18:17.875543 n-d-850468-18 devstack@n-api.service[106539]: WARNING keystonemiddleware.auth_token [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:18:17.883269 n-d-850468-18 devstack@n-api.service[106539]: WARNING keystonemiddleware.auth_token [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:18:18.084992 n-d-850468-18 devstack@n-api.service[106538]: WARNING keystonemiddleware.auth_token [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:18:18.091552 n-d-850468-18 devstack@n-api.service[106538]: WARNING keystonemiddleware.auth_token [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:18:18.098267 n-d-850468-18 devstack@n-api.service[106538]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564f1f5029c0 pid: 106538 (default app) Aug 25 12:18:18.100706 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:18:18.101978 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002038 Aug 25 12:18:18.102681 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Thu Aug 25 12:18:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:18:18.260984 n-d-850468-18 devstack@n-api.service[106539]: WARNING keystonemiddleware.auth_token [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:18:18.267822 n-d-850468-18 devstack@n-api.service[106539]: WARNING keystonemiddleware.auth_token [None req-ac38ae62-1ee6-4521-8cba-7d4b034622c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:18:18.273343 n-d-850468-18 devstack@n-api.service[106539]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564f1f5029c0 pid: 106539 (default app) Aug 25 12:19:59.130311 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:19:59.132020 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Aug 25 12:19:59.132697 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:19:59.147199 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_api:SELECT=3 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:19:59.148610 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_cell0:SELECT=3 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:19:59.149597 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_cell1:SELECT=3 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:19:59.150773 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_cell0:SELECT=3 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:00.487997 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-3d6b041f-dfb3-4a26-8edf-b3bb6849f9a7 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:00.522944 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-3d6b041f-dfb3-4a26-8edf-b3bb6849f9a7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.381689 Aug 25 12:20:00.524033 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 12:19:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:04.389137 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:04.389137 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-1ec3bb16-f530-48ac-9720-820075f9c24d None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 25 12:20:04.396630 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:05.050704 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-d94c9564-f243-474b-ba16-00158aaa0a07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "name": "cirros256", "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:05.108965 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-d94c9564-f243-474b-ba16-00158aaa0a07 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.712365 Aug 25 12:20:05.109784 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:20:05.128734 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_api:SELECT=3 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:05.129642 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_cell1:SELECT=3 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:05.130748 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_cell0:SELECT=3 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:05.131922 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:05.368883 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-574196de-e9a0-44d7-b44e-9b5f2b8dfc73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:05.482531 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-574196de-e9a0-44d7-b44e-9b5f2b8dfc73 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360286 Aug 25 12:20:05.483524 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 25 12:20:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:08.522592 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-d94c9564-f243-474b-ba16-00158aaa0a07 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:08.525566 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-d94c9564-f243-474b-ba16-00158aaa0a07 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003745 Aug 25 12:20:08.527098 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:09.722718 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-607998c6-49fe-410d-ab0e-a46f88a194d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:09.809508 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-607998c6-49fe-410d-ab0e-a46f88a194d6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.270475 Aug 25 12:20:09.812085 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:20:09.834673 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-8c917e27-839b-46cb-a39d-9cf4f1ee0ae1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:09.901198 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-8c917e27-839b-46cb-a39d-9cf4f1ee0ae1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070054 Aug 25 12:20:09.903234 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 25 12:20:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:20:13.563540 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-607998c6-49fe-410d-ab0e-a46f88a194d6 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:13.564589 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-607998c6-49fe-410d-ab0e-a46f88a194d6 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 25 12:20:13.571396 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:14.362526 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-ad9e5131-a8f4-4e65-b27e-ec0d7d92bbdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:14.403016 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-ad9e5131-a8f4-4e65-b27e-ec0d7d92bbdd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828583 Aug 25 12:20:14.405353 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:20:14.421439 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-a83a47b5-a182-4e65-8664-42bc9a89349e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:14.477259 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-a83a47b5-a182-4e65-8664-42bc9a89349e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062957 Aug 25 12:20:14.478532 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 25 12:20:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:20:18.360601 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-ad9e5131-a8f4-4e65-b27e-ec0d7d92bbdd admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:18.362467 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-ad9e5131-a8f4-4e65-b27e-ec0d7d92bbdd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002612 Aug 25 12:20:18.363245 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:19.064073 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-cee5aeef-6b92-4ced-8dec-fe9375647a24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:19.089816 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-cee5aeef-6b92-4ced-8dec-fe9375647a24 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715016 Aug 25 12:20:19.090752 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:20:19.113988 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-aa6aaf6b-1545-4abc-b18a-ab58b0ce568e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:19.165817 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-aa6aaf6b-1545-4abc-b18a-ab58b0ce568e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058949 Aug 25 12:20:19.167557 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 25 12:20:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:22.731019 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-cee5aeef-6b92-4ced-8dec-fe9375647a24 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:22.734748 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-cee5aeef-6b92-4ced-8dec-fe9375647a24 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004321 Aug 25 12:20:22.745132 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:23.545356 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:23.587354 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.840247 Aug 25 12:20:23.589437 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:20:23.611788 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-1ea7fe43-e762-4ced-bf2e-112eb70fc812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:23.674034 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-1ea7fe43-e762-4ced-bf2e-112eb70fc812 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071185 Aug 25 12:20:23.676275 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Thu Aug 25 12:20:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:20:27.911164 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:27.913227 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002669 Aug 25 12:20:27.913957 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:28.832268 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-f2fda031-064f-4483-871b-993c111b8f5f admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:28.879880 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-f2fda031-064f-4483-871b-993c111b8f5f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.956380 Aug 25 12:20:28.881007 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 12:20:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:20:33.170240 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:33.171492 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-9a6111f1-811b-4783-b41c-58b57548e833 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Aug 25 12:20:33.172495 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:33.926484 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-59ae0dd6-3615-417b-a9e4-a893cf1f53f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:33.953210 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-59ae0dd6-3615-417b-a9e4-a893cf1f53f5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.771441 Aug 25 12:20:33.953888 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:20:33.977581 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-7500f5a1-e23c-40db-87db-0e68c82d0537 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:33.988035 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:34.030487 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-7500f5a1-e23c-40db-87db-0e68c82d0537 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060011 Aug 25 12:20:34.031497 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 25 12:20:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:38.423194 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-59ae0dd6-3615-417b-a9e4-a893cf1f53f5 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:38.425159 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-59ae0dd6-3615-417b-a9e4-a893cf1f53f5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002659 Aug 25 12:20:38.425945 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:39.130831 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-e90dae52-ad16-484b-8245-7589b736ecb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:39.158085 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-e90dae52-ad16-484b-8245-7589b736ecb0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.720152 Aug 25 12:20:39.159216 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:20:39.174608 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-677d65c3-d9ee-415b-9a8b-9c42d7d10a3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:39.188596 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_api:SELECT=30,nova_api:SAVEPOINT=3,nova_api:INSERT=6,nova_api:RELEASE=3 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:20:39.216696 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-677d65c3-d9ee-415b-9a8b-9c42d7d10a3f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045623 Aug 25 12:20:39.217620 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 25 12:20:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:42.776202 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-e90dae52-ad16-484b-8245-7589b736ecb0 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:42.780661 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-e90dae52-ad16-484b-8245-7589b736ecb0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004707 Aug 25 12:20:42.781939 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:43.555062 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-34014bdf-ca0b-4456-ac37-bb9efa51f978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:43.586839 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-34014bdf-ca0b-4456-ac37-bb9efa51f978 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.794204 Aug 25 12:20:43.587511 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:20:43.607231 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-741a348b-06ad-4069-9f08-e9083d2b923c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:43.638120 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-741a348b-06ad-4069-9f08-e9083d2b923c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034319 Aug 25 12:20:43.639001 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 25 12:20:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:20:47.111587 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-34014bdf-ca0b-4456-ac37-bb9efa51f978 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:47.113741 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-34014bdf-ca0b-4456-ac37-bb9efa51f978 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002841 Aug 25 12:20:47.120723 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:47.977843 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-040a52a7-56ab-4b26-99ff-2aab41eaf433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:48.026188 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-040a52a7-56ab-4b26-99ff-2aab41eaf433 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.896527 Aug 25 12:20:48.026188 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:20:48.049002 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-e31e0403-8352-4bb5-86dd-7c0126f4e70f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:48.105866 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-e31e0403-8352-4bb5-86dd-7c0126f4e70f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067102 Aug 25 12:20:48.124512 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 25 12:20:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:20:51.734318 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-040a52a7-56ab-4b26-99ff-2aab41eaf433 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:20:51.736267 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-040a52a7-56ab-4b26-99ff-2aab41eaf433 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002631 Aug 25 12:20:51.744364 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:20:52.841408 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:52.875735 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.127257 Aug 25 12:20:52.877044 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Thu Aug 25 12:20:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:20:52.897411 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-67575c34-e3a4-404b-b843-1b017fb6d566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:20:52.944418 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-67575c34-e3a4-404b-b843-1b017fb6d566 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052875 Aug 25 12:20:52.945440 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Thu Aug 25 12:20:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:21:19.931972 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:19.933263 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Aug 25 12:21:19.934217 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:19.947707 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_api:SELECT=24,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:21:20.567040 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-35d2f73c-82a2-4e4c-83ca-3c867fb0f435 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:20.604496 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-35d2f73c-82a2-4e4c-83ca-3c867fb0f435 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.661103 Aug 25 12:21:20.605502 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 12:21:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:21:22.286789 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:22.287903 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-3884738c-2116-4b4c-8c28-c70444366954 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 25 12:21:22.288751 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:21:23.365579 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-f91c0030-cd5f-4c7b-aed4-cae231407302 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:23.380659 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.wsgi [None req-f91c0030-cd5f-4c7b-aed4-cae231407302 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-f91c0030-cd5f-4c7b-aed4-cae231407302 admin admin] Request method failure captured: Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Accept: application/json Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Accept-Encoding: gzip, deflate Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Connection: keep-alive Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Content-Length: 0 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Host: 10.222.0.60 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: Openstack-System-Scope: None Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: User-Agent: python-novaclient Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Auth-Token: gAAAAABjB2lCzNg6nogsxammJYPD071efxZYgQCjcb2cJKvVUdw-guraImt4RSdVuboPtkUjzH03cA-OF7QLblSLN-7HmPSzyFv4EX79BOqs3zIHd19IfLP-_tUmuQUY9EIHCiZSNCSH_LzKGP1a4iZt3w-iuH7dlXIjKvSlvt5ME28jUpVLTS0 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Id: None Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Name: None Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Identity-Status: Confirmed Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Is-Admin-Project: True Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Id: default Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Name: Default Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Name: admin Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Role: admin,reader,member Aug 25 12:21:23.386734 n-d-850468-18 devstack@n-api.service[106539]: X-Roles: admin,reader,member Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant: admin Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Name: admin Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-User: admin Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Id: default Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Name: Default Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: X-User-Name: admin Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: method: > Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: exception: Flavor 42 could not be found. Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: action_args: {'id': '42'} Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:23.389732 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:23.391527 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.394229 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-f91c0030-cd5f-4c7b-aed4-cae231407302 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:23.396830 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-f91c0030-cd5f-4c7b-aed4-cae231407302 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.924832 Aug 25 12:21:23.396830 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:21:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 927 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:21:23.408347 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-5a284093-7d8f-408c-ba5f-1f0d4438fe06 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:23.415719 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:21:23.457667 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-5a284093-7d8f-408c-ba5f-1f0d4438fe06 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.056678 Aug 25 12:21:23.458509 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:21:23.482935 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-33d9ae78-78d6-4525-9ba4-d5e3aee4b441 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:23.523720 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-33d9ae78-78d6-4525-9ba4-d5e3aee4b441 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.048359 Aug 25 12:21:23.524675 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:21:23.536716 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-67f60618-4eda-4c23-838f-7d8dedcc23f5 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:23.545282 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.wsgi [None req-67f60618-4eda-4c23-838f-7d8dedcc23f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-67f60618-4eda-4c23-838f-7d8dedcc23f5 admin admin] Request method failure captured: Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Accept: application/json Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Accept-Encoding: gzip, deflate Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Connection: keep-alive Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Content-Length: 0 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Host: 10.222.0.60 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: Openstack-System-Scope: None Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: User-Agent: python-novaclient Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Auth-Token: gAAAAABjB2lCzNg6nogsxammJYPD071efxZYgQCjcb2cJKvVUdw-guraImt4RSdVuboPtkUjzH03cA-OF7QLblSLN-7HmPSzyFv4EX79BOqs3zIHd19IfLP-_tUmuQUY9EIHCiZSNCSH_LzKGP1a4iZt3w-iuH7dlXIjKvSlvt5ME28jUpVLTS0 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Id: None Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Name: None Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Identity-Status: Confirmed Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Is-Admin-Project: True Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Id: default Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Name: Default Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Name: admin Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Role: admin,reader,member Aug 25 12:21:23.548948 n-d-850468-18 devstack@n-api.service[106538]: X-Roles: admin,reader,member Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant: admin Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Name: admin Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-User: admin Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Id: default Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Name: Default Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: X-User-Name: admin Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: method: > Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: exception: Flavor 42 could not be found. Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: action_args: {'id': '42'} Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:23.551782 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:23.553774 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:23.556317 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-67f60618-4eda-4c23-838f-7d8dedcc23f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:23.558546 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-67f60618-4eda-4c23-838f-7d8dedcc23f5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017985 Aug 25 12:21:23.558546 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:21:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:21:25.111436 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-33d9ae78-78d6-4525-9ba4-d5e3aee4b441 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:25.112695 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-33d9ae78-78d6-4525-9ba4-d5e3aee4b441 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 25 12:21:25.113164 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:25.940396 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-0ea8a418-3622-468f-86b7-3353ff091575 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:25.950726 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.wsgi [None req-0ea8a418-3622-468f-86b7-3353ff091575 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-0ea8a418-3622-468f-86b7-3353ff091575 admin admin] Request method failure captured: Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Accept: application/json Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Accept-Encoding: gzip, deflate Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Connection: keep-alive Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Content-Length: 0 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Host: 10.222.0.60 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: Openstack-System-Scope: None Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: User-Agent: python-novaclient Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Auth-Token: gAAAAABjB2lENdOQwXJ3hpgA2W71jvuCr0azV60pqg7De6smJ5f7FjubR5XwBydXL-JI_w77T_saA-cfgvVsGiXz85rhpejYXH9-z0oWK_iT9xoUV_qYqt3pEYlhiwU3efb02-o0PtieyJJOxtegBGzdRkaSxRvTyN0e75PSQLY9tDU87lyatmE Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Id: None Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Name: None Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Identity-Status: Confirmed Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Is-Admin-Project: True Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Id: default Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Name: Default Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Name: admin Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Role: admin,reader,member Aug 25 12:21:25.953537 n-d-850468-18 devstack@n-api.service[106538]: X-Roles: admin,reader,member Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant: admin Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Name: admin Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-User: admin Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Id: default Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Name: Default Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: X-User-Name: admin Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: method: > Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: exception: Flavor 84 could not be found. Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: action_args: {'id': '84'} Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:25.955678 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:25.956776 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:25.959131 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-0ea8a418-3622-468f-86b7-3353ff091575 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:25.961213 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-0ea8a418-3622-468f-86b7-3353ff091575 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.629765 Aug 25 12:21:25.961213 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:21:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 632 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:21:25.970292 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-d283c299-0951-4c42-aeb2-f789f7eb0d5b admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:25.988542 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-d283c299-0951-4c42-aeb2-f789f7eb0d5b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022229 Aug 25 12:21:25.989185 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:21:26.004376 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-9c8a6854-7eb0-43cc-b336-f8aea80144cd admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:26.022291 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-9c8a6854-7eb0-43cc-b336-f8aea80144cd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022721 Aug 25 12:21:26.022964 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:21:26.038054 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-26adecfb-d08a-4177-b68c-9ccb8cecd5a6 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:26.049038 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.wsgi [None req-26adecfb-d08a-4177-b68c-9ccb8cecd5a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-26adecfb-d08a-4177-b68c-9ccb8cecd5a6 admin admin] Request method failure captured: Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Accept: application/json Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Accept-Encoding: gzip, deflate Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Connection: keep-alive Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Content-Length: 0 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Host: 10.222.0.60 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: Openstack-System-Scope: None Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: User-Agent: python-novaclient Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Auth-Token: gAAAAABjB2lENdOQwXJ3hpgA2W71jvuCr0azV60pqg7De6smJ5f7FjubR5XwBydXL-JI_w77T_saA-cfgvVsGiXz85rhpejYXH9-z0oWK_iT9xoUV_qYqt3pEYlhiwU3efb02-o0PtieyJJOxtegBGzdRkaSxRvTyN0e75PSQLY9tDU87lyatmE Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Id: None Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Name: None Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Identity-Status: Confirmed Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Is-Admin-Project: True Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Id: default Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Name: Default Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Name: admin Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Role: admin,reader,member Aug 25 12:21:26.052330 n-d-850468-18 devstack@n-api.service[106539]: X-Roles: admin,reader,member Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant: admin Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Name: admin Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-User: admin Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Id: default Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Name: Default Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: X-User-Name: admin Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: method: > Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: exception: Flavor 84 could not be found. Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: action_args: {'id': '84'} Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:26.054211 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:26.055092 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:26.056779 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-26adecfb-d08a-4177-b68c-9ccb8cecd5a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:26.058901 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-26adecfb-d08a-4177-b68c-9ccb8cecd5a6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.023942 Aug 25 12:21:26.058901 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:21:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:21:27.439847 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-9c8a6854-7eb0-43cc-b336-f8aea80144cd admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:27.441325 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-9c8a6854-7eb0-43cc-b336-f8aea80144cd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Aug 25 12:21:27.441866 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:28.166505 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-84234ada-74ed-486c-beff-ba92bb77ab46 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:28.173972 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.wsgi [None req-84234ada-74ed-486c-beff-ba92bb77ab46 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-84234ada-74ed-486c-beff-ba92bb77ab46 admin admin] Request method failure captured: Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Accept: application/json Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Accept-Encoding: gzip, deflate Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Connection: keep-alive Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Content-Length: 0 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Host: 10.222.0.60 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: Openstack-System-Scope: None Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: User-Agent: python-novaclient Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Auth-Token: gAAAAABjB2lH33wUc603gZcPKuMKzi4ZC1oMLn1H8AeQY8uKw9p_IVZTSmbfeNkFXzc0G0SV6kuix5G6C3NqvnggTLNYjnwvkDuvR9S9ohFwEfFXo4r6NFC8RJoqxzyWQT-lZaRiI3rYG-melLQvPFxKZXtdl9pT-ceJfUam2QCtpS80i1fahRI Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Id: None Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Domain-Name: None Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Identity-Status: Confirmed Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Is-Admin-Project: True Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Id: default Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Domain-Name: Default Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Project-Name: admin Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Role: admin,reader,member Aug 25 12:21:28.175397 n-d-850468-18 devstack@n-api.service[106539]: X-Roles: admin,reader,member Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant: admin Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-Tenant-Name: admin Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-User: admin Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Id: default Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-User-Domain-Name: Default Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: X-User-Name: admin Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: method: > Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: exception: Flavor 451 could not be found. Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: action_args: {'id': '451'} Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:28.178704 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:28.180133 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.182471 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-84234ada-74ed-486c-beff-ba92bb77ab46 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:28.187634 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-84234ada-74ed-486c-beff-ba92bb77ab46 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.590700 Aug 25 12:21:28.187634 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:21:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:21:28.191018 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-2c19f6e0-fe3f-4c99-8405-514d5028481e admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:28.209027 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-2c19f6e0-fe3f-4c99-8405-514d5028481e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022086 Aug 25 12:21:28.209842 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:21:28.225893 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:28.260050 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.041151 Aug 25 12:21:28.261205 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Thu Aug 25 12:21:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:21:28.277185 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-e7cb3baf-8bbc-4732-acf6-aa5a65ef969a admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:28.285470 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.wsgi [None req-e7cb3baf-8bbc-4732-acf6-aa5a65ef969a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-e7cb3baf-8bbc-4732-acf6-aa5a65ef969a admin admin] Request method failure captured: Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Accept: application/json Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Accept-Encoding: gzip, deflate Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Connection: keep-alive Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Content-Length: 0 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Host: 10.222.0.60 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Openstack-Api-Version: compute 2.90 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: Openstack-System-Scope: None Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: User-Agent: python-novaclient Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Auth-Token: gAAAAABjB2lH33wUc603gZcPKuMKzi4ZC1oMLn1H8AeQY8uKw9p_IVZTSmbfeNkFXzc0G0SV6kuix5G6C3NqvnggTLNYjnwvkDuvR9S9ohFwEfFXo4r6NFC8RJoqxzyWQT-lZaRiI3rYG-melLQvPFxKZXtdl9pT-ceJfUam2QCtpS80i1fahRI Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Id: None Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Domain-Name: None Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Identity-Status: Confirmed Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Is-Admin-Project: True Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Id: default Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Domain-Name: Default Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Project-Name: admin Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Role: admin,reader,member Aug 25 12:21:28.287405 n-d-850468-18 devstack@n-api.service[106538]: X-Roles: admin,reader,member Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d9eae35b14724adfbf0bd384f335aeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant: admin Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Id: d9eae35b14724adfbf0bd384f335aeb4 Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-Tenant-Name: admin Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-User: admin Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Id: default Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-User-Domain-Name: Default Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-User-Id: 70a67c36ebc640e5b2387ae7eeb2a47e Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: X-User-Name: admin Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: method: > Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: exception: Flavor 451 could not be found. Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: action_args: {'id': '451'} Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:21:28.290413 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:28.292166 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: ERROR nova.api.openstack.wsgi Aug 25 12:21:28.295052 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-e7cb3baf-8bbc-4732-acf6-aa5a65ef969a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:21:28.297176 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-e7cb3baf-8bbc-4732-acf6-aa5a65ef969a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017047 Aug 25 12:21:28.297176 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:21:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 12:21:29.702678 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:29.704345 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002556 Aug 25 12:21:29.704806 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:30.467354 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-8640e556-2183-4406-bcd1-246c8c822472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:21:30.494372 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-8640e556-2183-4406-bcd1-246c8c822472 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.619348 Aug 25 12:21:30.495153 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 25 12:21:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:21:31.777363 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:31.779490 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002833 Aug 25 12:21:31.780293 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:32.627257 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-581369a6-b461-410b-b94e-3ea5de2ad42a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:21:32.663403 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-581369a6-b461-410b-b94e-3ea5de2ad42a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.724511 Aug 25 12:21:32.664475 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 25 12:21:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:21:34.423041 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:34.424882 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001883 Aug 25 12:21:34.425507 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:35.229035 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-bd999c30-fa57-4e41-996b-3df0aeae1155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:21:35.254329 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-bd999c30-fa57-4e41-996b-3df0aeae1155 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.617227 Aug 25 12:21:35.254895 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 25 12:21:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:21:36.615187 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:36.617057 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Aug 25 12:21:36.617774 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:37.395517 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-a4a832a4-e6ad-427f-9f33-f871da467dbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:21:37.429985 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-a4a832a4-e6ad-427f-9f33-f871da467dbd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.653992 Aug 25 12:21:37.430564 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Thu Aug 25 12:21:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:21:38.882712 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:38.884622 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002689 Aug 25 12:21:38.885372 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:21:39.698555 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-7aa4d332-a5eb-4b7f-bfeb-8bb158488d75 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:21:39.722496 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-7aa4d332-a5eb-4b7f-bfeb-8bb158488d75 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.651830 Aug 25 12:21:39.723066 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Thu Aug 25 12:21:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:22:47.508973 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:47.510754 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-0fb63773-0ad3-48f4-b818-91ac922c47d4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002531 Aug 25 12:22:47.511263 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Thu Aug 25 12:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:22:47.529023 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:22:48.052276 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-4292181a-cf00-4e29-bfe9-f4b25d33991d admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:48.084146 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-4292181a-cf00-4e29-bfe9-f4b25d33991d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.565644 Aug 25 12:22:48.084791 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 12:22:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:22:48.109222 n-d-850468-18 devstack@n-api.service[106539]: DEBUG dbcounter [-] [106539] Writing DB stats nova_api:SELECT=14 {{(pid=106539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:22:48.115964 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-fa6d1f24-a8da-4723-a13e-de9a60952f53 admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:48.126315 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-fa6d1f24-a8da-4723-a13e-de9a60952f53 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019454 Aug 25 12:22:48.127578 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Thu Aug 25 12:22:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:22:48.147107 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-14322c5b-82e7-4548-8f94-a43bd71c6db3 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:48.163325 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-14322c5b-82e7-4548-8f94-a43bd71c6db3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023823 Aug 25 12:22:48.164387 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Thu Aug 25 12:22:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:22:48.180618 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:48.192229 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015772 Aug 25 12:22:48.192671 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Thu Aug 25 12:22:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:22:48.207962 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-9418090c-48d8-48f5-ae43-e30c0dc189b7 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:22:48.223791 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-9418090c-48d8-48f5-ae43-e30c0dc189b7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020645 Aug 25 12:22:48.224905 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Thu Aug 25 12:22:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:28:44.085411 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:44.086993 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002663 Aug 25 12:28:44.087429 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:44.231777 n-d-850468-18 devstack@n-api.service[106538]: DEBUG dbcounter [-] [106538] Writing DB stats nova_api:SELECT=6 {{(pid=106538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:28:44.377896 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:44.382199 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:28:44.382667 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:28:44.383089 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:28:44.383796 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:28:44.384270 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:28:44.384684 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:28:44.427323 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-fd2f6f1b-2830-45c8-a78c-21f728784442 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.196907 Aug 25 12:28:44.428448 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:28:44 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:28:45.293136 n-d-850468-18 devstack@n-api.service[106539]: DEBUG nova.api.openstack.wsgi [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] Calling method '>' {{(pid=106539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:45.294143 n-d-850468-18 devstack@n-api.service[106539]: INFO nova.api.openstack.requestlog [None req-e3a778b1-6c5c-4ffc-9fc1-0dc8a57380ed admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 25 12:28:45.294533 n-d-850468-18 devstack@n-api.service[106539]: [pid: 106539|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Thu Aug 25 12:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:28:45.496341 n-d-850468-18 devstack@n-api.service[106538]: DEBUG nova.api.openstack.wsgi [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Calling method '>' {{(pid=106538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:28:45.499935 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:28:45.500444 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:28:45.500872 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:28:45.501583 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:28:45.502577 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:28:45.502996 n-d-850468-18 devstack@n-api.service[106538]: DEBUG oslo_concurrency.lockutils [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:28:45.528638 n-d-850468-18 devstack@n-api.service[106538]: INFO nova.api.openstack.requestlog [None req-5074d690-f510-49c0-a3ce-476996b64bb3 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.090105 Aug 25 12:28:45.529255 n-d-850468-18 devstack@n-api.service[106538]: [pid: 106538|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:28:45 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:29:32.988450 n-d-850468-18 devstack@n-api.service[106537]: Thu Aug 25 12:29:32 2022 - graceful shutdown triggered... Aug 25 12:29:32.988507 n-d-850468-18 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 12:29:32.989570 n-d-850468-18 devstack@n-api.service[106538]: Gracefully killing worker 1 (pid: 106538)... Aug 25 12:29:32.990605 n-d-850468-18 devstack@n-api.service[106539]: Gracefully killing worker 2 (pid: 106539)... Aug 25 12:29:33.990685 n-d-850468-18 devstack@n-api.service[106537]: worker 1 buried after 1 seconds Aug 25 12:29:33.990685 n-d-850468-18 devstack@n-api.service[106537]: worker 2 buried after 1 seconds Aug 25 12:29:33.990685 n-d-850468-18 devstack@n-api.service[106537]: goodbye to uWSGI. Aug 25 12:29:33.992473 n-d-850468-18 systemd[1]: devstack@n-api.service: Succeeded. Aug 25 12:29:33.993035 n-d-850468-18 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 12:29:33.995898 n-d-850468-18 systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 12:29:34.019709 n-d-850468-18 devstack@n-api.service[122688]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 12:29:34 2022] *** Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: nodename: n-d-850468-18 Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: machine: x86_64 Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: clock source: unix Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: pcre jit disabled Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: detected number of CPU cores: 4 Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: current working directory: / Aug 25 12:29:34.032537 n-d-850468-18 devstack@n-api.service[122688]: detected binary path: /usr/bin/uwsgi-core Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: your processes number limit is 47680 Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: your memory page size is 4096 bytes Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: detected max file descriptor number: 2048 Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: lock engine: pthread robust mutexes Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: thunder lock: enabled Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 12:29:34.033460 n-d-850468-18 devstack@n-api.service[122688]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 12:29:34.074415 n-d-850468-18 devstack@n-api.service[122688]: Python main interpreter initialized at 0x5616830fb9c0 Aug 25 12:29:34.074415 n-d-850468-18 devstack@n-api.service[122688]: python threads support enabled Aug 25 12:29:34.074415 n-d-850468-18 devstack@n-api.service[122688]: your server socket listen backlog is limited to 100 connections Aug 25 12:29:34.074415 n-d-850468-18 devstack@n-api.service[122688]: your mercy for graceful operations on workers is 90 seconds Aug 25 12:29:34.074897 n-d-850468-18 devstack@n-api.service[122688]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 12:29:34.074897 n-d-850468-18 devstack@n-api.service[122688]: *** Operational MODE: preforking *** Aug 25 12:29:34.075145 n-d-850468-18 devstack@n-api.service[122688]: *** uWSGI is running in multiple interpreter mode *** Aug 25 12:29:34.075145 n-d-850468-18 devstack@n-api.service[122688]: spawned uWSGI master process (pid: 122688) Aug 25 12:29:34.075368 n-d-850468-18 systemd[1]: Started Devstack devstack@n-api.service. Aug 25 12:29:34.086127 n-d-850468-18 devstack@n-api.service[122688]: spawned uWSGI worker 1 (pid: 122700, cores: 1) Aug 25 12:29:34.086127 n-d-850468-18 devstack@n-api.service[122688]: spawned uWSGI worker 2 (pid: 122701, cores: 1) Aug 25 12:29:34.086127 n-d-850468-18 devstack@n-api.service[122688]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 12:29:34.762334 n-d-850468-18 devstack@n-api.service[122701]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:29:34.765367 n-d-850468-18 devstack@n-api.service[122700]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 12:29:35.989063 n-d-850468-18 devstack@n-api.service[122701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:29:35.989063 n-d-850468-18 devstack@n-api.service[122701]: from cryptography.utils import int_from_bytes Aug 25 12:29:35.990478 n-d-850468-18 devstack@n-api.service[122701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:29:35.990478 n-d-850468-18 devstack@n-api.service[122701]: from cryptography.utils import int_from_bytes Aug 25 12:29:35.997404 n-d-850468-18 devstack@n-api.service[122700]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:29:35.997404 n-d-850468-18 devstack@n-api.service[122700]: from cryptography.utils import int_from_bytes Aug 25 12:29:35.998010 n-d-850468-18 devstack@n-api.service[122700]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 12:29:35.998010 n-d-850468-18 devstack@n-api.service[122700]: from cryptography.utils import int_from_bytes Aug 25 12:29:38.501991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:29:38.502700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:29:38.502790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:29:38.503245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:29:38.503462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:29:38.503797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.504148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.504486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.504888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.505925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.506149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 12:29:38.506701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 12:29:38.506896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 12:29:38.507008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.507264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.507371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 12:29:38.507595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.507793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 12:29:38.507954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-18 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.508973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.509201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.509305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.509520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.509740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.509844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.510898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.511131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.511320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.511594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.511775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.512200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.512524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-18 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.513932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.514989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.515226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.515591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.515858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.516920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-18 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.517816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.518964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.519881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.520072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.520202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-18 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.520612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.520973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.521613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.521777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.521891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.521985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.522552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.522849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.523581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.523710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.523865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.524952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.525937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.526951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.527932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.528912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.529920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.530879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.531944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.532939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.533931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.534982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.535974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.536155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.536297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.536563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.536706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.536834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.537970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.538839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.539976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.540964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.541912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.542974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.543151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.543448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.543553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.543770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.543874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.544842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.545790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.546935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.547962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.548936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.549876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.550798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.551955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.552051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.552344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.552476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.552692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.552944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.553112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.553225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.553380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.553500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.553703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.553820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.554044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.554141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.554374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.554465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.554698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.554801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.555015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.555111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.555330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.555427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.555646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.555745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.555969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.556065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 12:29:38.556318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.556425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.556638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.556735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.556964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.557954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.558919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.559977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.560988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.561990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.562959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.563995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.564892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.565798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.566783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.567013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.567117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.567351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.567477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.567665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.568340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.568541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.568682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.568871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.568984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.569986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.570924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.571884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.572895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.573871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.574990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.575950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.576049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.576734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.576837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.576937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.577931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.578884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.579841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.580862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.581997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.582962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.583206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.583423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.584258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.584534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.584907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.585161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.585474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.585787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.586099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.586435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.586751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.587065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.587372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.587630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.587764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.588003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.588103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.588371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.588734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.589094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.589438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.589549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.589772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.589887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.590105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.590200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.590431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.590756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.590966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.591321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.591502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.591654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.591944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.592045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.592322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.592564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.592666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.592991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.593177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.593299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.593700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.594037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.594376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.594732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.595124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.595239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.595480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.595734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.595885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.596920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.597148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.597260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.597483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.597628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.597861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.598191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.598533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.598863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.599288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.599605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.599709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.599934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.600948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.601943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.602923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.603983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.604228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.604341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.604570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.604691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.604900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.605968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.606935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.607940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.608878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.609816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.610780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.611954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.612138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.612297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.612476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.612697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.612827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.613787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.614007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.614105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.614321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.614442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.614779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.615851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.616805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.617993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.618935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.619969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.620965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.621932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.622888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.623144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.623249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.623422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.623515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.623742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.624798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.625994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.626952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.627954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.628926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.629876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.630076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.630166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.631975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.632955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.633876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.634860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.635810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.636827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.637066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.637168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.637378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.637471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.637934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.638980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.639917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.640933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.641840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.642985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.643926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.644988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.645940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.646801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.646908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.647934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.648894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.649837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.650780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.651935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.652997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.653924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.654922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.655804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.656981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.657948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.658984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.659925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.660920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.661123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.661217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.661479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.662202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.662435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.662536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.662826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.663898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.664882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.665858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.666098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.686642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.686965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.686965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.687295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.687295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.687816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.688070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.688434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.688685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.689264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.689264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.689946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.690818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.691029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.691160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.691314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.691614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.692029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.692312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.692513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.693998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.694359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.694801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.694983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.695173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.695447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.695784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.696300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.696645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.696987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.697295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.697693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.698003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.698357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.698711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.699462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.699801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.700073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.700335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.700538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.700778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.700983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.701318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.701603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.701842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.702128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.702355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.702504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.702634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.702634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.703967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.704746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.705893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.706101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.706199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.706423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.706681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.706869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.707830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.708079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.708267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.708461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.709824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.710997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.711974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.712959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.713965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.714894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.715949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.716945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.717911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.718938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.719928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.720785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.721991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.722992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.723068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.723317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.723393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.723634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.723708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.724515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.724786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.725884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.726905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.727849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.728838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.729838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.730967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.731979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.732287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.732381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.732637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.732714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.732969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.733949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.734907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.735849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.736863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.737116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.737199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.737441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.737528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.737808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.738826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.739078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.739155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.739404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.739481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.740376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.740510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.740627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.740711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.740947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.741982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.742928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.743881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.744144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.744326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.744459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.744714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.744792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.745835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.746982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.747913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.748915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.749874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.750173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.750450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.750538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.750600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.750759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.751806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.752821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.753938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.754950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.755074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.755796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.755925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.756342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.756662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.756853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.756987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.757974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.758937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.759897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.760076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.760778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.760877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.760993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.761842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.762076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.762152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.762400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.762482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.762976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.763947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.764943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.765997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.766244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.766330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.766604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.766683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.766933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.767041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.767415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.767493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.767745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.767823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.768874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.769846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.770084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.770168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.770418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.770497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.770814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.771704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.771704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.771905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.771968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.772941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.773889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.774825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.775983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.776963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.777967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.778893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.779810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.780889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.781869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.782856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.783982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.784978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.785270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.785419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.785618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.785875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.785970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.786200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.786280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.787996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.788975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.789918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.790874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.791813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.792790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.793975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.794984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.795070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.795341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.795488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.795679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.795831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.796977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:29:38.797180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.797506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.797843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.798167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.798722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.799083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.799400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.799726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.800048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.800426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.800765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.801106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.801575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.801911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.802961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.803325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.804034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.804436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.804923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.805285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.805608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.805932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.806325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.806593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.806916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.807235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.807651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.807888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.808262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.808599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.808920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.809260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.809595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.809961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.810287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.810646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.810982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.811307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.811744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.811941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 12:29:38.812297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 12:29:38.860938 n-d-850468-18 devstack@n-api.service[122700]: INFO dbcounter [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Registered counter for database nova_api Aug 25 12:29:38.878205 n-d-850468-18 devstack@n-api.service[122701]: INFO dbcounter [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Registered counter for database nova_api Aug 25 12:29:38.882583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_db.sqlalchemy.engines [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:38.892069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writer thread running {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:38.904678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_db.sqlalchemy.engines [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:38.917156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writer thread running {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:38.954482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.context [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122700) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:29:38.958402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:29:38.959066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:29:38.960691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:29:38.961452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:29:38.961899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:29:38.963913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:29:38.965955 n-d-850468-18 devstack@n-api.service[122700]: INFO dbcounter [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Registered counter for database nova_cell0 Aug 25 12:29:38.970158 n-d-850468-18 devstack@n-api.service[122700]: INFO dbcounter [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Registered counter for database nova_cell1 Aug 25 12:29:38.977857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_db.sqlalchemy.engines [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:38.982354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_db.sqlalchemy.engines [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:38.992965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writer thread running {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:38.993503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writer thread running {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:39.025088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.context [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122701) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 12:29:39.032567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:29:39.033393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:29:39.037169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:29:39.038471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:29:39.039251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:29:39.042998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:29:39.046560 n-d-850468-18 devstack@n-api.service[122701]: INFO dbcounter [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Registered counter for database nova_cell0 Aug 25 12:29:39.054431 n-d-850468-18 devstack@n-api.service[122701]: INFO dbcounter [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Registered counter for database nova_cell1 Aug 25 12:29:39.065694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_db.sqlalchemy.engines [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:39.069223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_db.sqlalchemy.engines [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:39.087973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writer thread running {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:39.090184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writer thread running {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:39.157171 n-d-850468-18 devstack@n-api.service[122700]: INFO dbcounter [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Registered counter for database nova_cell0 Aug 25 12:29:39.165868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_db.sqlalchemy.engines [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:39.171175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writer thread running {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:39.372870 n-d-850468-18 devstack@n-api.service[122701]: INFO dbcounter [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Registered counter for database nova_cell0 Aug 25 12:29:39.383680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_db.sqlalchemy.engines [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 12:29:39.392475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writer thread running {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 12:29:39.502155 n-d-850468-18 devstack@n-api.service[122700]: WARNING keystonemiddleware.auth_token [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:29:39.510980 n-d-850468-18 devstack@n-api.service[122700]: WARNING keystonemiddleware.auth_token [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:29:39.752747 n-d-850468-18 devstack@n-api.service[122701]: WARNING keystonemiddleware.auth_token [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:29:39.761580 n-d-850468-18 devstack@n-api.service[122701]: WARNING keystonemiddleware.auth_token [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:29:39.860613 n-d-850468-18 devstack@n-api.service[122700]: WARNING keystonemiddleware.auth_token [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:29:39.867264 n-d-850468-18 devstack@n-api.service[122700]: WARNING keystonemiddleware.auth_token [None req-feae8ef7-d40f-46b6-89a6-78c3de6567d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:29:39.872605 n-d-850468-18 devstack@n-api.service[122700]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5616830fb9c0 pid: 122700 (default app) Aug 25 12:29:40.113627 n-d-850468-18 devstack@n-api.service[122701]: WARNING keystonemiddleware.auth_token [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 12:29:40.119926 n-d-850468-18 devstack@n-api.service[122701]: WARNING keystonemiddleware.auth_token [None req-0840fc92-b7b3-441b-9b84-7b3bb12e802c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 12:29:40.125294 n-d-850468-18 devstack@n-api.service[122701]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616830fb9c0 pid: 122701 (default app) Aug 25 12:30:23.991012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:23.991902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:23.993601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:23.998298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:24.903821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:24.904836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:24.906224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:24.907312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:26.129173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0ed4dcb-74c8-4dfb-b00e-3ad58f8dcbd5 tempest-AZAdminNegativeTestJSON-61039723 tempest-AZAdminNegativeTestJSON-61039723-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:26.137448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d0ed4dcb-74c8-4dfb-b00e-3ad58f8dcbd5 tempest-AZAdminNegativeTestJSON-61039723 tempest-AZAdminNegativeTestJSON-61039723-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'aa54df7dfa164024a1614b10feb70b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be005126922b4e6a9fad4134d767e047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0ed4dcb-74c8-4dfb-b00e-3ad58f8dcbd5 tempest-AZAdminNegativeTestJSON-61039723 tempest-AZAdminNegativeTestJSON-61039723-project] Request method failure captured: Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tcKOOhlmGKd-3LQEPHfFQmcJ4BZz7CyOH6itsfTpU5mChx2bznaBlS24C-05ksAVeTl5rkR0XqCPENaxdHPqL5EvVdvRq27kTrzKn0Eqv3RqTDDMLyimwlFLs7irwWIj1g_pkN9epdfREcOklwr-U7OseGXjz4uyguXNI_f6aFzBA Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: be005126922b4e6a9fad4134d767e047 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AZAdminNegativeTestJSON-61039723 Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:30:26.146658 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_be005126922b4e6a9fad4134d767e047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/be005126922b4e6a9fad4134d767e047"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/be005126922b4e6a9fad4134d767e047"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/be005126922b4e6a9fad4134d767e047"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AZAdminNegativeTestJSON-61039723 Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: be005126922b4e6a9fad4134d767e047 Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-61039723 Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AZAdminNegativeTestJSON-61039723-project Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: aa54df7dfa164024a1614b10feb70b57 Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AZAdminNegativeTestJSON-61039723-project Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:30:26.147904 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:30:26.148692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:26.149605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0ed4dcb-74c8-4dfb-b00e-3ad58f8dcbd5 tempest-AZAdminNegativeTestJSON-61039723 tempest-AZAdminNegativeTestJSON-61039723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:26.150563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0ed4dcb-74c8-4dfb-b00e-3ad58f8dcbd5 tempest-AZAdminNegativeTestJSON-61039723 tempest-AZAdminNegativeTestJSON-61039723-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 2.164139 Aug 25 12:30:26.155285 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:30:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 2172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:30:26.818555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Calling method '.version_select at 0x7fc6c43bcaf0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:26.844212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122701) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 25 12:30:26.845173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:26.845645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:26.846346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:26.901184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:26.902679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:26.903808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:26.946480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:26.948729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:26.955252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:26.985858 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45ce9391-702a-4ef4-98a5-773f96c9eed9 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 2.091888 Aug 25 12:30:27.000143 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1208 bytes} [Thu Aug 25 12:30:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:30:27.014385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7b67df6-f653-45ec-aa10-2cf7ef778df0 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-190279782"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:27.082397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-f7b67df6-f653-45ec-aa10-2cf7ef778df0 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Generated uuid 51e97f46-0a4c-492e-b256-9b0850d4df2f for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:30:27.248808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7b67df6-f653-45ec-aa10-2cf7ef778df0 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.241027 Aug 25 12:30:27.260814 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2/3] 10.222.0.60 () {62 vars in 1205 bytes} [Thu Aug 25 12:30:27 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:27.713849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96c2712f-4a14-4227-8b04-b3ec32171d9f tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-225813764", "id": 1555475258, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:27.906862 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96c2712f-4a14-4227-8b04-b3ec32171d9f tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 1.182964 Aug 25 12:30:27.919005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2/4] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:26 2022] POST /compute/v2.1/flavors => generated 429 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:27.925253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0705e662-a32e-4b5d-a786-94a3b86654a8 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-86224370"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:28.256756 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0705e662-a32e-4b5d-a786-94a3b86654a8 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 297 microversion: 2.41 time: 0.334037 Aug 25 12:30:28.262295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3/5] 10.222.0.60 () {62 vars in 1210 bytes} [Thu Aug 25 12:30:27 2022] PUT /compute/v2.1/os-aggregates/1 => generated 297 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:28.300852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.309345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.311603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.314522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.317751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.318543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.321059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.452849 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5015f525-3ef1-405e-9391-779614a2d770 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.199701 Aug 25 12:30:28.453481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1164 bytes} [Thu Aug 25 12:30:27 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:28.580911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '.version_select at 0x7fc6c3a224c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.587927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.589410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.594044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.650280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c41c7430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.671801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122700) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 25 12:30:28.681089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.683532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.684042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.685309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.685912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.686499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.727980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.730840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.731429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.775987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7181a06-450d-4f8f-b5dc-2bf187778853 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.320869 Aug 25 12:30:28.777059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 12:30:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:28.777491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.778512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.779098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.803570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5c89324-147d-4bfb-85e8-46775e17061a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.812616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.814068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.814758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.844858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2dcf5b72-2993-4dd7-a755-b459fd3e17ad tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.580853 Aug 25 12:30:28.845469 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:28.882018 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5c89324-147d-4bfb-85e8-46775e17061a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1555475258" status: 202 len: 0 microversion: 2.1 time: 0.100614 Aug 25 12:30:28.883107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:30:28 2022] DELETE /compute/v2.1/flavors/1555475258 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:28.905904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c8222a56-8011-4290-a5dc-65d6e803d169 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.959339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:28.966974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.972571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c8222a56-8011-4290-a5dc-65d6e803d169 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 297 microversion: 2.41 time: 0.088014 Aug 25 12:30:28.973193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 6/10] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:30:28 2022] GET /compute/v2.1/os-aggregates/1 => generated 297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:28.985709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.986457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.987444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:28.988270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:28.989726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:28.999470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.012811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.024755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.025306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.026510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.027067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.027563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.079549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aebcc440-2ce8-498a-9018-7da8ddae1594 tempest-AZAdminV2TestJSON-523657986 tempest-AZAdminV2TestJSON-523657986-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.086239 Aug 25 12:30:29.085083 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:30:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:29.095119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c39cad30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.102259 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a899dba8-ff98-42d0-8d26-b6c6a5fde343 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.255621 Aug 25 12:30:29.103775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.104476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.106331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.108537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:30:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:29.113390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed99eaa0-bf1c-4b50-9ee1-e60f89b9fc2a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.164324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.166912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.173018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.209608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.210459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.211229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.222543 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed99eaa0-bf1c-4b50-9ee1-e60f89b9fc2a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.111442 Aug 25 12:30:29.230726 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ce00c10-d74b-47af-a35f-e846b97fc031 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.141708 Aug 25 12:30:29.231771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:29.253085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:29.271907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38a9dedf-5fd9-4eb0-a8c2-e2a415f1abc6 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1319585434", "id": 1283345014, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:29.292550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f25304df-14ba-4b2a-a11f-88b379514f2a tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:29.314324 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38a9dedf-5fd9-4eb0-a8c2-e2a415f1abc6 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.057734 Aug 25 12:30:29.325280 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 7/15] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:29 2022] POST /compute/v2.1/flavors => generated 417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:29.330385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c39b0040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.337631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.338727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.339337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.355946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f25304df-14ba-4b2a-a11f-88b379514f2a tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.357292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f25304df-14ba-4b2a-a11f-88b379514f2a tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.362928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f25304df-14ba-4b2a-a11f-88b379514f2a tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.399610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.404349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.405897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.439249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.441654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.444931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.461553 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd7e86a5-8950-4770-adbb-fdc09725314c tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.134678 Aug 25 12:30:29.477174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:29.499581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e638978-ebad-4c52-883e-1f473843aee2 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.558382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e638978-ebad-4c52-883e-1f473843aee2 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.076266 Aug 25 12:30:29.567289 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 9/17] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:29.580196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c3989700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.600307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.601288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.605546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.714765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.715911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.732185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:29.776320 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e270c7f-527d-4ab9-b668-534b7a4b568d tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.181551 Aug 25 12:30:29.784957 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 10/18] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:29.804146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e57319ea-736e-4d2c-866d-b5bfcd8a798a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.929784 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e57319ea-736e-4d2c-866d-b5bfcd8a798a tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1283345014" status: 202 len: 0 microversion: 2.1 time: 0.141372 Aug 25 12:30:29.933633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 11/19] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:30:29 2022] DELETE /compute/v2.1/flavors/1283345014 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:29.947590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4aa55a3-76df-4e8f-8d48-c05e14215a16 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c39b0f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:29.960748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4aa55a3-76df-4e8f-8d48-c05e14215a16 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:29.960748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4aa55a3-76df-4e8f-8d48-c05e14215a16 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:29.963294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4aa55a3-76df-4e8f-8d48-c05e14215a16 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.053592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4aa55a3-76df-4e8f-8d48-c05e14215a16 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.110834 Aug 25 12:30:30.066266 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 12/20] 10.222.0.60 () {58 vars in 1179 bytes} [Thu Aug 25 12:30:29 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:30.081858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e859e457-07db-48f0-9ccf-bde1456f5dd9 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:30.123379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e859e457-07db-48f0-9ccf-bde1456f5dd9 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054280 Aug 25 12:30:30.125535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 13/21] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:30.133688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c390fd30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:30.141297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.156438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.158967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.196455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.197492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.198366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.229883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.233354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.241543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.259946 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-356b6385-ff82-4c2a-adc6-391ccf32178f tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.132643 Aug 25 12:30:30.267140 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 14/22] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:30.323402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3bd41ea-cec8-49c9-b51b-94f8014e2b30 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-975357395", "id": 175753074, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:30.411151 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c3bd41ea-cec8-49c9-b51b-94f8014e2b30 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.132868 Aug 25 12:30:30.412957 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 15/23] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:30.426168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c3921160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:30.432708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.434020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.437173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.484663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.488217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.488843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.524511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f8d14bf6-4db0-4e44-bdf1-237d9190a7d9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.107748 Aug 25 12:30:30.536569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 16/24] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:30:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:30.559801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-117dc16e-afab-45a5-bfca-0360377ba5f5 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:30.745145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-117dc16e-afab-45a5-bfca-0360377ba5f5 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/175753074" status: 202 len: 0 microversion: 2.1 time: 0.212174 Aug 25 12:30:30.753076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 17/25] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:30 2022] DELETE /compute/v2.1/flavors/175753074 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:30.767183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c390f820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:30.773548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.775701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.777766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.831303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:30.835336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:30.839088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:30.869782 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d5e192b-a4b7-4ad8-bc97-7db6bf108ba9 tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.112829 Aug 25 12:30:30.873721 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 18/26] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:30:30 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:30.893005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc0857ad-e75d-4d70-a2f1-d729e1012b3b tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.018190 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc0857ad-e75d-4d70-a2f1-d729e1012b3b tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.142274 Aug 25 12:30:31.019627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 19/27] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:31.050419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Calling method '.version_select at 0x7fc6c42d19d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.055235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.055753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.056408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.100328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.101310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.102106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.141504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.142116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.142806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.156934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:30:31.157603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd1b39cd-1eb2-46ae-9255-e4d11923f9be tempest-HypervisorAdminTestJSON-1675934803 tempest-HypervisorAdminTestJSON-1675934803-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:30:31.159283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.160069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.161041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.162715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.163889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.164753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.185092 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.rpcapi [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 12:30:31.186497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] Releasing lock "compute-rpcapi-router" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:30:31.306167 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92b90951-eef8-40e0-b2fc-f4ca0bf62d30 None None] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.260448 Aug 25 12:30:31.308509 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 20/28] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:30:31 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:31.380509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f31d14e9-a572-4ece-a40f-6a03604329d1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1339377919", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:31.436858 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f25304df-14ba-4b2a-a11f-88b379514f2a tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 2.203399 Aug 25 12:30:31.439200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 9/29] 10.222.0.60 () {62 vars in 1232 bytes} [Thu Aug 25 12:30:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:31.459623 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f31d14e9-a572-4ece-a40f-6a03604329d1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.148453 Aug 25 12:30:31.466260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-30ed5dad-9af9-4957-84c3-7d654a90cd10 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:31.470814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 21/30] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:31.520063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a069d995-d8d7-468e-8858-0e3e0846e580 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.529079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30ed5dad-9af9-4957-84c3-7d654a90cd10 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:31.533192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30ed5dad-9af9-4957-84c3-7d654a90cd10 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:31.541050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30ed5dad-9af9-4957-84c3-7d654a90cd10 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:31.558724 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a069d995-d8d7-468e-8858-0e3e0846e580 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/ae1a1b7d-5965-476c-90b9-bd0bc3951ec7" status: 202 len: 0 microversion: 2.1 time: 0.069753 Aug 25 12:30:31.559936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 22/31] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:30:31 2022] DELETE /compute/v2.1/flavors/ae1a1b7d-5965-476c-90b9-bd0bc3951ec7 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:31.581466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97174f39-a272-4fa1-bc7c-52ef2e9b30a0 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.634474 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97174f39-a272-4fa1-bc7c-52ef2e9b30a0 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058750 Aug 25 12:30:31.649652 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 23/32] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:31.670175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acf05c4f-b3ec-470a-96fe-bf7195dae23c tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-195999553", "id": "2af5993b-b11c-4e8a-88e3-ea8710bb9eeb", "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:31.703699 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acf05c4f-b3ec-470a-96fe-bf7195dae23c tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.038380 Aug 25 12:30:31.714093 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 24/33] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:31 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:31.724610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0040254-a09a-4f8e-a457-058aaf3f5eac tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.754511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0040254-a09a-4f8e-a457-058aaf3f5eac tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2af5993b-b11c-4e8a-88e3-ea8710bb9eeb" status: 202 len: 0 microversion: 2.1 time: 0.038149 Aug 25 12:30:31.760463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 25/34] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:30:31 2022] DELETE /compute/v2.1/flavors/2af5993b-b11c-4e8a-88e3-ea8710bb9eeb => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:31.773141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95788e42-b5eb-4990-a9ca-85eddd253a44 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.887599 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95788e42-b5eb-4990-a9ca-85eddd253a44 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.125344 Aug 25 12:30:31.908800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-30ed5dad-9af9-4957-84c3-7d654a90cd10 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.41 time: 0.454276 Aug 25 12:30:31.913476 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 10/35] 10.222.0.60 () {62 vars in 1232 bytes} [Thu Aug 25 12:30:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 12:30:31.921670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 26/36] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:31.945410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5daf2d9d-a3ab-4686-a257-7db38f303829 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:31.945739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-951b51e3-d385-4977-aac0-ebef10d27fd1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1620034399", "id": 929283506, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:32.014061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5daf2d9d-a3ab-4686-a257-7db38f303829 tempest-AggregatesAdminTestV241-51868951 tempest-AggregatesAdminTestV241-51868951-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.084768 Aug 25 12:30:32.021382 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 27/37] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:30:31 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:32.057795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-951b51e3-d385-4977-aac0-ebef10d27fd1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.138351 Aug 25 12:30:32.073072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f20cc1ad-4233-41a7-8528-ae9299b0e375 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1962479095", "name": "tempest-test_aggregate-75213651"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:32.076475 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 11/38] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:31 2022] POST /compute/v2.1/flavors => generated 411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:32.109219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00865ed9-4b1b-4ff0-ac1f-6c3e2b212419 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:32.125493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-f20cc1ad-4233-41a7-8528-ae9299b0e375 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 83b120dd-4a0c-4a1b-8914-36c51cd1fa59 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:30:32.142455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:32.206425 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00865ed9-4b1b-4ff0-ac1f-6c3e2b212419 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/929283506" status: 200 len: 411 microversion: 2.1 time: 0.121821 Aug 25 12:30:32.227847 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 12/39] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:30:32 2022] GET /compute/v2.1/flavors/929283506 => generated 411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:32.264651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f20cc1ad-4233-41a7-8528-ae9299b0e375 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.201458 Aug 25 12:30:32.264651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 28/40] 10.222.0.60 () {60 vars in 1165 bytes} [Thu Aug 25 12:30:32 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:32.289621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9da4eea8-5671-4283-b025-32895d938525 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:32.315401 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9da4eea8-5671-4283-b025-32895d938525 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.041636 Aug 25 12:30:32.316403 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 29/41] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:30:32 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:32.334434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-489eabb7-31fb-4265-bb6b-f0da0fe3d00c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:32.376761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-489eabb7-31fb-4265-bb6b-f0da0fe3d00c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:32.377534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-489eabb7-31fb-4265-bb6b-f0da0fe3d00c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:32.378896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-489eabb7-31fb-4265-bb6b-f0da0fe3d00c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:33.345743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb8db2d7-0df6-4959-a496-1ee81c352965 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:33.520932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb8db2d7-0df6-4959-a496-1ee81c352965 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 1.289099 Aug 25 12:30:33.522984 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 13/42] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:32 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:33.562752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc8ecbaa-9fdc-4ea5-9e3b-18f0c81a03bd tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:33.620936 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc8ecbaa-9fdc-4ea5-9e3b-18f0c81a03bd tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/929283506" status: 202 len: 0 microversion: 2.1 time: 0.068929 Aug 25 12:30:33.628502 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 14/43] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:33 2022] DELETE /compute/v2.1/flavors/929283506 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:33.640876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7d0ef3a-71b5-4f33-9c71-83d885733d44 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:33.707305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7d0ef3a-71b5-4f33-9c71-83d885733d44 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075543 Aug 25 12:30:33.712658 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 15/44] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:33.736899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c6c2410-6786-4e84-8b08-c937760a2b74 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-566318703", "id": 919607850, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:33.774677 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c6c2410-6786-4e84-8b08-c937760a2b74 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.047414 Aug 25 12:30:33.789766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 16/45] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:33 2022] POST /compute/v2.1/flavors => generated 426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:30:33.803387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-755ee690-514d-4ed1-ad7b-3194d2bc23b9 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "919607850"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:33.841861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-755ee690-514d-4ed1-ad7b-3194d2bc23b9 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] HTTP exception thrown: Flavor 919607850 could not be found. Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-755ee690-514d-4ed1-ad7b-3194d2bc23b9 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Request method failure captured: Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 106 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2teV1nldbU__BTJRray-QiIahtHoNnxjg3OCCI9NIFXDjkoa84r0HnP89p_OxgcRfWQyYoLfxj2KU_k4JP7nN6a7-9BHn_T0diQirf4cepD1FYLq80wBjRNA-6hHfGEm5mX9gRfrG50Emeb4B71iiTDlcN-em0PmemYFpGexVi-UbM Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 79828464a49e42c49fb0bdebec3107d3 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsAdminTestJSON-2100881285 Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:30:33.857492 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_79828464a49e42c49fb0bdebec3107d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/79828464a49e42c49fb0bdebec3107d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79828464a49e42c49fb0bdebec3107d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/79828464a49e42c49fb0bdebec3107d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsAdminTestJSON-2100881285 Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 79828464a49e42c49fb0bdebec3107d3 Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2100881285 Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsAdminTestJSON-2100881285-project Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a3b662b3a9584ee8afb095e72cbbf26a Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsAdminTestJSON-2100881285-project Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "test", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "919607850"}} Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:30:33.858841 n-d-850468-18 devstack@n-api.service[122701]: exception: Flavor 919607850 could not be found. Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '919607850'}}} Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 919607850 could not be found. Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:33.859649 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 919607850 could not be found. Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:33.861198 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:33.862456 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:33.862456 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:30:33.862456 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:30:33.862456 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 919607850 could not be found. Aug 25 12:30:33.862456 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:33.867955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-755ee690-514d-4ed1-ad7b-3194d2bc23b9 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Returning 400 to user: Flavor 919607850 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:33.869619 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-755ee690-514d-4ed1-ad7b-3194d2bc23b9 tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.077736 Aug 25 12:30:33.871091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 17/46] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:33 2022] POST /compute/v2.1/servers => generated 80 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:30:33.882945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ace13c2-6e1a-442d-9fae-9bf0082300be tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:33.908937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ace13c2-6e1a-442d-9fae-9bf0082300be tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/919607850" status: 202 len: 0 microversion: 2.1 time: 0.032324 Aug 25 12:30:33.910039 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 18/47] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:33 2022] DELETE /compute/v2.1/flavors/919607850 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:33.920591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b637f81-a272-4dab-a800-2b3c8d4d8399 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:33.943546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b637f81-a272-4dab-a800-2b3c8d4d8399 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026815 Aug 25 12:30:33.944832 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 19/48] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:30:33.986046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5066d515-c48b-4b55-af39-aa2e2f6db7ab tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-409659543", "id": 672077264, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:34.012864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5066d515-c48b-4b55-af39-aa2e2f6db7ab tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.032598 Aug 25 12:30:34.015067 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 20/49] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:33 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:34.040756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df7bcbe9-dc36-4f3e-b77f-5146c55b4df6 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1943262391", "id": 401117562, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:34.070400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df7bcbe9-dc36-4f3e-b77f-5146c55b4df6 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036269 Aug 25 12:30:34.073175 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 21/50] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:34.102169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-631ec87a-597a-4fba-9446-b323dd53390c tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.145781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-631ec87a-597a-4fba-9446-b323dd53390c tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.051997 Aug 25 12:30:34.147383 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 22/51] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:34.164299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-800add9b-739c-47a3-add6-e9fae1a62d2e tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.184410 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-800add9b-739c-47a3-add6-e9fae1a62d2e tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.022404 Aug 25 12:30:34.185259 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 23/52] 10.222.0.60 () {58 vars in 1177 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:30:34.210676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddb309a1-356e-425e-b664-0d9590d3947d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.244750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddb309a1-356e-425e-b664-0d9590d3947d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.042937 Aug 25 12:30:34.246566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 24/53] 10.222.0.60 () {58 vars in 1171 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:34.261613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-751ba5fc-8697-4664-9449-3525cd3941ba tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.277823 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-751ba5fc-8697-4664-9449-3525cd3941ba tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.020984 Aug 25 12:30:34.284845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 25/54] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:30:34.307508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-482495e0-4ef1-46f2-b681-3e9dda85914d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.337605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:34.387442 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-482495e0-4ef1-46f2-b681-3e9dda85914d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.092325 Aug 25 12:30:34.392290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 26/55] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:34.420785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43bddf37-f5d2-4af0-a8ae-dc2eace294b7 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.472637 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43bddf37-f5d2-4af0-a8ae-dc2eace294b7 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.061403 Aug 25 12:30:34.474155 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 27/56] 10.222.0.60 () {58 vars in 1175 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:30:34.508774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2ff5c08-89b2-450a-9df0-7d473b912d7d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.552394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2ff5c08-89b2-450a-9df0-7d473b912d7d tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.056282 Aug 25 12:30:34.580350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 28/57] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:34.607427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3b48bf83-8cc0-411b-b3e3-3dbdbf258b98 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.679070 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3b48bf83-8cc0-411b-b3e3-3dbdbf258b98 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.096871 Aug 25 12:30:34.682164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 29/58] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:34.708153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-734d9242-eb05-4cb5-85b2-a49335a6f9b8 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.759412 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-734d9242-eb05-4cb5-85b2-a49335a6f9b8 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/401117562" status: 202 len: 0 microversion: 2.1 time: 0.060370 Aug 25 12:30:34.768410 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:34 2022] DELETE /compute/v2.1/flavors/401117562 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:30:34.775840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b0990d0-1d76-4b60-b8d5-566f8cd7ea05 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.837982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b0990d0-1d76-4b60-b8d5-566f8cd7ea05 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068313 Aug 25 12:30:34.840214 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 31/60] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:34.872833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-122d8125-5a70-4b09-bfc2-0b1100180204 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:34.971958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-122d8125-5a70-4b09-bfc2-0b1100180204 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/672077264" status: 202 len: 0 microversion: 2.1 time: 0.108403 Aug 25 12:30:34.977045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 32/61] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:34 2022] DELETE /compute/v2.1/flavors/672077264 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:30:34.991751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e5463f4-9d3d-484b-896a-86209721ed79 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.085705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e5463f4-9d3d-484b-896a-86209721ed79 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103223 Aug 25 12:30:35.086598 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 33/62] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:35.112799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62ef023f-61a6-4a47-8fac-d6151d4451c1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-612697395", "id": 776177214, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:35.161095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62ef023f-61a6-4a47-8fac-d6151d4451c1 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.053930 Aug 25 12:30:35.163358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 34/63] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:35 2022] POST /compute/v2.1/flavors => generated 411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:35.176594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5639be80-f746-4483-b3e4-92531a7cc18b tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.247885 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5639be80-f746-4483-b3e4-92531a7cc18b tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076003 Aug 25 12:30:35.248972 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:35.274508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53195346-edbe-47f8-93a1-8e62c199c1cb tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.286764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-489eabb7-31fb-4265-bb6b-f0da0fe3d00c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 2.958328 Aug 25 12:30:35.301689 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 30/65] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:30:32 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:30:35.330926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-53195346-edbe-47f8-93a1-8e62c199c1cb tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062258 Aug 25 12:30:35.331480 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 36/66] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:35.358920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0f3da74-7189-4d08-949d-56fe8a289a13 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.428221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0f3da74-7189-4d08-949d-56fe8a289a13 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/776177214" status: 202 len: 0 microversion: 2.1 time: 0.075563 Aug 25 12:30:35.429786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 31/67] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:35 2022] DELETE /compute/v2.1/flavors/776177214 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:35.439779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d017b88a-b281-47b3-bc00-4e13caf3aef3 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.494688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d017b88a-b281-47b3-bc00-4e13caf3aef3 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059416 Aug 25 12:30:35.496164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 37/68] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:30:35.522069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d8fa764-de0e-49e3-a83c-73a0d6c117fd tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2122217444", "id": 2105973095, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:35.549609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d8fa764-de0e-49e3-a83c-73a0d6c117fd tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035207 Aug 25 12:30:35.561774 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 32/69] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:35.570170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f00b96c-c092-4644-9ae9-c9ba72c7844b tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.619242 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f00b96c-c092-4644-9ae9-c9ba72c7844b tempest-FlavorsAdminTestJSON-2100881285 tempest-FlavorsAdminTestJSON-2100881285-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.055739 Aug 25 12:30:35.631074 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 38/70] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:35 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:30:35.647148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a91eff96-60d6-4f8a-b124-b1e854796e33 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.695727 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a91eff96-60d6-4f8a-b124-b1e854796e33 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2105973095" status: 202 len: 0 microversion: 2.1 time: 0.053569 Aug 25 12:30:35.704364 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 33/71] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:30:35 2022] DELETE /compute/v2.1/flavors/2105973095 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:35.715094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29be6ace-aa42-4f1c-9148-eeeeeb52b711 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:35.774579 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29be6ace-aa42-4f1c-9148-eeeeeb52b711 tempest-FlavorsAdminTestJSON-231899905 tempest-FlavorsAdminTestJSON-231899905-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067212 Aug 25 12:30:35.775264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:30:36.881815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-729080484", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "availability_zone": "tempest-test_az-1962479095"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:36.915344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:36.916638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:36.917695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:36.918710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:36.919490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:36.919951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:39.130045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:30:39.870281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:30:39.870281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:30:39.872092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:30:39.872092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:30:39.876773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:30:39.931581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:39.932413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:39.933119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:39.934787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:39.935544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:39.937029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:40.051480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Getting quotas for project 42f38f00baa246399078fb86aca9c2c8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:30:40.063399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Getting quotas for user 7594f93920ab41868c9208c4798992a1 and project 42f38f00baa246399078fb86aca9c2c8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:30:40.111942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:30:40.118503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:30:40.448024 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ee2cc7c-6d9b-4db7-a5f7-8f18127ebd84 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.391637 Aug 25 12:30:40.463697 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 34/73] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:30:40.470985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c94c2b1-60ca-41bb-bcd5-18a69f825c35 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:40.476702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c94c2b1-60ca-41bb-bcd5-18a69f825c35 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:40.497181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:41.611542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:43.251239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c94c2b1-60ca-41bb-bcd5-18a69f825c35 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:43.288152 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c94c2b1-60ca-41bb-bcd5-18a69f825c35 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1242 microversion: 2.1 time: 2.824681 Aug 25 12:30:43.289582 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 40/74] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:40 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1242 bytes in 2828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:44.344592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:44.352703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:44.415606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:44.416884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:44.417739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:44.420479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:44.424489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:44.429374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:45.073134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:45.115651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b90706b1-21ee-441a-9e2d-26b4855a8514 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1234 microversion: 2.1 time: 0.784621 Aug 25 12:30:45.154024 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 35/75] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:44 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1234 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:46.172010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:46.178300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:46.226380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:46.227210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:46.227735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:46.245618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:46.248926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:46.253725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:46.902066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:46.931137 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b386d21c-fe93-49e2-9995-d0cb3b10ed86 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1308 microversion: 2.1 time: 0.775468 Aug 25 12:30:46.933670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 41/76] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:46 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:47.962217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:47.962217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:47.977799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:47.978747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:47.981535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:47.984632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:47.987331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:47.989054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.160808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:48.184408 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf2d9de4-ae89-468d-a4e2-194689929f9f tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1296 microversion: 2.1 time: 0.226925 Aug 25 12:30:48.189775 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 42/77] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:47 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:48.606980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c3702790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:48.612423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.615594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.616584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.617671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.618346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.619004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.670151 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8973763c-831b-494c-a989-ddef9d7a940c tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.291083 Aug 25 12:30:48.684426 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 36/78] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:30:47 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:48.690890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c3741b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:48.695897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.696635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.697246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.698192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.698813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.699503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.807588 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92eeddda-2339-4fa4-acc8-1d44153c75b0 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.121156 Aug 25 12:30:48.810920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1139 bytes} [Thu Aug 25 12:30:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:48.824735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c3741040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:48.849416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.855539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.858234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:48.863345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:48.864973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:48.869520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:49.001695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-568c3e8f-6d8f-4ae5-9d6f-d79886c156e9 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.175536 Aug 25 12:30:49.014327 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 38/80] 10.222.0.60 () {58 vars in 1145 bytes} [Thu Aug 25 12:30:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:49.225504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:49.251735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:49.302636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:49.309453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:49.310485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:49.312839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:49.313705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:49.314778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:49.833445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:49.880234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa94deeb-f0fd-49b8-89a9-6e5af5398b8e tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.661581 Aug 25 12:30:49.908765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 39/81] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:49 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:50.393019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:50.434350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Calling method '.version_select at 0x7fc6c39ef9d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:50.452050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:50.453903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:50.454640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:50.519597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:50.520547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:50.521273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:50.570508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:50.571646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:50.572182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:50.597226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4650e138-6c97-4387-b34e-175234422bb9 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 2.171529 Aug 25 12:30:50.601200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 43/82] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:51.511253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b572b69-52e1-40fb-97ed-6ee756e93bf1 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-575157954", "id": 1238202196, "os-flavor-access:is_public": "False"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:51.578627 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b572b69-52e1-40fb-97ed-6ee756e93bf1 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 1.194668 Aug 25 12:30:51.601546 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 40/83] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:30:51.620775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:51.632088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:51.680484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:51.682016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:51.691157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:51.694672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:51.702239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:51.709339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:51.975173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4e8a2c2-ee1c-40c5-8763-d4e81889ef1d tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Calling method '.version_select at 0x7fc6c3848280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:51.979813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4e8a2c2-ee1c-40c5-8763-d4e81889ef1d tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'ce942fe1416b465a8ec9c92d72019fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ff0861025145f595a3223e0fe62c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4e8a2c2-ee1c-40c5-8763-d4e81889ef1d tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Request method failure captured: Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/n-h2-850468-18/search HTTP/1.1 Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tztSRKxzqQFHpH_1mulwNJ8CuWyFp9sEMISVXLD4vshaBp-dKvS_N0V_8CcvWIe2ea70HvDxBVnwyeAwjsGI0GGjUHpO4lzZxcdqIMHXiU8x58TC41ME6mxJcF8tlrEevtChVrzus19bqSeZ17Gwe_SYEQB3LJ4nVg7tRpz1huZGE Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 32ff0861025145f595a3223e0fe62c0a Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:30:51.990426 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 32ff0861025145f595a3223e0fe62c0a Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-382789847-project Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ce942fe1416b465a8ec9c92d72019fdc Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847-project Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:30:51.991727 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'n-h2-850468-18'} Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:30:51.992424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 25 12:30:51.993559 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:52.001623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4e8a2c2-ee1c-40c5-8763-d4e81889ef1d tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:52.003032 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4e8a2c2-ee1c-40c5-8763-d4e81889ef1d tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-850468-18/search" status: 403 len: 117 microversion: 2.1 time: 1.389875 Aug 25 12:30:52.004272 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 44/84] 10.222.0.60 () {58 vars in 1212 bytes} [Thu Aug 25 12:30:50 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-18/search => generated 117 bytes in 1394 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:30:52.486602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:52.512690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d48facaa-eba4-4a94-8616-963713cd94ba tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.907874 Aug 25 12:30:52.532810 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 41/85] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:51 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:52.544588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41793c95-886b-4ce9-89d2-b79dd5666feb tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:53.286762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-71390400-c0e6-4ed8-97d3-cd909d74a3b4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:53.307508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:53.335455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-71390400-c0e6-4ed8-97d3-cd909d74a3b4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.318685 Aug 25 12:30:53.336566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 45/86] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:30:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:53.378023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Calling method '.version_select at 0x7fc6c37d6d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:53.386627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:53.393114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:53.394244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:53.476762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Request method failure captured: Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2t4BZKOy-FIJuOm9B8_E0pgAkf_QHiOl-F1L6EW5aG0rxcuct8-EYHVa7WZeFcgARZNUUIqmvHAJpp6KIZqFBfa8tQMtq1RUhQChyzODO7byDIFfzXqXUAS2BbgmF6bvRatAqMhyPlRPIfFeo0emIgYKhleMuDYu6fP1d6V6DVDtXA Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f508d520923415798e15e27d29c5c1f Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:30:53.483078 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f508d520923415798e15e27d29c5c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f508d520923415798e15e27d29c5c1f Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6b65998151a34e31bcefe9bc4ae453c1 Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:30:53.485429 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:53.486883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:53.489830 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:53.489830 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:30:53.489830 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:30:53.489830 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 25 12:30:53.489830 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:30:53.492822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:53.503367 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28d8f8d8-b266-4822-bfcf-e6584baf93a7 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.158037 Aug 25 12:30:53.506184 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 46/87] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 12:30:53 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:30:54.268570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41793c95-886b-4ce9-89d2-b79dd5666feb tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1238202196/action" status: 200 len: 97 microversion: 2.1 time: 1.732460 Aug 25 12:30:54.277229 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 42/88] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:30:52 2022] POST /compute/v2.1/flavors/1238202196/action => generated 97 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:54.598718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc50c034-1777-4a02-918c-ed2c325e3f80 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-314620086", "id": 168180389, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:54.684396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc50c034-1777-4a02-918c-ed2c325e3f80 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.170961 Aug 25 12:30:54.695358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 47/89] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:53 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:54.722693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Calling method '.version_select at 0x7fc6c3732310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:54.730848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:54.732183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:54.733559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:54.786647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:54.789775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:54.792462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:54.845767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:54.851180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:54.852327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:54.899354 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e48d9db-3a96-4d1a-8aa7-bb01be778301 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.198393 Aug 25 12:30:54.914632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 48/90] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:54.938866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:54.956287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:55.017889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:55.023041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:55.024029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:55.025414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:55.029362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:55.030212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:55.208959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d8b5712-459e-4268-9f30-ebe681817d30 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1870576458", "id": 253568095, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:55.282952 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d8b5712-459e-4268-9f30-ebe681817d30 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.002103 Aug 25 12:30:55.292296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 43/91] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:54 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:55.307216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e624161e-64b2-434c-b8c1-cd1a8292bea8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:55.824712 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e624161e-64b2-434c-b8c1-cd1a8292bea8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] HTTP exception thrown: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e624161e-64b2-434c-b8c1-cd1a8292bea8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Request method failure captured: Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/flavors/1238202196/action HTTP/1.1 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 67 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2t0DuoXEXrROfgxcJPJu5hWzUg_s21mklQNJVpvqknCfbgtQIbKMyP7D6jq7PnlBUeU6d9OMu2b6l3Zzn6aPra5inmn5jnFp1REah3lD973pHAZmZeO_N6cUssLsGqIBhQAeKmnBgskUf9hAJrlx5apRqQi6VBNiIfnk8DJc1_eDnA Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:30:55.893855 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af738fa7c5f9453fba21b6809f814978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6b94a689eb7040b28e9b69ca04d5842a Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} Aug 25 12:30:55.895863 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: exception: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1238202196', 'body': {'addTenantAccess': {'tenant': '2ed8be2959564caeb5751dc9900a6dc4'}}} Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:30:55.896759 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '26-2ed8be2959564caeb5751dc9900a6dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:30:55.898237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:30:55.901528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:30:55.905864 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '26-2ed8be2959564caeb5751dc9900a6dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 30, 55, 755833), 'updated_at': None, 'flavor_id': 26, 'project_id': '2ed8be2959564caeb5751dc9900a6dc4'}] Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:55.911983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:55.918007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:30:55.922578 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:30:55.925875 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. Aug 25 12:30:55.925875 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:55.925875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e624161e-64b2-434c-b8c1-cd1a8292bea8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Returning 409 to user: Flavor access already exists for flavor 26 and project 2ed8be2959564caeb5751dc9900a6dc4 combination. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:55.930175 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e624161e-64b2-434c-b8c1-cd1a8292bea8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1238202196/action" status: 409 len: 152 microversion: 2.1 time: 0.641570 Aug 25 12:30:55.930175 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 44/92] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:30:55 2022] POST /compute/v2.1/flavors/1238202196/action => generated 152 bytes in 643 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:30:55.946919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3106149-d7b7-4c53-9cd2-fcfe928b7008 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f501090f48d445e3a200e51071a8d6e9"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:56.399440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:56.413815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=12,nova_api:DELETE=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:56.417295 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6fde382-0fcc-4368-92d1-1247eb3b9a8d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 1.496084 Aug 25 12:30:56.419456 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 49/93] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:54 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:56.425323 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3106149-d7b7-4c53-9cd2-fcfe928b7008 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/168180389/action" status: 200 len: 96 microversion: 2.1 time: 0.493237 Aug 25 12:30:56.427550 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 45/94] 10.222.0.60 () {60 vars in 1197 bytes} [Thu Aug 25 12:30:55 2022] POST /compute/v2.1/flavors/168180389/action => generated 96 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:56.435544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db3e337c-953d-49d7-a070-cd771d8c7adc tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Calling method '.version_select at 0x7fc6c36bbaf0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:56.438112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db3e337c-953d-49d7-a070-cd771d8c7adc tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'ce942fe1416b465a8ec9c92d72019fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ff0861025145f595a3223e0fe62c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db3e337c-953d-49d7-a070-cd771d8c7adc tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Request method failure captured: Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tztSRKxzqQFHpH_1mulwNJ8CuWyFp9sEMISVXLD4vshaBp-dKvS_N0V_8CcvWIe2ea70HvDxBVnwyeAwjsGI0GGjUHpO4lzZxcdqIMHXiU8x58TC41ME6mxJcF8tlrEevtChVrzus19bqSeZ17Gwe_SYEQB3LJ4nVg7tRpz1huZGE Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 32ff0861025145f595a3223e0fe62c0a Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:30:56.445364 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/32ff0861025145f595a3223e0fe62c0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 32ff0861025145f595a3223e0fe62c0a Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847 Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-382789847-project Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ce942fe1416b465a8ec9c92d72019fdc Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-382789847-project Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:30:56.446606 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1'} Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:30:56.447206 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 25 12:30:56.448270 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.456589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db3e337c-953d-49d7-a070-cd771d8c7adc tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:56.475088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db3e337c-953d-49d7-a070-cd771d8c7adc tempest-HypervisorAdminNegativeUnderV252Test-382789847 tempest-HypervisorAdminNegativeUnderV252Test-382789847-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.043593 Aug 25 12:30:56.479323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 46/95] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:30:56 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:30:56.496710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-781ed4de-c9f0-4c2a-81d4-4310ab535be8 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:56.528865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-781ed4de-c9f0-4c2a-81d4-4310ab535be8 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047538 Aug 25 12:30:56.540527 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 47/96] 10.222.0.60 () {58 vars in 1182 bytes} [Thu Aug 25 12:30:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:56.572763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a40a0ed-55dd-40cb-b611-15b4de96abaf tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:56.600385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c277c45e-abc2-4b75-b8ba-9b907e1846e2 tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1998306625", "id": 1021476842, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:56.694055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c277c45e-abc2-4b75-b8ba-9b907e1846e2 tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.271703 Aug 25 12:30:56.695334 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 50/97] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:30:56 2022] POST /compute/v2.1/flavors => generated 449 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:56.833301 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a40a0ed-55dd-40cb-b611-15b4de96abaf tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1238202196/action" status: 200 len: 21 microversion: 2.1 time: 0.288445 Aug 25 12:30:56.838828 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 48/98] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:30:56 2022] POST /compute/v2.1/flavors/1238202196/action => generated 21 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:56.857659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Calling method '.version_select at 0x7fc6c372c670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:56.865703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:56.866544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:56.867276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:56.930308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=75 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:56.936969 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] HTTP exception thrown: No hypervisor matching '068405db-2711-490c-ba7f-5919776f8540' could be found. Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Request method failure captured: Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hypervisors/068405db-2711-490c-ba7f-5919776f8540/servers HTTP/1.1 Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2t4BZKOy-FIJuOm9B8_E0pgAkf_QHiOl-F1L6EW5aG0rxcuct8-EYHVa7WZeFcgARZNUUIqmvHAJpp6KIZqFBfa8tQMtq1RUhQChyzODO7byDIFfzXqXUAS2BbgmF6bvRatAqMhyPlRPIfFeo0emIgYKhleMuDYu6fP1d6V6DVDtXA Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f508d520923415798e15e27d29c5c1f Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:30:56.942255 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f508d520923415798e15e27d29c5c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f508d520923415798e15e27d29c5c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f508d520923415798e15e27d29c5c1f Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468 Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6b65998151a34e31bcefe9bc4ae453c1 Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: exception: No hypervisor matching '068405db-2711-490c-ba7f-5919776f8540' could be found. Aug 25 12:30:56.944591 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '068405db-2711-490c-ba7f-5919776f8540'} Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '068405db-2711-490c-ba7f-5919776f8540' could be found. Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.946002 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '068405db-2711-490c-ba7f-5919776f8540' could be found. Aug 25 12:30:56.948185 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:56.954166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] Returning 404 to user: No hypervisor matching '068405db-2711-490c-ba7f-5919776f8540' could be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:56.958743 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64e8703e-74c4-4ae0-adf3-54144c565045 tempest-HypervisorAdminNegativeUnderV252Test-440038468 tempest-HypervisorAdminNegativeUnderV252Test-440038468-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/068405db-2711-490c-ba7f-5919776f8540/servers" status: 404 len: 123 microversion: 2.1 time: 0.117558 Aug 25 12:30:56.967132 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 12:30:56 2022] GET /compute/v2.1/os-hypervisors/068405db-2711-490c-ba7f-5919776f8540/servers => generated 123 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:30:57.013984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3cfeb4b-ed92-419f-81bb-43202cf4bc30 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1522093070", "id": 28805348, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:57.080771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-700158af-3a78-4113-83a0-1a57ab2d8773 tempest-FlavorsAccessTestJSON-405672961 tempest-FlavorsAccessTestJSON-405672961-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.184933 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3cfeb4b-ed92-419f-81bb-43202cf4bc30 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.204000 Aug 25 12:30:57.189268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 50/100] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:56 2022] POST /compute/v2.1/flavors => generated 419 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:57.227281 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-700158af-3a78-4113-83a0-1a57ab2d8773 tempest-FlavorsAccessTestJSON-405672961 tempest-FlavorsAccessTestJSON-405672961-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6647 microversion: 2.1 time: 0.529059 Aug 25 12:30:57.233622 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:56 2022] GET /compute/v2.1/flavors/detail => generated 6647 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:57.273605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dca92a28-4b6e-4d06-ba28-5932db95b856 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.385390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dca92a28-4b6e-4d06-ba28-5932db95b856 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1238202196" status: 202 len: 0 microversion: 2.1 time: 0.148829 Aug 25 12:30:57.404039 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:30:57 2022] DELETE /compute/v2.1/flavors/1238202196 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:57.425343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de8abbc5-532c-443d-b6c3-6f12bc9cddb6 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.465344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de8abbc5-532c-443d-b6c3-6f12bc9cddb6 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056887 Aug 25 12:30:57.467175 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 53/103] 10.222.0.60 () {58 vars in 1182 bytes} [Thu Aug 25 12:30:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:57.495486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0bc8805-7d05-4ca5-8afd-dddbb48b2ada tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f501090f48d445e3a200e51071a8d6e9"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:57.658676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-60d085f3-7b27-4569-838b-ca592ed88e55 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.752048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-60d085f3-7b27-4569-838b-ca592ed88e55 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] 10.222.0.60 "GET /compute/v2.1/flavors/1021476842" status: 200 len: 449 microversion: 2.55 time: 0.531500 Aug 25 12:30:57.780332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 51/104] 10.222.0.60 () {60 vars in 1199 bytes} [Thu Aug 25 12:30:57 2022] GET /compute/v2.1/flavors/1021476842 => generated 449 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:57.835806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a774b25b-13f0-47c3-a414-16742baf14c8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.906617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0bc8805-7d05-4ca5-8afd-dddbb48b2ada tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/168180389/action" status: 200 len: 21 microversion: 2.1 time: 0.435044 Aug 25 12:30:57.908204 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 54/105] 10.222.0.60 () {60 vars in 1197 bytes} [Thu Aug 25 12:30:57 2022] POST /compute/v2.1/flavors/168180389/action => generated 21 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:30:57.924486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:57.931292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:30:57.946076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a774b25b-13f0-47c3-a414-16742baf14c8 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.160538 Aug 25 12:30:57.947010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:57.948216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:57.949337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:57.949600 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 52/106] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:57 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:57.961308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:57.974925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:57.975813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:58.576396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4ef0fe-bbad-4eec-99a4-8321beab7c5d", "tag": "790a56d4-f1f6-468d-a242-3febcc35f394"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:58.649192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:30:58.668077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:30:58.671629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:30:58.760866 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] Creating event network-changed:790a56d4-f1f6-468d-a242-3febcc35f394 for instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d on n-h2-850468-18 Aug 25 12:30:58.786115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-378b6104-b220-410a-92b3-4409c5a80e87 req-e5c050d7-6008-4e45-9b99-e5ab5d21e5af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.833542 Aug 25 12:30:58.788384 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 53/107] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:58.820266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41620a59-d6ae-431f-9543-1ee27dfafc63 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Action: 'create', calling method: .version_select at 0x7fc6c38288b0>, body: {"keypair": {"name": "tempest-keypair-1417181888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcXeaYd6GjJ9NBPpeBdyVZCf3IoZ/Ey+01S5mw50Act9cWEatD6+lrz0TPXtRz4pIUJ/OnYfVNIbC6RgZ9/s+xv8F1HsekokD37nrNf2+gkZJMLauS1qUWrypa48W6x3A=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:58.878990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:30:58.904279 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99bc38d0-963b-4a41-b6a8-2f3ae879a93a tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.988897 Aug 25 12:30:58.913716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:58.917154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 55/108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:30:57 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:58.931999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9cd62768-6a1b-48f3-8c0e-f54101467b6a tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c477ddc0>, body: {"flavor": {"description": "new"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:58.984001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-41620a59-d6ae-431f-9543-1ee27dfafc63 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for project 89c932bd810047c7915941697021fdb3. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:30:59.002980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-41620a59-d6ae-431f-9543-1ee27dfafc63 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for user 1aa2df29675141de952756ad23f15926 and project 89c932bd810047c7915941697021fdb3. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:30:59.090978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41620a59-d6ae-431f-9543-1ee27dfafc63 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299551 Aug 25 12:30:59.100669 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 54/109] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:30:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:59.134106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9cd62768-6a1b-48f3-8c0e-f54101467b6a tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1021476842" status: 200 len: 450 microversion: 2.55 time: 0.214945 Aug 25 12:30:59.149087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e26c840b-1996-451d-99d1-65f66bd7a938 tempest-FlavorsAccessTestJSON-405672961 tempest-FlavorsAccessTestJSON-405672961-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.155995 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 56/110] 10.222.0.60 () {62 vars in 1219 bytes} [Thu Aug 25 12:30:58 2022] PUT /compute/v2.1/flavors/1021476842 => generated 450 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:30:59.182908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b8d1d0f8-b87a-4af0-98ef-9af50b9128eb tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1217372994", "id": 332302373, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:30:59.292258 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b8d1d0f8-b87a-4af0-98ef-9af50b9128eb tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.129626 Aug 25 12:30:59.303098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e26c840b-1996-451d-99d1-65f66bd7a938 tempest-FlavorsAccessTestJSON-405672961 tempest-FlavorsAccessTestJSON-405672961-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.193109 Aug 25 12:30:59.305246 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 57/111] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:30:59.319445 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 55/112] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:59.325806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11ec049b-4034-474b-86a3-3d09f3abb222 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.345407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec5a2b04-7ee6-40d3-a68f-2f4ca6d655c9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.372569 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ec5a2b04-7ee6-40d3-a68f-2f4ca6d655c9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec5a2b04-7ee6-40d3-a68f-2f4ca6d655c9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Request method failure captured: Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/flavors/332302373/os-flavor-access HTTP/1.1 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2t0DuoXEXrROfgxcJPJu5hWzUg_s21mklQNJVpvqknCfbgtQIbKMyP7D6jq7PnlBUeU6d9OMu2b6l3Zzn6aPra5inmn5jnFp1REah3lD973pHAZmZeO_N6cUssLsGqIBhQAeKmnBgskUf9hAJrlx5apRqQi6VBNiIfnk8DJc1_eDnA Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:30:59.378638 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af738fa7c5f9453fba21b6809f814978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6b94a689eb7040b28e9b69ca04d5842a Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: exception: Access list not available for public flavors. Aug 25 12:30:59.381989 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'flavor_id': '332302373'} Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 25 12:30:59.383496 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:30:59.393345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec5a2b04-7ee6-40d3-a68f-2f4ca6d655c9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:30:59.398545 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ec5a2b04-7ee6-40d3-a68f-2f4ca6d655c9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/332302373/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.064246 Aug 25 12:30:59.400646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 56/113] 10.222.0.60 () {58 vars in 1206 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors/332302373/os-flavor-access => generated 91 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:30:59.421663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-675a00ff-ff44-4495-aa7f-93a4988c3008 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.430992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11ec049b-4034-474b-86a3-3d09f3abb222 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 7034 microversion: 2.55 time: 0.121829 Aug 25 12:30:59.443700 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 58/114] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors/detail => generated 7034 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:30:59.453170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ad7de18f-e0a7-49cd-9b63-24f974ba850c tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.535558 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-675a00ff-ff44-4495-aa7f-93a4988c3008 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/168180389" status: 202 len: 0 microversion: 2.1 time: 0.129214 Aug 25 12:30:59.556624 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 57/115] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:59 2022] DELETE /compute/v2.1/flavors/168180389 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:59.593096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:30:59.603746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7aa94d59-584a-40fe-9ae8-17eb653d6cf2 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.647358 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ad7de18f-e0a7-49cd-9b63-24f974ba850c tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/332302373" status: 202 len: 0 microversion: 2.1 time: 0.200726 Aug 25 12:30:59.664735 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 59/116] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:30:59 2022] DELETE /compute/v2.1/flavors/332302373 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:30:59.684325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2edbdfb4-346a-478e-931a-52482af16c27 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.753012 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7aa94d59-584a-40fe-9ae8-17eb653d6cf2 tempest-FlavorsV255TestJSON-1727662401 tempest-FlavorsV255TestJSON-1727662401-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3678 microversion: 2.55 time: 0.189042 Aug 25 12:30:59.757038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 58/117] 10.222.0.60 () {60 vars in 1166 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors => generated 3678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:30:59.767712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5f7a8f0-125b-473f-a6be-a307657c5df9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.825476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5f7a8f0-125b-473f-a6be-a307657c5df9 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.065877 Aug 25 12:30:59.827499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 59/118] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:30:59.859561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27402cd1-ada2-4466-89f8-d8d25cdf2cce tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:30:59.981576 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27402cd1-ada2-4466-89f8-d8d25cdf2cce tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1021476842" status: 202 len: 0 microversion: 2.55 time: 0.150881 Aug 25 12:30:59.989728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 60/119] 10.222.0.60 () {60 vars in 1202 bytes} [Thu Aug 25 12:30:59 2022] DELETE /compute/v2.1/flavors/1021476842 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:30:59.993214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2edbdfb4-346a-478e-931a-52482af16c27 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.307433 Aug 25 12:31:00.030029 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 60/120] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:30:59 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:00.054411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c56b16f-a6ad-46c7-99b3-dc5b06490420 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-362659459", "id": 476105142, "os-flavor-access:is_public": "False"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:00.061711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:00.063260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:00.083819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:00.084943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:00.085655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:00.092766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:00.095046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:00.095799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:00.104041 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c56b16f-a6ad-46c7-99b3-dc5b06490420 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.112042 Aug 25 12:31:00.117175 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 61/121] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:30:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:00.133240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb3e6eac-783c-48bf-b4a7-bfbd45fad493 tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:00.200391 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb3e6eac-783c-48bf-b4a7-bfbd45fad493 tempest-FlavorsV255TestJSON-1364686303 tempest-FlavorsV255TestJSON-1364686303-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6148 microversion: 2.55 time: 0.080960 Aug 25 12:31:00.232743 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 62/122] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:31:00 2022] GET /compute/v2.1/flavors/detail => generated 6148 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:00.256169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea6e8f8d-03ff-42ea-8290-149255874ca0 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2065372527", "id": 1307124768, "os-flavor-access:is_public": "False"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:00.312099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea6e8f8d-03ff-42ea-8290-149255874ca0 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.077071 Aug 25 12:31:00.323588 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 63/123] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:00.914598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:00.942036 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e72dc55-ba7a-4e03-b414-f6fad4770d8c tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.909481 Aug 25 12:31:00.976154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 61/124] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:00 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:01.010626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0796f727-0a83-471a-bb54-8a8f2ee4f043 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:01.049871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3d73d12-d733-4010-ac5e-d3c30608d7bb tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:01.054548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3d73d12-d733-4010-ac5e-d3c30608d7bb tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f42d89a69a2548f39cc832200b386433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8be2959564caeb5751dc9900a6dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3d73d12-d733-4010-ac5e-d3c30608d7bb tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Request method failure captured: Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/flavors/476105142/action HTTP/1.1 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 67 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tvbIykLqUxepNQT4XjaSJkmfuZ_ptSNp8Fz2XHiqNf4TugOkgydlAkxcXUNm9qcI9ULJxXCJrHQWFHjofnHhk8eCiydCr71XX232gyZ6qBDaLhRUv7j5Ljd--_ellwyHUEyQsJXRZLiuJXhr-o3gKwUZB2ejQTUDF-bx9A2BLYL-4 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2ed8be2959564caeb5751dc9900a6dc4 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:01.070357 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2ed8be2959564caeb5751dc9900a6dc4 Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsAccessNegativeTestJSON-1289456057-project Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f42d89a69a2548f39cc832200b386433 Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057-project Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} Aug 25 12:31:01.071999 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '476105142', 'body': {'addTenantAccess': {'tenant': '2ed8be2959564caeb5751dc9900a6dc4'}}} Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:01.072999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 25 12:31:01.074391 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:01.084873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3d73d12-d733-4010-ac5e-d3c30608d7bb tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:01.086541 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3d73d12-d733-4010-ac5e-d3c30608d7bb tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] 10.222.0.60 "POST /compute/v2.1/flavors/476105142/action" status: 403 len: 130 microversion: 2.1 time: 0.761304 Aug 25 12:31:01.093362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 64/125] 10.222.0.60 () {60 vars in 1197 bytes} [Thu Aug 25 12:31:00 2022] POST /compute/v2.1/flavors/476105142/action => generated 130 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:01.114928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-958d5b01-1958-4603-acee-e6c794dfebec tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:01.126010 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0796f727-0a83-471a-bb54-8a8f2ee4f043 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/1307124768/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.143078 Aug 25 12:31:01.138365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 62/126] 10.222.0.60 () {58 vars in 1209 bytes} [Thu Aug 25 12:31:00 2022] GET /compute/v2.1/flavors/1307124768/os-flavor-access => generated 21 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:31:01.170767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0dfa3788-a318-45ab-b924-c759112b338a tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:01.245495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0dfa3788-a318-45ab-b924-c759112b338a tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1307124768" status: 202 len: 0 microversion: 2.1 time: 0.100519 Aug 25 12:31:01.256551 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 63/127] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:31:01 2022] DELETE /compute/v2.1/flavors/1307124768 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:01.283952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-542e4c9d-9aa6-43e2-bbdb-bc9f1a4ba2d7 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:01.317838 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-958d5b01-1958-4603-acee-e6c794dfebec tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/476105142" status: 202 len: 0 microversion: 2.1 time: 0.200079 Aug 25 12:31:01.325013 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 65/128] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:31:01 2022] DELETE /compute/v2.1/flavors/476105142 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:01.378312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa190c2f-ff2e-42f4-82a7-53c74f07560b tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:01.479397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-542e4c9d-9aa6-43e2-bbdb-bc9f1a4ba2d7 tempest-FlavorsAccessTestJSON-1388207016 tempest-FlavorsAccessTestJSON-1388207016-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.220233 Aug 25 12:31:01.535244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 64/129] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:01 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:01.602446 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa190c2f-ff2e-42f4-82a7-53c74f07560b tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.266451 Aug 25 12:31:01.604937 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:01 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:01.659089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f3c003a-7546-4412-9046-7103574f87ab tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1396444685", "id": 1590155941, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:01.782107 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f3c003a-7546-4412-9046-7103574f87ab tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.126981 Aug 25 12:31:01.798454 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 65/131] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:01 2022] POST /compute/v2.1/flavors => generated 439 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:01.824731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9446e5db-62ae-41f7-bd07-e2d250b4c7dd tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:02.040697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:02.043107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:02.108994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:02.116084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:02.117812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:02.126922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:02.134691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:02.138763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:03.815770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9446e5db-62ae-41f7-bd07-e2d250b4c7dd tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1590155941/action" status: 200 len: 97 microversion: 2.1 time: 1.999968 Aug 25 12:31:03.831088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 67/132] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:31:01 2022] POST /compute/v2.1/flavors/1590155941/action => generated 97 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 12:31:03.871323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f371a78b-ff8e-4954-8bc1-7e76365298ee tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:03.888526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f371a78b-ff8e-4954-8bc1-7e76365298ee tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f42d89a69a2548f39cc832200b386433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8be2959564caeb5751dc9900a6dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f371a78b-ff8e-4954-8bc1-7e76365298ee tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Request method failure captured: Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/flavors/1590155941/action HTTP/1.1 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 70 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tvbIykLqUxepNQT4XjaSJkmfuZ_ptSNp8Fz2XHiqNf4TugOkgydlAkxcXUNm9qcI9ULJxXCJrHQWFHjofnHhk8eCiydCr71XX232gyZ6qBDaLhRUv7j5Ljd--_ellwyHUEyQsJXRZLiuJXhr-o3gKwUZB2ejQTUDF-bx9A2BLYL-4 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2ed8be2959564caeb5751dc9900a6dc4 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:03.900152 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2ed8be2959564caeb5751dc9900a6dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2ed8be2959564caeb5751dc9900a6dc4 Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057 Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsAccessNegativeTestJSON-1289456057-project Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f42d89a69a2548f39cc832200b386433 Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1289456057-project Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: {"removeTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} Aug 25 12:31:03.901907 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1590155941', 'body': {'removeTenantAccess': {'tenant': '2ed8be2959564caeb5751dc9900a6dc4'}}} Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can( Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:03.902749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 25 12:31:03.903893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:03.905011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f371a78b-ff8e-4954-8bc1-7e76365298ee tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:03.905011 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f371a78b-ff8e-4954-8bc1-7e76365298ee tempest-FlavorsAccessNegativeTestJSON-1289456057 tempest-FlavorsAccessNegativeTestJSON-1289456057-project] 10.222.0.60 "POST /compute/v2.1/flavors/1590155941/action" status: 403 len: 133 microversion: 2.1 time: 0.068138 Aug 25 12:31:03.909120 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 68/133] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:31:03 2022] POST /compute/v2.1/flavors/1590155941/action => generated 133 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:03.934436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19064b1d-a907-496b-bb8a-2d265661fb4a tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ed8be2959564caeb5751dc9900a6dc4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:04.402138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:04.421690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9c16927-fe18-493b-ba69-f8eac29773f7 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 2.400602 Aug 25 12:31:04.424336 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 66/134] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:02 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:04.605808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19064b1d-a907-496b-bb8a-2d265661fb4a tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1590155941/action" status: 200 len: 21 microversion: 2.1 time: 0.688543 Aug 25 12:31:04.615676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 69/135] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:31:03 2022] POST /compute/v2.1/flavors/1590155941/action => generated 21 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 12:31:04.632912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1c9f646-ee91-49ac-aa3e-29e1446f4ad2 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:04.694595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1c9f646-ee91-49ac-aa3e-29e1446f4ad2 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1590155941" status: 202 len: 0 microversion: 2.1 time: 0.076219 Aug 25 12:31:04.696823 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 67/136] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:31:04 2022] DELETE /compute/v2.1/flavors/1590155941 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:04.712481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32210160-2238-476e-93de-204b01f4062d tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:04.771498 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32210160-2238-476e-93de-204b01f4062d tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.063587 Aug 25 12:31:04.797782 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 70/137] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:04 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:04.836013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd2883a3-6576-4c00-a76d-897b54197b88 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-111389785", "id": 1837247217, "os-flavor-access:is_public": "False"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:04.915635 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fd2883a3-6576-4c00-a76d-897b54197b88 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.091127 Aug 25 12:31:04.925219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 68/138] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:04 2022] POST /compute/v2.1/flavors => generated 438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:04.950070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6ea0e99-5f86-4baa-90be-e7b5dce8f090 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "31fef59f05f042b6ae0a745e4847363d"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:05.478605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:05.488104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:05.511004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:05.511527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:05.512099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:05.513029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:05.513560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:05.513999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:05.711168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f6ea0e99-5f86-4baa-90be-e7b5dce8f090 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] HTTP exception thrown: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6ea0e99-5f86-4baa-90be-e7b5dce8f090 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Request method failure captured: Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/flavors/1837247217/action HTTP/1.1 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 70 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2t0DuoXEXrROfgxcJPJu5hWzUg_s21mklQNJVpvqknCfbgtQIbKMyP7D6jq7PnlBUeU6d9OMu2b6l3Zzn6aPra5inmn5jnFp1REah3lD973pHAZmZeO_N6cUssLsGqIBhQAeKmnBgskUf9hAJrlx5apRqQi6VBNiIfnk8DJc1_eDnA Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:05.721185 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af738fa7c5f9453fba21b6809f814978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af738fa7c5f9453fba21b6809f814978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af738fa7c5f9453fba21b6809f814978 Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-836434449 Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6b94a689eb7040b28e9b69ca04d5842a Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: {"removeTenantAccess": {"tenant": "31fef59f05f042b6ae0a745e4847363d"}} Aug 25 12:31:05.724556 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: exception: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1837247217', 'body': {'removeTenantAccess': {'tenant': '31fef59f05f042b6ae0a745e4847363d'}}} Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 25 12:31:05.725969 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:05.728299 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. Aug 25 12:31:05.730781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:05.734053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6ea0e99-5f86-4baa-90be-e7b5dce8f090 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Returning 404 to user: Flavor access not found for 35 / 31fef59f05f042b6ae0a745e4847363d combination. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:05.738215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6ea0e99-5f86-4baa-90be-e7b5dce8f090 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1837247217/action" status: 404 len: 124 microversion: 2.1 time: 0.797618 Aug 25 12:31:05.745449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 71/139] 10.222.0.60 () {60 vars in 1200 bytes} [Thu Aug 25 12:31:04 2022] POST /compute/v2.1/flavors/1837247217/action => generated 124 bytes in 806 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:05.758169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b61cac0-09e3-4d01-90f1-753120f72536 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:05.851151 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b61cac0-09e3-4d01-90f1-753120f72536 tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1837247217" status: 202 len: 0 microversion: 2.1 time: 0.102747 Aug 25 12:31:05.852422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 72/140] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:31:05 2022] DELETE /compute/v2.1/flavors/1837247217 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:05.871419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-187b2802-fc1b-4705-820b-b8c35c98979e tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:06.003786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-187b2802-fc1b-4705-820b-b8c35c98979e tempest-FlavorsAccessNegativeTestJSON-836434449 tempest-FlavorsAccessNegativeTestJSON-836434449-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.144625 Aug 25 12:31:06.021822 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 73/141] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:05 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:06.490601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:06.536444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcc521a4-c1d2-498e-8398-f0be2395e823 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 1.072847 Aug 25 12:31:06.539153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 69/142] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:05 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:07.600710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:07.602353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:07.642633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:07.698728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:07.703395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:07.710152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:07.725690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:07.726924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:07.733018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:08.013328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-353641082", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "28805348", "adminPass": "***", "networks": [{"uuid": "3e4619a7-d03e-4d15-b146-6e3538f68286"}], "security_groups": [{"name": "tempest-securitygroup--1856348433"}], "key_name": "tempest-keypair-1417181888", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:08.088387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:08.124421 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34fecf88-d23f-4a7e-870e-d1f377341cee tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.549578 Aug 25 12:31:08.140159 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 74/143] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:07 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:08.452347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] validate_networks() for [('3e4619a7-d03e-4d15-b146-6e3538f68286', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:31:09.157375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:09.174692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:09.176622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:09.201157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:09.202043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:09.202876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:09.204347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:09.205284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:09.206146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:09.546835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:09.561305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf7b3428-f3d5-4fd8-afc1-c267fd77c473 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.408283 Aug 25 12:31:09.576472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 75/144] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:09 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:10.610194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:31:10.612585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:31:10.616921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:31:10.618876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:10.620281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:31:10.621333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:31:10.624529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:10.660823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:10.667257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:10.668467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:10.673308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:10.675406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:10.678107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:10.680525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:10.682283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:10.683593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:10.689845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:10.690538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:10.692300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:10.771542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for project 89c932bd810047c7915941697021fdb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:31:10.781652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for user 1aa2df29675141de952756ad23f15926 and project 89c932bd810047c7915941697021fdb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:31:10.804990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:31:10.810260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:31:10.929586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1535b6e4-0c23-4065-a043-e292cd1e1cad tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.934907 Aug 25 12:31:10.930800 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 70/145] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:31:10.966017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e69c3897-00fd-4b33-bfb5-6188ef9823c6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:10.967745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e69c3897-00fd-4b33-bfb5-6188ef9823c6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:11.161339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e69c3897-00fd-4b33-bfb5-6188ef9823c6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:11.163082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:11.182796 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b72d070-52ff-47f7-92d7-2e654f6b8d23 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.588427 Aug 25 12:31:11.185230 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 76/146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:10 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:11.194224 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e69c3897-00fd-4b33-bfb5-6188ef9823c6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1260 microversion: 2.1 time: 0.249043 Aug 25 12:31:11.196019 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 71/147] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:10 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:12.225259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:12.228318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:12.244621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:12.245879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:12.247355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:12.249882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:12.250974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:12.252619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:12.261719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92f011ea-5188-4897-a852-4778191801fd tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:12.261719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92f011ea-5188-4897-a852-4778191801fd tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:12.500702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-92f011ea-5188-4897-a852-4778191801fd tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:12.513428 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92f011ea-5188-4897-a852-4778191801fd tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1260 microversion: 2.1 time: 0.273201 Aug 25 12:31:12.516006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 72/148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:12 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:12.749103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:12.765745 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-054c05f6-8718-46be-a2c6-69923971fb1b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.557939 Aug 25 12:31:12.767570 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 77/149] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:12 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:13.557635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:13.561105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:13.587648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:13.588713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:13.589288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:13.591405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:13.592299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:13.593026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:13.733622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:13.747896 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c66cff03-a711-4930-b751-43ab2d0c623d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1312 microversion: 2.1 time: 0.197719 Aug 25 12:31:13.750146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 78/150] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:13 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:13.830725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:13.835210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:13.853420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:13.854677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:13.859338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:13.877156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:13.882580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:13.883347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:14.240465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1677787170", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:14.277434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:14.295657 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8137c54-aff7-4a8f-8a3c-9868e5c2b3d1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.482427 Aug 25 12:31:14.297939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 79/151] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:13 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:14.430687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:31:14.796425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:14.821787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:14.861896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:14.865018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:14.871437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:14.878085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:14.880078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:14.882704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:15.241746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:15.276827 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8bf3a89e-57d6-4217-8c93-45e5c844119f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1318 microversion: 2.1 time: 0.492380 Aug 25 12:31:15.293845 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 80/152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:14 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:15.341363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:15.342728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:15.357768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:15.359027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:15.360255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:15.361799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:15.362843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:15.364216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:15.389894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:31:15.390823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:31:15.391825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:31:15.392863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:31:15.421080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:31:15.495745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:15.498476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:15.499870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:15.502814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:15.506234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:15.506948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:15.541873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=59 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:15.585543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Getting quotas for project da5f96a655f2428398c431b107624a95. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:31:15.603807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Getting quotas for user 02d83698bb4d405797a50af230d3bd01 and project da5f96a655f2428398c431b107624a95. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:31:15.641626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:31:15.653867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:31:15.692709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:15.709764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad09308d-fb84-4b03-baff-073567357487 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.378232 Aug 25 12:31:15.733158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 81/153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:15 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:15.831311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa0e9db0-637d-425c-a094-54eff0c7ca1b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.571579 Aug 25 12:31:15.843746 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 73/154] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:31:15.855965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c0d5df2-f618-4c5b-9846-747457a72ddb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:15.856950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c0d5df2-f618-4c5b-9846-747457a72ddb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:16.085162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c0d5df2-f618-4c5b-9846-747457a72ddb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:16.127904 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c0d5df2-f618-4c5b-9846-747457a72ddb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1219 microversion: 2.1 time: 0.279144 Aug 25 12:31:16.130709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 74/155] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:15 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:16.328299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:16.329359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:16.356363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:16.358604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:16.359345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:16.362422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:16.364771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:16.366006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:16.612501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:16.638600 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e24dbb1-3abc-4dfa-8a98-fa704f4bc2a7 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1318 microversion: 2.1 time: 0.318446 Aug 25 12:31:16.652168 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 75/156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:16 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:16.749135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc3f73fc-d1cf-4eea-9b84-466eb8ada4b4 tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-943042555", "id": 254213334, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:16.818225 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc3f73fc-d1cf-4eea-9b84-466eb8ada4b4 tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 1.092665 Aug 25 12:31:16.843661 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 82/157] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:31:15 2022] POST /compute/v2.1/flavors => generated 464 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:16.873648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:16.874819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:16.920647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:16.922157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:16.929220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:16.934402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:16.935617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:16.939830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:17.354148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:17.385082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1d9fb02-c045-4d67-a4e3-149ece90ab9b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.539208 Aug 25 12:31:17.395881 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 83/158] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:16 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:17.435845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bc0cbe9-712d-46a1-82b6-da2b9f7460b0 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1724601989", "id": 153322748, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:17.509238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bc0cbe9-712d-46a1-82b6-da2b9f7460b0 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.867311 Aug 25 12:31:17.510846 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 76/159] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:31:16 2022] POST /compute/v2.1/flavors => generated 468 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:17.544386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fb98699-1059-4b18-a88b-483e15e2aef9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:17.547265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fb98699-1059-4b18-a88b-483e15e2aef9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:17.686666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fb98699-1059-4b18-a88b-483e15e2aef9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:17.704338 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fb98699-1059-4b18-a88b-483e15e2aef9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1219 microversion: 2.1 time: 0.190325 Aug 25 12:31:17.728819 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 77/160] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:17 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1219 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:17.741922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-331cce7c-8361-4b99-8c9a-22763b748924 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:17.859037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a5145d6-894b-4e39-a523-91165db4cc64 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:17.896466 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a5145d6-894b-4e39-a523-91165db4cc64 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] 10.222.0.60 "GET /compute/v2.1/flavors/254213334" status: 200 len: 464 microversion: 2.61 time: 0.497772 Aug 25 12:31:17.898032 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 84/161] 10.222.0.60 () {60 vars in 1196 bytes} [Thu Aug 25 12:31:17 2022] GET /compute/v2.1/flavors/254213334 => generated 464 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:17.967033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:18.011276 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-331cce7c-8361-4b99-8c9a-22763b748924 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/153322748/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.280181 Aug 25 12:31:18.016373 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 78/162] 10.222.0.60 () {62 vars in 1262 bytes} [Thu Aug 25 12:31:17 2022] POST /compute/v2.1/flavors/153322748/os-extra_specs => generated 62 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:18.032211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.032853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:18.043316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.044081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.045054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.046559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.047519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.048394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.179369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ef0fe-bbad-4eec-99a4-8321beab7c5d", "name": "network-vif-plugged", "status": "completed", "tag": "790a56d4-f1f6-468d-a242-3febcc35f394"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:18.202831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.204528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.205833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.243200 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] Creating event network-vif-plugged:790a56d4-f1f6-468d-a242-3febcc35f394 for instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d on n-h2-850468-18 Aug 25 12:31:18.261541 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-41787dab-1c1a-4f52-8640-138e6ce1afa9 req-a0794fc8-1b33-46e9-81af-2aa956db054c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360533 Aug 25 12:31:18.267025 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 85/163] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:18.284726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cd26be7-56ef-4f46-895c-36a6dfc5965c tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c477fdc0>, body: {"flavor": {"description": "new"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:18.375110 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cd26be7-56ef-4f46-895c-36a6dfc5965c tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/254213334" status: 200 len: 465 microversion: 2.61 time: 0.105952 Aug 25 12:31:18.376225 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 86/164] 10.222.0.60 () {62 vars in 1216 bytes} [Thu Aug 25 12:31:18 2022] PUT /compute/v2.1/flavors/254213334 => generated 465 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:18.386420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:18.391938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e5baaa2-35c9-49a2-91f5-849d97e5ba64 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.442496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e5baaa2-35c9-49a2-91f5-849d97e5ba64 tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/153322748" status: 202 len: 0 microversion: 2.86 time: 0.063589 Aug 25 12:31:18.442838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48ff267b-3a9b-49eb-959e-28725752d849 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.425264 Aug 25 12:31:18.444618 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 79/165] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:18.446675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 87/166] 10.222.0.60 () {60 vars in 1199 bytes} [Thu Aug 25 12:31:18 2022] DELETE /compute/v2.1/flavors/153322748 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:31:18.468142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.470056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:18.475703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-140ee8f9-d12f-4814-be6a-17097c72ec58 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.501929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.506287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.514827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.526894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.527572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.528426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.580029 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-140ee8f9-d12f-4814-be6a-17097c72ec58 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 7147 microversion: 2.61 time: 0.130463 Aug 25 12:31:18.582876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 80/167] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/flavors/detail => generated 7147 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:18.593915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04979f5f-d475-409f-9eb7-00b35ca4a84c tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.682779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04979f5f-d475-409f-9eb7-00b35ca4a84c tempest-FlavorMetadataValidation-1680616775 tempest-FlavorMetadataValidation-1680616775-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 7130 microversion: 2.86 time: 0.097304 Aug 25 12:31:18.684992 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 81/168] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/flavors/detail => generated 7130 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:18.695683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e527012f-8f33-4efe-aab4-cc4505909be1 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.759137 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e527012f-8f33-4efe-aab4-cc4505909be1 tempest-FlavorsV261TestJSON-1828083725 tempest-FlavorsV261TestJSON-1828083725-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 3674 microversion: 2.61 time: 0.072136 Aug 25 12:31:18.760728 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 82/169] 10.222.0.60 () {60 vars in 1166 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/flavors => generated 3674 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:18.792725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:18.794189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:18.807769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.809223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.810223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:18.811761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:18.812944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:18.813906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:19.073791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:19.085452 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-87cb3e19-856c-49a0-a7cd-23e46715d17d tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1223 microversion: 2.1 time: 0.300122 Aug 25 12:31:19.086553 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 83/170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1223 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:19.093700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27428623-1a86-44fb-965b-2c8d08adbce4 tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:19.125587 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27428623-1a86-44fb-965b-2c8d08adbce4 tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/254213334" status: 202 len: 0 microversion: 2.61 time: 0.036800 Aug 25 12:31:19.132322 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 84/171] 10.222.0.60 () {60 vars in 1199 bytes} [Thu Aug 25 12:31:19 2022] DELETE /compute/v2.1/flavors/254213334 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:31:19.239426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:19.250889 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b4f27c28-8326-442e-94e1-7ad1b1ece749 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.802178 Aug 25 12:31:19.264903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 88/172] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:18 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:19.274460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b472ad7e-46a8-4f7f-a627-d433f69aa12a tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:19.307383 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b472ad7e-46a8-4f7f-a627-d433f69aa12a tempest-FlavorsV261TestJSON-149924285 tempest-FlavorsV261TestJSON-149924285-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 6692 microversion: 2.61 time: 0.040763 Aug 25 12:31:19.308724 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 89/173] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:31:19 2022] GET /compute/v2.1/flavors/detail => generated 6692 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:19.490640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:19.491666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:19.500572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:19.501199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:19.501754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:19.502850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:19.503632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:19.504897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:19.543710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34b4055c-a077-4887-8e1b-7f279f2a1a58 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] Action: 'create', calling method: .version_select at 0x7fc6c360ac10>, body: {"security_group": {"name": "tempest-securitygroup-1612859022", "description": "tempest-description-788333055"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:19.882277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:19.897651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2da7dd78-c344-4862-a119-ab3c307d7b01 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.412706 Aug 25 12:31:19.899458 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:19 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:20.128009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:20.129723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:20.152978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.154208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.155223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:20.156874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.158011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.159036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:20.296667 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34b4055c-a077-4887-8e1b-7f279f2a1a58 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.162094 Aug 25 12:31:20.312467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 85/175] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:31:19 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:20.312978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:20.315514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:20.333897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.335867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.336957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:20.338654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.339714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.340688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:20.346770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:20.401135 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea7befdd-0eb3-40b8-b7d6-79228be0b9c8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1223 microversion: 2.1 time: 0.280583 Aug 25 12:31:20.404732 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 91/176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:20 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1223 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:20.435393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-929042d5-1054-490e-9915-3d12743ce844 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] Action: 'create', calling method: .version_select at 0x7fc6c34b5280>, body: {"security_group": {"name": "tempest-securitygroup-513453747", "description": "tempest-description-1390486498"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:20.750360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:20.793318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8fd710fa-f055-4528-a4ec-ca1b232c1d3b tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1338 microversion: 2.1 time: 0.493647 Aug 25 12:31:20.797917 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 86/177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:20 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1338 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:20.913488 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-929042d5-1054-490e-9915-3d12743ce844 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.502928 Aug 25 12:31:20.917468 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 92/178] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:31:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:20.952516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:20.954508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:20.973708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.974728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.975648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:20.977069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:20.978757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:20.979562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:21.386858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:21.404604 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f60b8a28-e0e1-4d58-84be-845297803489 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.471132 Aug 25 12:31:21.406604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 87/179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:20 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:21.460394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:21.461992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:21.472569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:21.474187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:21.474966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:21.476039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:21.476767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:21.478189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:21.560646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b888313-10d8-4644-a086-f8826af7c96e tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] Action: 'create', calling method: .version_select at 0x7fc6c34b5160>, body: {"security_group": {"name": "tempest-securitygroup-437204897", "description": "tempest-description-120810781"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:21.624995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:21.640506 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0fc2e4d-4686-426b-a7a3-f6a3222a44e7 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1223 microversion: 2.1 time: 0.187835 Aug 25 12:31:21.641415 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 88/180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:21 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1223 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:21.828624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:21.830875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:21.855223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:21.856065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:21.856822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:21.857808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:21.858492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:21.859198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:22.258065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:22.298056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa97e961-6d67-412b-9292-5596841ca5d5 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1487 microversion: 2.1 time: 0.481194 Aug 25 12:31:22.313358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 89/181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:21 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1487 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:22.364197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:22.371307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:22.375518 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b888313-10d8-4644-a086-f8826af7c96e tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.425794 Aug 25 12:31:22.378239 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 93/182] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:31:20 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:22.389953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:22.403107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a39de36-4864-4e67-a6ac-8d3f97cd9004 tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] Action: 'create', calling method: .version_select at 0x7fc6c3484790>, body: {"security_group": {"name": "tempest-securitygroup-714956181", "description": "tempest-description-1997947439"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:22.406464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:22.413315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:22.417086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:22.418195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:22.420498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:22.787831 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a39de36-4864-4e67-a6ac-8d3f97cd9004 tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.393261 Aug 25 12:31:22.796666 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 94/183] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:31:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:22.818388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:22.819387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:22.842227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:22.843395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:22.844555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:22.846137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:22.846822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:22.847391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:23.279395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c22413b2-47d1-4a5f-b459-92691c29fcff tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1640 microversion: 2.1 time: 0.929397 Aug 25 12:31:23.281352 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 90/184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:22 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1640 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:23.290219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:23.291754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:23.302594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:23.303870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:23.305092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:23.306792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:23.308281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:23.309429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:23.347688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:23.375223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-edf6c544-b9c5-4acd-b529-2711065dfd05 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.576607 Aug 25 12:31:23.381232 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 95/185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:22 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:23.401400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ce83497-f558-438d-a069-23f04139dc73 tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] Calling method '.version_select at 0x7fc6c3702670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:23.520888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:23.542450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d6c5995-f31f-4716-9a1c-317ff3aa2817 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1271 microversion: 2.1 time: 0.258920 Aug 25 12:31:23.562188 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 91/186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:23 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:23.583001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:23.584414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:23.602288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:23.603721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:23.607343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:23.610506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:23.612153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:23.613851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:23.701074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:31:24.102289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "compute-rpcapi-router" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:31:24.103634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f266319-fcfb-45de-bfea-5a61344eb11d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquired lock "compute-rpcapi-router" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:31:24.109367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:24.114068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:24.115786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:24.120347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:24.121332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:24.125056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:24.154481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.rpcapi [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 12:31:24.157839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] Releasing lock "compute-rpcapi-router" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:31:24.254863 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-465665e8-e77c-4aac-9c92-03c5b41cbf81 None None] 10.222.0.60 "DELETE /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 204 len: 0 microversion: 2.1 time: 0.688494 Aug 25 12:31:24.257515 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 92/187] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:31:23 2022] DELETE /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:31:24.285222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:24.288685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:24.306051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:24.309047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:24.313706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:24.325477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:24.327389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:24.329609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:25.089904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:25.133124 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8203a83c-b3be-4f0e-9f03-4688434cbe7d tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1493 microversion: 2.1 time: 0.853369 Aug 25 12:31:25.144177 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 93/188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:24 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1493 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:25.148727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:25.149893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:25.182336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:25.184621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:25.187076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:25.190093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:25.191994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:25.197144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:26.063220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:26.075325 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-741e9f87-0dca-4f83-b46c-103d27b5c3f1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.938943 Aug 25 12:31:26.076322 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 94/189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:25 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:26.086468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:26.089283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:26.105440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:26.109378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:26.110262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:26.112583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:26.113873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:26.115112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:26.554058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:26.570463 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85c1a4eb-a24b-478b-a5b9-f767713ef8fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1277 microversion: 2.1 time: 0.491747 Aug 25 12:31:26.571858 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 95/190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:26 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1277 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:26.931360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dea48cab-48e9-47be-a170-168077948f39 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1551572474", "ram": 512, "vcpus": 1, "disk": 10, "id": 1758878864, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:27.126671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dea48cab-48e9-47be-a170-168077948f39 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.540869 Aug 25 12:31:27.127840 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 96/191] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:26 2022] POST /compute/v2.1/flavors => generated 416 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:27.219298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef194ae5-b778-4be7-9180-c09d1588cf69", "tag": "fafb5042-8900-45e3-bdb2-3b5527a0a97c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:27.242146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:27.243209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:27.244000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:27.283792 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] Creating event network-changed:fafb5042-8900-45e3-bdb2-3b5527a0a97c for instance ef194ae5-b778-4be7-9180-c09d1588cf69 on n-h1-850468-18 Aug 25 12:31:27.293484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fad91b48-d305-4de5-81d2-faf2c73cc6a4 req-efa6278f-cb14-4936-ae5c-080fc053dd0d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164357 Aug 25 12:31:27.294505 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 97/192] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:27.372755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab787074-fee3-40b1-8c8c-3ea0be3d4d1b tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:27.381145 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ab787074-fee3-40b1-8c8c-3ea0be3d4d1b tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab787074-fee3-40b1-8c8c-3ea0be3d4d1b tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin] Request method failure captured: Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2udW1lLd9dBIF2duaOG5L37xtEWoBZQgejuL4NINFSHNCoM9hqxeF46jx0MxtG5rIQ_SiBasdDNfpPbQWJdynKerTfIz6pFbpO7-gpeqFB9A7FuiFRevj0OjKF-63ACceeS7ytuTVI3Rr7bayzdIKzMc4jPEZrUOw-2Y7YhDPeJndQ Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0570072004d94fa28499dfcb8a3c8d67 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:31:27.391513 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0570072004d94fa28499dfcb8a3c8d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0570072004d94fa28499dfcb8a3c8d67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0570072004d94fa28499dfcb8a3c8d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0570072004d94fa28499dfcb8a3c8d67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0570072004d94fa28499dfcb8a3c8d67 Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9d38e966cbed4b319d84d0ad4e5e2293 Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:27.394057 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid timestamp for date invalid_time Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'invalid_time'} Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:27.395772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab787074-fee3-40b1-8c8c-3ea0be3d4d1b tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:27.399587 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab787074-fee3-40b1-8c8c-3ea0be3d4d1b tempest-InstanceUsageAuditLogNegativeTestJSON-731328958 tempest-InstanceUsageAuditLogNegativeTestJSON-731328958-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.098636 Aug 25 12:31:27.402182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 98/193] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 25 12:31:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:31:27.411132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:27.412788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:27.426099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:27.427211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:27.428077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:27.429584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:27.430580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:27.431399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:27.695393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:28.114366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7594f93920ab41868c9208c4798992a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f38f00baa246399078fb86aca9c2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:28.133153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5fbb3f8-0c89-4fb3-9a2a-70ec187e29a0 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 200 len: 1493 microversion: 2.1 time: 0.733338 Aug 25 12:31:28.136031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 99/194] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:27 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 1493 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:28.147259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:28.149565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:28.162956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:28.164395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:28.165631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:28.167638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:28.168924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:28.170091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:28.182550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:28.545793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:28.558803 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aff40573-bc1a-42ef-95fb-d434b9979c27 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.420417 Aug 25 12:31:28.559464 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 100/195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:28 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:28.752715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-894da9df-b9e4-4cf8-8c06-7fbd15408c33 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:28.771966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-894da9df-b9e4-4cf8-8c06-7fbd15408c33 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] HTTP exception thrown: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-894da9df-b9e4-4cf8-8c06-7fbd15408c33 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Request method failure captured: Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2ubA_0sHb5DHGHzthnsq4GSpzEMVF0aSlobxMH-tJ5na4yB7aO826VH7yPOjzXo-dM6_t4HouKBPKFHLFF4-QnZ-zSzWUCyT-jYa9_2JCSnh8Na8V6KjPcCC8Bh53lEyN0rslRmbz7tTK2ACr45BJrflSc95IalaMf-IUmTPUSWh-c Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:28.775501 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76625098873d4933b5eb4ecd42805a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9052f43974c4407b97ec6f2dcde343bb Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:28.777180 n-d-850468-18 devstack@n-api.service[122701]: exception: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'flavor_id': '1758878864', 'id': 'hw:cpu_thread_policy'} Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:28.778167 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-894da9df-b9e4-4cf8-8c06-7fbd15408c33 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Returning 404 to user: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-894da9df-b9e4-4cf8-8c06-7fbd15408c33 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] 10.222.0.60 "GET /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.217318 Aug 25 12:31:28.780019 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 101/196] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 12:31:28 2022] GET /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:28.827096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ce83497-f558-438d-a069-23f04139dc73 tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7624 microversion: 2.1 time: 5.443496 Aug 25 12:31:28.828429 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 96/197] 10.222.0.60 () {58 vars in 1191 bytes} [Thu Aug 25 12:31:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7624 bytes in 5446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:28.839165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:28.840489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:28.854247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:28.855170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:28.855885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:28.857450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:28.858617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:28.859328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:28.869963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=84 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:29.020191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-227a9300-2c8a-44e8-a06e-97e74f3bab77 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.023709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-227a9300-2c8a-44e8-a06e-97e74f3bab77 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '1ec16865ff76415096ad2682320a9ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c350813e911a492f954a6fc6ad8eb0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-227a9300-2c8a-44e8-a06e-97e74f3bab77 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Request method failure captured: Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2ucuUeI8P2RRhQg899fkhxdynZOkXasSMnXGPeYMlT-rnlkig2i1x7A4ZZeAvF44Jk2kIwQs23zE0wmT8a7OF6xRjYhCDsD8TFOfX5dbtZuDFnoo16w9tu4Mf6VyWtckhbe9q2inFjffifK-wmBb5j1xvyb2CIsk8UWqwomhEXOlDo Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: c350813e911a492f954a6fc6ad8eb0e0 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:29.025701 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: c350813e911a492f954a6fc6ad8eb0e0 Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1ec16865ff76415096ad2682320a9ad0 Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project Aug 25 12:31:29.028377 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:29.029655 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 25 12:31:29.032075 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.034312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-227a9300-2c8a-44e8-a06e-97e74f3bab77 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:29.034312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-227a9300-2c8a-44e8-a06e-97e74f3bab77 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.239505 Aug 25 12:31:29.034312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 102/198] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:31:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:29.043423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4ef0fe-bbad-4eec-99a4-8321beab7c5d", "name": "network-vif-deleted", "tag": "790a56d4-f1f6-468d-a242-3febcc35f394"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:29.064533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.065505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.066363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:29.089502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] Creating event network-vif-deleted:790a56d4-f1f6-468d-a242-3febcc35f394 for instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d on n-h2-850468-18 Aug 25 12:31:29.099231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bcf5120f-94e6-43c5-82d4-31f081e72eee req-ab15740f-df23-449f-9d1a-20fc19eef828 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064870 Aug 25 12:31:29.100481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 103/199] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:29.110933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86208f60-3dd9-49d1-9bd5-9b10a906ffeb tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:29.118695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-86208f60-3dd9-49d1-9bd5-9b10a906ffeb tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9052f43974c4407b97ec6f2dcde343bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76625098873d4933b5eb4ecd42805a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86208f60-3dd9-49d1-9bd5-9b10a906ffeb tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Request method failure captured: Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/flavors/1758878864/os-extra_specs HTTP/1.1 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 66 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2ubA_0sHb5DHGHzthnsq4GSpzEMVF0aSlobxMH-tJ5na4yB7aO826VH7yPOjzXo-dM6_t4HouKBPKFHLFF4-QnZ-zSzWUCyT-jYa9_2JCSnh8Na8V6KjPcCC8Bh53lEyN0rslRmbz7tTK2ACr45BJrflSc95IalaMf-IUmTPUSWh-c Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:29.122250 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76625098873d4933b5eb4ecd42805a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9052f43974c4407b97ec6f2dcde343bb Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 25 12:31:29.123718 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'flavor_id': '1758878864', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:29.124514 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 25 12:31:29.125534 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.126805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86208f60-3dd9-49d1-9bd5-9b10a906ffeb tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:29.126805 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-86208f60-3dd9-49d1-9bd5-9b10a906ffeb tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] 10.222.0.60 "POST /compute/v2.1/flavors/1758878864/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023307 Aug 25 12:31:29.131182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 104/200] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:31:29 2022] POST /compute/v2.1/flavors/1758878864/os-extra_specs => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:29.138348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:29.142261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50eb0d21-b3ed-419a-9a9d-fdd625b4a301 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] Calling method '.version_select at 0x7fc6c435fca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.155768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-025c96d2-37ed-4c9f-b70c-14eb197e2490 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.325213 Aug 25 12:31:29.157335 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 97/201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:28 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:29.191850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3ccb84e-0f12-4adb-b4ee-716ee42c9db2 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.196989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b3ccb84e-0f12-4adb-b4ee-716ee42c9db2 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '1ec16865ff76415096ad2682320a9ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c350813e911a492f954a6fc6ad8eb0e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3ccb84e-0f12-4adb-b4ee-716ee42c9db2 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Request method failure captured: Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012:31:29 HTTP/1.1 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2ucuUeI8P2RRhQg899fkhxdynZOkXasSMnXGPeYMlT-rnlkig2i1x7A4ZZeAvF44Jk2kIwQs23zE0wmT8a7OF6xRjYhCDsD8TFOfX5dbtZuDFnoo16w9tu4Mf6VyWtckhbe9q2inFjffifK-wmBb5j1xvyb2CIsk8UWqwomhEXOlDo Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c350813e911a492f954a6fc6ad8eb0e0 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:29.201160 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c350813e911a492f954a6fc6ad8eb0e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c350813e911a492f954a6fc6ad8eb0e0 Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1ec16865ff76415096ad2682320a9ad0 Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project Aug 25 12:31:29.203471 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '2022-08-25 12:31:29'} Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:29.204592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 25 12:31:29.215971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.219868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3ccb84e-0f12-4adb-b4ee-716ee42c9db2 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:29.219868 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3ccb84e-0f12-4adb-b4ee-716ee42c9db2 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740 tempest-InstanceUsageAuditLogNegativeTestJSON-1003153740-project] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25 12:31:29" status: 403 len: 128 microversion: 2.1 time: 0.044352 Aug 25 12:31:29.219868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 98/202] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 12:31:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012%3A31%3A29 => generated 128 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:29.220660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c3a97b0-3cb3-4860-9088-8f15d2e0cdaa tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:29.297328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c3a97b0-3cb3-4860-9088-8f15d2e0cdaa tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1758878864/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088606 Aug 25 12:31:29.299201 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 99/203] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:31:29 2022] POST /compute/v2.1/flavors/1758878864/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:31:29.310950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.317119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:29.341211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.347113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.350075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:29.352477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.355463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.358591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:29.407274 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] HTTP exception thrown: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Request method failure captured: Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d HTTP/1.1 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tfhLtxzIXAVYwrNCWwtmRWII9uI0Yg7Cif0An_lzdBEDnSL4vHL3kY9Yn-vGMmDML26pUFJj8POSNkuWbxvHuiDrVujsdErzfnI6HMNNqZyp_6SHI15cilG9uQPSy3KC69xY7AKxUGTZfvLYPQEie25uQy44DBzBrcq42Rs94X39w Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:29.417495 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7594f93920ab41868c9208c4798992a1 Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:29.419893 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bb4ef0fe-bbad-4eec-99a4-8321beab7c5d'} Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:29.421671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:29.427287 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.433497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Returning 404 to user: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:29.433497 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a67a2dfa-1e90-4142-bb17-90a8ca18f1b1 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 404 len: 111 microversion: 2.1 time: 0.118782 Aug 25 12:31:29.433497 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 100/204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:29 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:29.433497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18fda3a0-7284-4b35-ad48-64aaab15adca tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.437997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-18fda3a0-7284-4b35-ad48-64aaab15adca tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9052f43974c4407b97ec6f2dcde343bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76625098873d4933b5eb4ecd42805a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18fda3a0-7284-4b35-ad48-64aaab15adca tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Request method failure captured: Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2ubA_0sHb5DHGHzthnsq4GSpzEMVF0aSlobxMH-tJ5na4yB7aO826VH7yPOjzXo-dM6_t4HouKBPKFHLFF4-QnZ-zSzWUCyT-jYa9_2JCSnh8Na8V6KjPcCC8Bh53lEyN0rslRmbz7tTK2ACr45BJrflSc95IalaMf-IUmTPUSWh-c Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:29.439183 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76625098873d4933b5eb4ecd42805a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9052f43974c4407b97ec6f2dcde343bb Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:29.444685 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'flavor_id': '1758878864', 'id': 'hw:numa_nodes'} Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:29.446059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:29.450298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18fda3a0-7284-4b35-ad48-64aaab15adca tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:29.455458 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18fda3a0-7284-4b35-ad48-64aaab15adca tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] 10.222.0.60 "DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018416 Aug 25 12:31:29.455458 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 101/205] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:31:29 2022] DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:29.456562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10e881d1-0d86-4af9-844f-05e3df065faf tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:29.486657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10e881d1-0d86-4af9-844f-05e3df065faf tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.487530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10e881d1-0d86-4af9-844f-05e3df065faf tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.490651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10e881d1-0d86-4af9-844f-05e3df065faf tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:29.835119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10e881d1-0d86-4af9-844f-05e3df065faf tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.388439 Aug 25 12:31:29.836093 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 102/206] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:29.852023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bbf2c0c-b399-4d42-a917-1d595714d805 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:29.939470 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5bbf2c0c-b399-4d42-a917-1d595714d805 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/1758878864/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101518 Aug 25 12:31:29.942129 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 103/207] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:31:29 2022] POST /compute/v2.1/flavors/1758878864/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:31:29.960327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:29.961699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:29.974652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.975661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.976569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:29.977967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:29.979305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:29.979591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:30.032333 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50eb0d21-b3ed-419a-9a9d-fdd625b4a301 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.903486 Aug 25 12:31:30.032960 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 105/208] 10.222.0.60 () {58 vars in 1191 bytes} [Thu Aug 25 12:31:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:30.039820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0db4a775-8f84-425c-959d-9974f4e0b317 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:30.101695 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0db4a775-8f84-425c-959d-9974f4e0b317 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.065511 Aug 25 12:31:30.102990 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 106/209] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:30 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:30.122909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-890f2548-030d-4cfa-9f60-cb55f18764d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:30.132632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-890f2548-030d-4cfa-9f60-cb55f18764d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9052f43974c4407b97ec6f2dcde343bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76625098873d4933b5eb4ecd42805a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-890f2548-030d-4cfa-9f60-cb55f18764d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Request method failure captured: Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 22 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2ubA_0sHb5DHGHzthnsq4GSpzEMVF0aSlobxMH-tJ5na4yB7aO826VH7yPOjzXo-dM6_t4HouKBPKFHLFF4-QnZ-zSzWUCyT-jYa9_2JCSnh8Na8V6KjPcCC8Bh53lEyN0rslRmbz7tTK2ACr45BJrflSc95IalaMf-IUmTPUSWh-c Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:30.138129 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_76625098873d4933b5eb4ecd42805a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/76625098873d4933b5eb4ecd42805a84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 76625098873d4933b5eb4ecd42805a84 Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9052f43974c4407b97ec6f2dcde343bb Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: {"hw:numa_nodes": "1"} Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:30.141793 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'flavor_id': '1758878864', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:30.145225 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 25 12:31:30.148749 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.153256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-890f2548-030d-4cfa-9f60-cb55f18764d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:30.155735 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-890f2548-030d-4cfa-9f60-cb55f18764d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723 tempest-FlavorsExtraSpecsNegativeTestJSON-1858015723-project] 10.222.0.60 "PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.050367 Aug 25 12:31:30.164967 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 107/210] 10.222.0.60 () {60 vars in 1265 bytes} [Thu Aug 25 12:31:30 2022] PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes => generated 124 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:30.183031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e4507df-f7b8-4e1b-8ed5-af5b0a3e694c tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] Calling method '.version_select at 0x7fc6c362e160>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:30.557438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:30.573694 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee8ebb0f-5177-4fb3-8b67-996657e55a2c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.623548 Aug 25 12:31:30.575120 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 104/211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:29 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:30.584952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ad49ed2-97f5-40fb-bece-c261bcde765b tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1077852663"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:30.591733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-2ad49ed2-97f5-40fb-bece-c261bcde765b tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid bea09293-148b-48b5-968c-c755c093c259 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:30.633649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ad49ed2-97f5-40fb-bece-c261bcde765b tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056266 Aug 25 12:31:30.636156 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 105/212] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:30.640800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0da268da-941c-4b35-ace1-1a1a0b18488a tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:30.652682 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0da268da-941c-4b35-ace1-1a1a0b18488a tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] HTTP exception thrown: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0da268da-941c-4b35-ace1-1a1a0b18488a tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Request method failure captured: Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2udrb3JIDkvz0AT1fvUW3Yz6fkC-lzFYyk2MF51QOZqi2GtWIA4G57-N4ULo2KB_CG6ggZxnqswI6ts_C8TYWE3g3Wwos__CM3h_jcSkEVkGKFlrEC_icNxyB7ZDCQfitHs8ElTRoRfdO8Y41VDSNbzBC9GXbLELXQGeNp3SYB8FDo Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:30.653954 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86d82e3674354200822c72494253fa72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86d82e3674354200822c72494253fa72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 18d9d6845e814879ba0fc6582316a5bd Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:30.656394 n-d-850468-18 devstack@n-api.service[122700]: exception: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'flavor_id': '1758878864', 'id': 'hw:cpu_thread_policy'} Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:30.657632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0da268da-941c-4b35-ace1-1a1a0b18488a tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Returning 404 to user: Flavor 1758878864 has no extra specs with key hw:cpu_thread_policy. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0da268da-941c-4b35-ace1-1a1a0b18488a tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.020021 Aug 25 12:31:30.659885 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 106/213] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:31:30 2022] DELETE /compute/v2.1/flavors/1758878864/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:30.670421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:30.672071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:30.681150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:30.682721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:30.683126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:30.684779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:30.685868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:30.686460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:31.148047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e4507df-f7b8-4e1b-8ed5-af5b0a3e694c tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/17c78871-ec14-45ff-864c-92ce5f0a74f3" status: 202 len: 0 microversion: 2.1 time: 0.980708 Aug 25 12:31:31.154527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 108/214] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:31:30 2022] DELETE /compute/v2.1/os-security-groups/17c78871-ec14-45ff-864c-92ce5f0a74f3 => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:31.162123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9c5a3e0-f5a3-4a3c-b06a-42b5a8730615 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:31.192876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9c5a3e0-f5a3-4a3c-b06a-42b5a8730615 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:31.194894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9c5a3e0-f5a3-4a3c-b06a-42b5a8730615 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:31.196495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9c5a3e0-f5a3-4a3c-b06a-42b5a8730615 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:31.197779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:31.230618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-09712c81-26ca-4bd1-87e0-15028666b8f0 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.564605 Aug 25 12:31:31.248150 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 107/215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:30 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:31.262407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4a622da-f471-4ab0-b044-ab4c04533d1f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:31.273816 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c4a622da-f471-4ab0-b044-ab4c04533d1f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4a622da-f471-4ab0-b044-ab4c04533d1f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Request method failure captured: Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 27 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2udrb3JIDkvz0AT1fvUW3Yz6fkC-lzFYyk2MF51QOZqi2GtWIA4G57-N4ULo2KB_CG6ggZxnqswI6ts_C8TYWE3g3Wwos__CM3h_jcSkEVkGKFlrEC_icNxyB7ZDCQfitHs8ElTRoRfdO8Y41VDSNbzBC9GXbLELXQGeNp3SYB8FDo Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:31.278294 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86d82e3674354200822c72494253fa72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86d82e3674354200822c72494253fa72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 18d9d6845e814879ba0fc6582316a5bd Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: {"hw:cpu_policy": "shared"} Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:31.280604 n-d-850468-18 devstack@n-api.service[122700]: exception: Request body and URI mismatch Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'flavor_id': '1758878864', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:31.282021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4a622da-f471-4ab0-b044-ab4c04533d1f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:31.285103 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4a622da-f471-4ab0-b044-ab4c04533d1f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.038305 Aug 25 12:31:31.290939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 108/216] 10.222.0.60 () {60 vars in 1265 bytes} [Thu Aug 25 12:31:31 2022] PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes => generated 73 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:31:31.296567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4431d2d-434e-4d0b-95ba-39f93aac3b19", "tag": "7bb811dd-3f64-44f2-804e-ffadbb99711c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:31.312446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:31.313019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:31.313622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:31.335090 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] Creating event network-changed:7bb811dd-3f64-44f2-804e-ffadbb99711c for instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 on n-h1-850468-18 Aug 25 12:31:31.346549 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0116216e-302f-4ab9-b0b6-620a7fa9643b req-d12fc1bd-c8a1-47eb-ab6e-af68c8e3f2fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053679 Aug 25 12:31:31.347304 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 109/217] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:31.358581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0146d363-77ed-491f-81f4-008162ae2d4a tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] Calling method '.version_select at 0x7fc6c32e5af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:31.468989 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9c5a3e0-f5a3-4a3c-b06a-42b5a8730615 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.315633 Aug 25 12:31:31.478114 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 109/218] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:31.482301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f19c208-21d5-4b7e-80a5-36be177224b2 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f19c208-21d5-4b7e-80a5-36be177224b2 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Request method failure captured: Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 49 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2udrb3JIDkvz0AT1fvUW3Yz6fkC-lzFYyk2MF51QOZqi2GtWIA4G57-N4ULo2KB_CG6ggZxnqswI6ts_C8TYWE3g3Wwos__CM3h_jcSkEVkGKFlrEC_icNxyB7ZDCQfitHs8ElTRoRfdO8Y41VDSNbzBC9GXbLELXQGeNp3SYB8FDo Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:31:31.496885 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_86d82e3674354200822c72494253fa72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/86d82e3674354200822c72494253fa72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/86d82e3674354200822c72494253fa72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 86d82e3674354200822c72494253fa72 Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 18d9d6845e814879ba0fc6582316a5bd Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 25 12:31:31.499313 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'flavor_id': '1758878864', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 25 12:31:31.500836 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.503237 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f19c208-21d5-4b7e-80a5-36be177224b2 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f19c208-21d5-4b7e-80a5-36be177224b2 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026574 Aug 25 12:31:31.507927 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 110/219] 10.222.0.60 () {60 vars in 1265 bytes} [Thu Aug 25 12:31:31 2022] PUT /compute/v2.1/flavors/1758878864/os-extra_specs/hw:numa_nodes => generated 117 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:31:31.514137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-697dfa81-b0fa-4b02-bc8e-a0b5af7efbbb tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:31.538085 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-697dfa81-b0fa-4b02-bc8e-a0b5af7efbbb tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.035134 Aug 25 12:31:31.539499 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 111/220] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:31:31 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:31.548349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-794382e0-cc89-4a30-9c38-1a5b7676c65f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:31.599213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-794382e0-cc89-4a30-9c38-1a5b7676c65f tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1758878864" status: 202 len: 0 microversion: 2.1 time: 0.057822 Aug 25 12:31:31.607911 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 112/221] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:31:31 2022] DELETE /compute/v2.1/flavors/1758878864 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:31.621608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80d79c5b-822d-4bd5-b2bc-33f843cd6eb7 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:31.640853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80d79c5b-822d-4bd5-b2bc-33f843cd6eb7 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:31.641881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80d79c5b-822d-4bd5-b2bc-33f843cd6eb7 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:31.642785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80d79c5b-822d-4bd5-b2bc-33f843cd6eb7 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:31.890141 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80d79c5b-822d-4bd5-b2bc-33f843cd6eb7 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.274650 Aug 25 12:31:31.891452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 113/222] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:31.914556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:31.917503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:31.931822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:31.932845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:31.933768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:31.935506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:31.936788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:31.937733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:32.460342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:32.479375 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-06d5bfe9-147b-425f-aed3-bba5ffbe6ce3 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.581978 Aug 25 12:31:32.481012 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 114/223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:31 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:32.490936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b6060c7-29ee-478c-80fb-869f28f9aacf tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:32.499760 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0146d363-77ed-491f-81f4-008162ae2d4a tempest-SecurityGroupsTestAdminJSON-880083859 tempest-SecurityGroupsTestAdminJSON-880083859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/eb311c56-e7a1-49ea-ad15-2d9ed19f4198" status: 202 len: 0 microversion: 2.1 time: 1.148486 Aug 25 12:31:32.506333 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 110/224] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:31:31 2022] DELETE /compute/v2.1/os-security-groups/eb311c56-e7a1-49ea-ad15-2d9ed19f4198 => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:32.511367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-037e104d-062c-439f-ac3c-5ece9bc76af4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:32.526625 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b6060c7-29ee-478c-80fb-869f28f9aacf tempest-FlavorsExtraSpecsNegativeTestJSON-101817061 tempest-FlavorsExtraSpecsNegativeTestJSON-101817061-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.043220 Aug 25 12:31:32.528430 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 115/225] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:32 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:32.535714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:32.538320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:32.542173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:32.543371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:32.564045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-037e104d-062c-439f-ac3c-5ece9bc76af4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.056121 Aug 25 12:31:32.564660 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 111/226] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:32 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:32.568832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:32.571913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:32.575434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:32.576928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:32.577221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-735553e0-708d-4d46-9522-89c88f67d519 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] Calling method '.version_select at 0x7fc6c34b53a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:32.580449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:32.581487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:32.948896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:32.959635 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df0561e5-7920-4590-9f13-ab565ed63f63 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.429360 Aug 25 12:31:32.960787 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 116/227] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:32 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:32.966738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-979320a1-b648-4362-aa1b-4ec4021f862c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-43920985"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:32.970930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-979320a1-b648-4362-aa1b-4ec4021f862c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid a71e576d-60df-473b-b6f5-e841cd2bf08e for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:32.997514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-735553e0-708d-4d46-9522-89c88f67d519 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3a25b522-54a1-4e6b-927b-59855b0f185f" status: 202 len: 0 microversion: 2.1 time: 0.431371 Aug 25 12:31:32.998710 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 112/228] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:31:32 2022] DELETE /compute/v2.1/os-security-groups/3a25b522-54a1-4e6b-927b-59855b0f185f => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:31:33.008896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dce6f9d5-1f2c-49b4-97b7-78964ebffcf1 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] Calling method '.version_select at 0x7fc6c396daf0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:33.038582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-979320a1-b648-4362-aa1b-4ec4021f862c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.071839 Aug 25 12:31:33.053057 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 117/229] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:32 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:33.060007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-238091d0-e3d3-456a-923f-ba2081b18b69 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:33.096643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-238091d0-e3d3-456a-923f-ba2081b18b69 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:33.097960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-238091d0-e3d3-456a-923f-ba2081b18b69 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:33.100986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-238091d0-e3d3-456a-923f-ba2081b18b69 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:33.281939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-238091d0-e3d3-456a-923f-ba2081b18b69 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.227280 Aug 25 12:31:33.282945 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 118/230] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:33.295518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a58bdbc4-0203-4c3c-a7ce-f85cac772b14 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:33.319892 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a58bdbc4-0203-4c3c-a7ce-f85cac772b14 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.027409 Aug 25 12:31:33.323434 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:31:33 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:33.342955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca5a3494-db22-41da-8a80-740913a7e0ad tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:33.371630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca5a3494-db22-41da-8a80-740913a7e0ad tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:33.373216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca5a3494-db22-41da-8a80-740913a7e0ad tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:33.375255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca5a3494-db22-41da-8a80-740913a7e0ad tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:33.456284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dce6f9d5-1f2c-49b4-97b7-78964ebffcf1 tempest-SecurityGroupsTestAdminJSON-295255978 tempest-SecurityGroupsTestAdminJSON-295255978-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7cee8760-849f-4445-8980-4992794f4cac" status: 202 len: 0 microversion: 2.1 time: 0.452667 Aug 25 12:31:33.457696 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 113/232] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:31:33 2022] DELETE /compute/v2.1/os-security-groups/7cee8760-849f-4445-8980-4992794f4cac => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:31:33.542129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:33.550373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:33.583228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:33.583888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:33.585287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:33.587769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:33.588899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:33.590724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:33.608657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca5a3494-db22-41da-8a80-740913a7e0ad tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.276167 Aug 25 12:31:33.618161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 120/233] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:33.624830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a1c8fad-ed1a-4c08-ad7b-9bba2a50dd12 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:33.666390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a1c8fad-ed1a-4c08-ad7b-9bba2a50dd12 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045493 Aug 25 12:31:33.669340 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 121/234] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:33 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:33.689256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db77504d-c512-4594-bc49-147bd9684591 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-907250403"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:33.699374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-db77504d-c512-4594-bc49-147bd9684591 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 561d2f06-6e45-40bb-8ac2-b40942fc1f0f for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:33.758371 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db77504d-c512-4594-bc49-147bd9684591 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.078839 Aug 25 12:31:33.773929 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 122/235] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:33.786702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-228a4632-d8eb-4c15-a387-e980f32ed353 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:33.808340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228a4632-d8eb-4c15-a387-e980f32ed353 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:33.809217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228a4632-d8eb-4c15-a387-e980f32ed353 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:33.811125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228a4632-d8eb-4c15-a387-e980f32ed353 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:33.981661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:33.994750 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-965f7034-d47b-410b-ad86-67b4c00122d2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.482300 Aug 25 12:31:33.999392 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 114/236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:33 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:34.031337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:34.038379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:34.054899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:34.056434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:34.057556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:34.059310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:34.061493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:34.062596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:34.137250 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-228a4632-d8eb-4c15-a387-e980f32ed353 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.360604 Aug 25 12:31:34.137859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 123/237] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:33 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:34.155672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92791925-cb0b-4eaa-8825-bc595047f349 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.172539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:34.200401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92791925-cb0b-4eaa-8825-bc595047f349 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:34.201767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92791925-cb0b-4eaa-8825-bc595047f349 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:34.202953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92791925-cb0b-4eaa-8825-bc595047f349 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:34.396948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:34.411698 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30e61004-f1a5-4ca7-b7c3-7bded4415efa tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.409270 Aug 25 12:31:34.413186 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 115/238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:34 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:34.418230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef194ae5-b778-4be7-9180-c09d1588cf69", "name": "network-vif-plugged", "status": "completed", "tag": "fafb5042-8900-45e3-bdb2-3b5527a0a97c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.435944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:34.436602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:34.437380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:34.454404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] Creating event network-vif-plugged:fafb5042-8900-45e3-bdb2-3b5527a0a97c for instance ef194ae5-b778-4be7-9180-c09d1588cf69 on n-h1-850468-18 Aug 25 12:31:34.462134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3e4ba29f-0cf2-4063-a24b-b412146d5033 req-d5a41875-9f3c-49e5-a185-dfbaeae79c01 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047097 Aug 25 12:31:34.463818 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 116/239] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:34.493468 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92791925-cb0b-4eaa-8825-bc595047f349 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.345662 Aug 25 12:31:34.494053 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 124/240] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:34.511423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea790cff-3ad6-4c24-af69-63f1eff1a865 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:34.545163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea790cff-3ad6-4c24-af69-63f1eff1a865 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.041837 Aug 25 12:31:34.546232 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:34 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:34.562694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3813ae6-dbc8-41a4-8ecc-dedf52ff4069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-980959171"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.567573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-a3813ae6-dbc8-41a4-8ecc-dedf52ff4069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid f14301ab-2e63-43be-aeac-203dd680e13c for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:34.579282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e60e40d-2031-4292-872c-abf42ccf065c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-117835255"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.583719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-0e60e40d-2031-4292-872c-abf42ccf065c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 77e093ae-81ff-4495-a939-ac40362b15c0 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:34.624315 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3813ae6-dbc8-41a4-8ecc-dedf52ff4069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066913 Aug 25 12:31:34.625358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 125/242] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:34.647398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2af6b4ef-81c7-404c-8911-d20827fe5efe tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.666142 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e60e40d-2031-4292-872c-abf42ccf065c tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.094910 Aug 25 12:31:34.672736 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 118/243] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:34.677207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2af6b4ef-81c7-404c-8911-d20827fe5efe tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:34.678049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2af6b4ef-81c7-404c-8911-d20827fe5efe tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:34.678945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2af6b4ef-81c7-404c-8911-d20827fe5efe tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:34.689588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4047b268-216f-4e7e-a753-c0de17039fde tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:34.775311 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4047b268-216f-4e7e-a753-c0de17039fde tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.093156 Aug 25 12:31:34.775311 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 119/244] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 25 12:31:34.790651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4381d8e4-09cf-4a38-bf0f-233de204f679 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:34.809061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-4381d8e4-09cf-4a38-bf0f-233de204f679 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4381d8e4-09cf-4a38-bf0f-233de204f679 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Request method failure captured: Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjRQbb94094WY5lGUxbskYc7B4oluM7OMXc4hq0A6g5rwamdTjVoWxq2wOEy0hU8Dejgt-ttq4TGWsssoCPTftzliP_tDMnFyM6h-BcsDN0B_4V7ZZDdo5SFKcSaVTt1MaPquusJ17xZA967P0IrTYMqri1416AZB7CgE1OxP5EEY Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:34.813485 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 212c59c14e2c4098bc9e9e3ff3bc2c31 Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate 7 could not be found. Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7'} Aug 25 12:31:34.815958 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.820181 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.824417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4381d8e4-09cf-4a38-bf0f-233de204f679 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:34.831079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4381d8e4-09cf-4a38-bf0f-233de204f679 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.034333 Aug 25 12:31:34.831079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 120/245] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:31:34 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:31:34.832543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31e0a4a-e647-4658-b362-4b1b6ff34a6e tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:34.864294 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e31e0a4a-e647-4658-b362-4b1b6ff34a6e tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31e0a4a-e647-4658-b362-4b1b6ff34a6e tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Request method failure captured: Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjRQbb94094WY5lGUxbskYc7B4oluM7OMXc4hq0A6g5rwamdTjVoWxq2wOEy0hU8Dejgt-ttq4TGWsssoCPTftzliP_tDMnFyM6h-BcsDN0B_4V7ZZDdo5SFKcSaVTt1MaPquusJ17xZA967P0IrTYMqri1416AZB7CgE1OxP5EEY Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:34.867684 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 212c59c14e2c4098bc9e9e3ff3bc2c31 Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate 7 could not be found. Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7'} Aug 25 12:31:34.870512 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:34.872302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:34.885617 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31e0a4a-e647-4658-b362-4b1b6ff34a6e tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:34.890976 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e31e0a4a-e647-4658-b362-4b1b6ff34a6e tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.066021 Aug 25 12:31:34.901207 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 121/246] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:34.924629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e5fb738-fcaf-44cf-b3c6-508b39ea7535 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-960265681", "name": "tempest-test_aggregate-854338839"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:34.935502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-4e5fb738-fcaf-44cf-b3c6-508b39ea7535 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 34ee76d6-81fc-4c4d-9c98-8d3c870473af for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:35.001388 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2af6b4ef-81c7-404c-8911-d20827fe5efe tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.361600 Aug 25 12:31:35.003085 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 126/247] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:35.026277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:35.043022 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e5fb738-fcaf-44cf-b3c6-508b39ea7535 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.131535 Aug 25 12:31:35.054319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 122/248] 10.222.0.60 () {60 vars in 1165 bytes} [Thu Aug 25 12:31:34 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:35.064995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.067049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:35.079508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.081011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.082629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.084462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.086310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.086661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.087632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.088317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.089267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.168743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-850468-18. Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 40 Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:31:35.192690 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: {"add_host": {"host": "n-h2-850468-18"}} Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:35.194169 n-d-850468-18 devstack@n-api.service[122701]: exception: Aggregate 6 already has host n-h2-850468-18. Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-850468-18'}}} Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:31:35.194901 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-850468-18-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:31:35.195902 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:31:35.196935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:31:35.197964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-850468-18-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 31, 35, 147032), 'updated_at': None, 'host': 'n-h2-850468-18', 'aggregate_id': 6}] Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.198868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-850468-18. Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.199735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-850468-18. Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:35.200962 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:35.202021 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-850468-18. Aug 25 12:31:35.202021 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.203084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-850468-18. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:35.208754 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2c01cd2-8800-42b4-8fb4-9e111d087456 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 96 microversion: 2.1 time: 0.191164 Aug 25 12:31:35.216563 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 127/249] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:35 2022] POST /compute/v2.1/os-aggregates/6/action => generated 96 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Aug 25 12:31:35.225799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-91c422c0-cdef-4988-aaa0-144942a7317d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.306171 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-91c422c0-cdef-4988-aaa0-144942a7317d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.087214 Aug 25 12:31:35.308183 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 128/250] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:35 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:35.321235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-590946d5-aa4c-4b5b-b7bd-f8983c459e31 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:35.344284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590946d5-aa4c-4b5b-b7bd-f8983c459e31 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.345595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590946d5-aa4c-4b5b-b7bd-f8983c459e31 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.346767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590946d5-aa4c-4b5b-b7bd-f8983c459e31 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.701095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:35.717084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f842be08-f673-4f40-a9e8-92c78d1fe780 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.671528 Aug 25 12:31:35.720061 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 123/251] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:35 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:35.726848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-590946d5-aa4c-4b5b-b7bd-f8983c459e31 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.406446 Aug 25 12:31:35.728749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21db5443-b64a-4d43-91fb-feec41fcb2cd tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.729469 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 129/252] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:35 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:35.747452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-21db5443-b64a-4d43-91fb-feec41fcb2cd tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21db5443-b64a-4d43-91fb-feec41fcb2cd tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Request method failure captured: Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjRQbb94094WY5lGUxbskYc7B4oluM7OMXc4hq0A6g5rwamdTjVoWxq2wOEy0hU8Dejgt-ttq4TGWsssoCPTftzliP_tDMnFyM6h-BcsDN0B_4V7ZZDdo5SFKcSaVTt1MaPquusJ17xZA967P0IrTYMqri1416AZB7CgE1OxP5EEY Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:35.749107 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 212c59c14e2c4098bc9e9e3ff3bc2c31 Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate 8 could not be found. Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8'} Aug 25 12:31:35.750304 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.751076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 25 12:31:35.752376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.753543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21db5443-b64a-4d43-91fb-feec41fcb2cd tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:35.756679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.758184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:35.762388 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21db5443-b64a-4d43-91fb-feec41fcb2cd tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.035707 Aug 25 12:31:35.768523 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 124/253] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:31:35 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:35.773224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.775141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.775876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d323048-4f8d-4cf5-adc0-770b0174eefb tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.776854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.778751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.781172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.784824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.806132 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d323048-4f8d-4cf5-adc0-770b0174eefb tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.036339 Aug 25 12:31:35.807470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 125/254] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:35 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:35.814082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75e747e3-542f-4523-a74d-9cb51f58390d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.829022 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-75e747e3-542f-4523-a74d-9cb51f58390d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75e747e3-542f-4523-a74d-9cb51f58390d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Request method failure captured: Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjRQbb94094WY5lGUxbskYc7B4oluM7OMXc4hq0A6g5rwamdTjVoWxq2wOEy0hU8Dejgt-ttq4TGWsssoCPTftzliP_tDMnFyM6h-BcsDN0B_4V7ZZDdo5SFKcSaVTt1MaPquusJ17xZA967P0IrTYMqri1416AZB7CgE1OxP5EEY Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:35.834123 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/87d5f7dd383c494c862d0650fe1ebe98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 87d5f7dd383c494c862d0650fe1ebe98 Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174247452 Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 212c59c14e2c4098bc9e9e3ff3bc2c31 Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-174247452-project-admin Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate 8 could not be found. Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8'} Aug 25 12:31:35.838997 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:35.842259 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:35.846068 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75e747e3-542f-4523-a74d-9cb51f58390d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-75e747e3-542f-4523-a74d-9cb51f58390d tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.027141 Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 126/255] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:35 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:35.853382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41c5cbd3-e1ac-4a0e-be2f-d293f792cb53 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-332351729"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:35.861119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-41c5cbd3-e1ac-4a0e-be2f-d293f792cb53 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid 8d4d1813-de5c-4a3a-a83e-f76e3af4b136 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:35.901273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41c5cbd3-e1ac-4a0e-be2f-d293f792cb53 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060941 Aug 25 12:31:35.902133 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 127/256] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:35.913465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a33e926-155e-43fc-b7b5-7d8d793abbb8 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1458856701"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:35.920558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-3a33e926-155e-43fc-b7b5-7d8d793abbb8 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 2b07d80e-cee0-4772-afd8-91f92a5fe2f7 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:35.965966 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a33e926-155e-43fc-b7b5-7d8d793abbb8 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061781 Aug 25 12:31:35.967415 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 128/257] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:35.979427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c3484670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:35.985587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.986175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.986696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:35.987824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:35.990138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:35.990853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.026951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e946f3dc-49db-4f5d-baec-a2691eb82ee1 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.057840 Aug 25 12:31:36.028350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 129/258] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:31:35 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.079699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:36.090176 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fb625ce-ecf8-4427-b9fb-9a1143f38cb1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.358919 Aug 25 12:31:36.091182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 130/259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:35 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:36.096377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbb62e14-313a-4ec2-8e5a-c3dc0ac22949 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.106754 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbb62e14-313a-4ec2-8e5a-c3dc0ac22949 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.014243 Aug 25 12:31:36.107451 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 131/260] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.114213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c36d9dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.121007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.121875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.122672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.123709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.124808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.125602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.163451 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1afbdeef-bedb-4ca9-9109-740eba03fb77 tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.054595 Aug 25 12:31:36.164816 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 132/261] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.181014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec3550c2-e51b-4acf-8d45-6c26cbb0e8d5 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.221375 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec3550c2-e51b-4acf-8d45-6c26cbb0e8d5 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.055140 Aug 25 12:31:36.224340 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 133/262] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.231001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c31d89d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.237922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.239887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.240709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.241751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.242619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.243673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.287002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39636105-3b72-4f6d-8b4b-83e53e1afbea tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.058967 Aug 25 12:31:36.288391 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 134/263] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.293910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42501b49-1fb8-41a7-80c7-c2a0444ba3ae tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.303657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42501b49-1fb8-41a7-80c7-c2a0444ba3ae tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.013926 Aug 25 12:31:36.305171 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 135/264] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.311265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c31d8430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.321862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.322489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.323336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.339382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.340069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.340748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.364312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ba65a6d-aaed-46ac-992c-2e241f60172d tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h2-850468-18" status: 200 len: 335 microversion: 2.1 time: 0.057315 Aug 25 12:31:36.365443 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 136/265] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-hosts/n-h2-850468-18 => generated 335 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.370597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca7d3e02-0320-4c40-8f92-45864eb99fd9 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.375966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:36.402517 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca7d3e02-0320-4c40-8f92-45864eb99fd9 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.035493 Aug 25 12:31:36.403375 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 137/266] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:36 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:36.413188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Calling method '.version_select at 0x7fc6c435fca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.422787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.423600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.424288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.445799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.446677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.447384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.481818 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42014613-8c94-4949-a05e-be57a134ed1e tempest-HostsAdminTestJSON-448097035 tempest-HostsAdminTestJSON-448097035-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-h1-850468-18" status: 200 len: 603 microversion: 2.1 time: 0.076945 Aug 25 12:31:36.483149 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 138/267] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-hosts/n-h1-850468-18 => generated 603 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.490025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b655949f-7c2d-4f47-b717-b85da8091fe4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1805991877", "availability_zone": "tempest-test_az-931971829"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.505321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d4f80a2-703b-47e0-b76d-feed7a60da6f tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.519156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d4f80a2-703b-47e0-b76d-feed7a60da6f tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:36.520048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-b655949f-7c2d-4f47-b717-b85da8091fe4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 957bf62c-4452-4a36-a337-43ab19185491 for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d4f80a2-703b-47e0-b76d-feed7a60da6f tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 40 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:36.524050 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: {"add_host": {"host": "n-h2-850468-18"}} Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:36.526286 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-850468-18'}}} Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:36.527269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 25 12:31:36.528839 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.532223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d4f80a2-703b-47e0-b76d-feed7a60da6f tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:36.538812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d4f80a2-703b-47e0-b76d-feed7a60da6f tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.506261 Aug 25 12:31:36.542219 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 130/268] 10.222.0.60 () {60 vars in 1191 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 513 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:36.562291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d672cf92-a6c6-418f-9268-83968a6b4e91 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.580071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b655949f-7c2d-4f47-b717-b85da8091fe4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.095713 Aug 25 12:31:36.588267 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 139/269] 10.222.0.60 () {60 vars in 1165 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.609388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3efb70b-dac3-481c-a3c4-5a668dc0f764 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1805991877_new", "availability_zone": "tempest-test_az-931971829_new"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.629374 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d672cf92-a6c6-418f-9268-83968a6b4e91 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.079560 Aug 25 12:31:36.630070 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 131/270] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:36 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:36.645360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be0bc6e4-bd5c-41a1-9bb1-d736dfe6ebff tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-724430947"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.657697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-be0bc6e4-bd5c-41a1-9bb1-d736dfe6ebff tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid cf45263a-c55d-450b-a1be-8692ee1756aa for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:36.709061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be0bc6e4-bd5c-41a1-9bb1-d736dfe6ebff tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070578 Aug 25 12:31:36.716432 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 132/271] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.722213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2012223535"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.773592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.774435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.780648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.787626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3efb70b-dac3-481c-a3c4-5a668dc0f764 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.792572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3efb70b-dac3-481c-a3c4-5a668dc0f764 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.793452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3efb70b-dac3-481c-a3c4-5a668dc0f764 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.813109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.814906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.816029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.832154 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2012223535 could not be found. Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 58 Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:36.838042 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: {"add_host": {"host": "tempest-nonexist_host-2012223535"}} Aug 25 12:31:36.839260 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: exception: Compute host tempest-nonexist_host-2012223535 could not be found. Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-2012223535'}}} Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2012223535' is not mapped to any cell Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.839948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 25 12:31:36.841066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2012223535 could not be found. Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2012223535 could not be found. Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.842150 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2012223535 could not be found. Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2012223535 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:36.843385 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6cfe9ca5-272f-4e25-9812-8d32fa24fd46 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.122300 Aug 25 12:31:36.843890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 133/272] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:36.853694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.855994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3efb70b-dac3-481c-a3c4-5a668dc0f764 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 335 microversion: 2.1 time: 0.253553 Aug 25 12:31:36.858077 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 140/273] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 12:31:36 2022] PUT /compute/v2.1/os-aggregates/11 => generated 335 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.859864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:36.865164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b8c402c-02a8-4e3b-b026-9ef2f919601b tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.879622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.880551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.881327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.882855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:36.884092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:36.885454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:36.919620 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b8c402c-02a8-4e3b-b026-9ef2f919601b tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057923 Aug 25 12:31:36.921157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 141/274] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:36 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:36.937860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c4130a-ca15-43be-9ae3-d86cbeaa9dab tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:36.954530 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0c4130a-ca15-43be-9ae3-d86cbeaa9dab tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.031634 Aug 25 12:31:36.955282 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 142/275] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:36.962683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61c3b4b4-a429-4aa5-a60b-4c2b96ecec73 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61c3b4b4-a429-4aa5-a60b-4c2b96ecec73 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 283 Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:31:36.970723 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:36.972268 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:31:36.973628 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:36.974488 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:36.975582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:36.976853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:31:36.976853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:31:36.976853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:31:36.976853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:36.976853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61c3b4b4-a429-4aa5-a60b-4c2b96ecec73 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:36.977262 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61c3b4b4-a429-4aa5-a60b-4c2b96ecec73 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017514 Aug 25 12:31:36.983572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 143/276] 10.222.0.60 () {60 vars in 1165 bytes} [Thu Aug 25 12:31:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:31:36.993539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e705fbd-f41c-48ed-a5e8-61486c4690b1 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.043182 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e705fbd-f41c-48ed-a5e8-61486c4690b1 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.057357 Aug 25 12:31:37.045803 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 144/277] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:36 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:37.066040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b79d683-2cb6-4eb6-ae1c-739dc00ade34 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b79d683-2cb6-4eb6-ae1c-739dc00ade34 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 27 Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:31:37.072788 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: {"aggregate": {"name": ""}} Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:37.074386 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '' Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.075164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:31:37.076368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.080827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b79d683-2cb6-4eb6-ae1c-739dc00ade34 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.080827 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b79d683-2cb6-4eb6-ae1c-739dc00ade34 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.027314 Aug 25 12:31:37.084680 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 145/278] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:31:37.092667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13125244-ff38-4d69-a8fb-2384a7d02bc4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1966228146"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.099726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-13125244-ff38-4d69-a8fb-2384a7d02bc4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Generated uuid 73bbf649-6849-4341-af3e-086ab4718879 for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:37.172319 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13125244-ff38-4d69-a8fb-2384a7d02bc4 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084891 Aug 25 12:31:37.175311 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 146/279] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:37.191954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b09dc79-5d55-4661-bd27-192e8dae201d tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1107718902"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.201192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b09dc79-5d55-4661-bd27-192e8dae201d tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b09dc79-5d55-4661-bd27-192e8dae201d tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 60 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:37.203062 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: {"aggregate": {"name": "tempest-test_aggregate-1107718902"}} Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:37.204315 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1107718902'}}} Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:37.205123 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:37.206275 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 25 12:31:37.208070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.209082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b09dc79-5d55-4661-bd27-192e8dae201d tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.212544 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b09dc79-5d55-4661-bd27-192e8dae201d tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.035141 Aug 25 12:31:37.213643 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 147/280] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:37.220740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.221709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:37.234722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.236913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.237695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.238987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.240059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.241493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.292738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:37.311083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-49b6defa-38eb-4f28-a58e-a283a85e38dc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1386 microversion: 2.1 time: 0.465708 Aug 25 12:31:37.311676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 134/281] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:36 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1386 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:37.317719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02c4bc73-0d85-432d-a0f7-8fa36b6a6065 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.327520 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02c4bc73-0d85-432d-a0f7-8fa36b6a6065 tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014321 Aug 25 12:31:37.328928 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 135/282] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:31:37 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:37.337364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6648ce5-e9ee-4803-800a-59fa14339059 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-9347463"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.343832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-a6648ce5-e9ee-4803-800a-59fa14339059 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid d9070944-bb4d-466b-aa02-30007b71c9e4 for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:37.372291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6648ce5-e9ee-4803-800a-59fa14339059 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.041773 Aug 25 12:31:37.373722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 136/283] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:37.380000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce93e886-55fc-4e7b-a57a-d706792b36eb tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.434439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce93e886-55fc-4e7b-a57a-d706792b36eb tempest-AggregatesAdminTestJSON-174247452 tempest-AggregatesAdminTestJSON-174247452-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059083 Aug 25 12:31:37.437547 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 137/284] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:37.447411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-9347463"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.451104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid 65c90ef7-7394-43bf-ae31-17cb25eb7cfc for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:37.474391 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-9347463 already exists. Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 57 Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:37.476901 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: {"aggregate": {"name": "tempest-test_aggregate-9347463"}} Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:37.478562 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate tempest-test_aggregate-9347463 already exists. Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-9347463'}}} Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 25 12:31:37.479296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-9347463 already exists. Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:37.480610 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-9347463 already exists. Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-9347463 already exists. Aug 25 12:31:37.481683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.483878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-9347463 already exists. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.485115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-072e4195-c1ea-402c-9d1c-21e55d40e663 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 409 len: 108 microversion: 2.1 time: 0.046109 Aug 25 12:31:37.485868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 138/285] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:37.494981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.495965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:37.588321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:37.603054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e55ac06-ee80-4e1e-9dd6-09249c066d9b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.388098 Aug 25 12:31:37.617459 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 148/286] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:37 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:37.627296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-817cf1e6-b320-469f-a1d3-7875b90493b4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.671537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-817cf1e6-b320-469f-a1d3-7875b90493b4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.051877 Aug 25 12:31:37.673086 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 149/287] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:37.681277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.682184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.682974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.684488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.685019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d751f10e-56ae-4280-bb26-cba4f5d2320a tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-588106787"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.685355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.686128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.694801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-d751f10e-56ae-4280-bb26-cba4f5d2320a tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid 596fef83-f750-4bf2-b55d-984ba301b3fb for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:37.715318 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] HTTP exception thrown: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Request method failure captured: Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d HTTP/1.1 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tfhLtxzIXAVYwrNCWwtmRWII9uI0Yg7Cif0An_lzdBEDnSL4vHL3kY9Yn-vGMmDML26pUFJj8POSNkuWbxvHuiDrVujsdErzfnI6HMNNqZyp_6SHI15cilG9uQPSy3KC69xY7AKxUGTZfvLYPQEie25uQy44DBzBrcq42Rs94X39w Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:37.718796 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7594f93920ab41868c9208c4798992a1 Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.721349 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bb4ef0fe-bbad-4eec-99a4-8321beab7c5d'} Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.722730 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.725384 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.727573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Returning 404 to user: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.727573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5bfe18a8-ff1a-423a-aa82-7222b8a6e9d2 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 404 len: 111 microversion: 2.1 time: 0.233689 Aug 25 12:31:37.727573 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 139/288] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:37.743843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.744811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] [instance: bb4ef0fe-bbad-4eec-99a4-8321beab7c5d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:37.752858 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d751f10e-56ae-4280-bb26-cba4f5d2320a tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073756 Aug 25 12:31:37.756741 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 150/289] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:37.760281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.761081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.761712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.762643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:37.763447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:37.764099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:37.771075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8c42212-c4a5-4c4d-ad60-21702562c484 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.773120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a8c42212-c4a5-4c4d-ad60-21702562c484 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8c42212-c4a5-4c4d-ad60-21702562c484 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:37.776884 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:31:37.778966 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '15'} Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:37.781041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.784621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8c42212-c4a5-4c4d-ad60-21702562c484 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.789865 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8c42212-c4a5-4c4d-ad60-21702562c484 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.013962 Aug 25 12:31:37.789865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 151/290] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] HTTP exception thrown: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Request method failure captured: Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d HTTP/1.1 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tfhLtxzIXAVYwrNCWwtmRWII9uI0Yg7Cif0An_lzdBEDnSL4vHL3kY9Yn-vGMmDML26pUFJj8POSNkuWbxvHuiDrVujsdErzfnI6HMNNqZyp_6SHI15cilG9uQPSy3KC69xY7AKxUGTZfvLYPQEie25uQy44DBzBrcq42Rs94X39w Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:37.790470 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/42f38f00baa246399078fb86aca9c2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 42f38f00baa246399078fb86aca9c2c8 Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-650559083 Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7594f93920ab41868c9208c4798992a1 Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminTestJSON-650559083-project Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.797733 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bb4ef0fe-bbad-4eec-99a4-8321beab7c5d'} Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.799201 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. Aug 25 12:31:37.802804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.806102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] Returning 404 to user: Instance bb4ef0fe-bbad-4eec-99a4-8321beab7c5d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.806102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3cdb4b3-e787-46ca-803f-1f711a2a5584 tempest-AggregatesAdminTestJSON-650559083 tempest-AggregatesAdminTestJSON-650559083-project] 10.222.0.60 "GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d" status: 404 len: 111 microversion: 2.1 time: 0.051557 Aug 25 12:31:37.806102 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 140/291] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:37 2022] GET /compute/v2.1/servers/bb4ef0fe-bbad-4eec-99a4-8321beab7c5d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:37.806531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b29a46e-a65c-4bfc-af0e-cea65cbf47e1 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.850682 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b29a46e-a65c-4bfc-af0e-cea65cbf47e1 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.062512 Aug 25 12:31:37.851736 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 152/292] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:37.868072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca4e188e-ad76-4e58-8b39-173f2279157c tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:37.897853 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ca4e188e-ad76-4e58-8b39-173f2279157c tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca4e188e-ad76-4e58-8b39-173f2279157c tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:37.902249 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate -1 could not be found. Aug 25 12:31:37.904742 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '-1'} Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:37.906033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.908607 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca4e188e-ad76-4e58-8b39-173f2279157c tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:37.913987 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca4e188e-ad76-4e58-8b39-173f2279157c tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045077 Aug 25 12:31:37.916788 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 141/293] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:37 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:37.922282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2efce9ff-a162-4c2f-b75b-8e8abe40cf59 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-468641675"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:37.929213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.aggregate [None req-2efce9ff-a162-4c2f-b75b-8e8abe40cf59 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid 1e8b4d6e-24e9-4f0c-8157-cbe125755bd9 for aggregate {{(pid=122701) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:37.988815 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2efce9ff-a162-4c2f-b75b-8e8abe40cf59 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071876 Aug 25 12:31:37.998166 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 153/294] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:38.011727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ba85ad-6087-41ca-aca3-3215213bf917 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.015753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c1ba85ad-6087-41ca-aca3-3215213bf917 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ba85ad-6087-41ca-aca3-3215213bf917 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:31:38.020108 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:31:38.022549 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '16'} Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:38.023799 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.027565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ba85ad-6087-41ca-aca3-3215213bf917 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:38.030668 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1ba85ad-6087-41ca-aca3-3215213bf917 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.017610 Aug 25 12:31:38.030668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 142/295] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:38 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:38.038921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32651056-68c5-4355-8e30-7b13e5db68c3 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.101480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32651056-68c5-4355-8e30-7b13e5db68c3 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.069839 Aug 25 12:31:38.107887 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 154/296] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:38 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:38.125327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da5ee3e2-f1ab-4936-8a9e-350f45b1a0e0 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.148841 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-da5ee3e2-f1ab-4936-8a9e-350f45b1a0e0 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da5ee3e2-f1ab-4936-8a9e-350f45b1a0e0 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:38.152468 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: exception: Aggregate -1 could not be found. Aug 25 12:31:38.154848 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '-1'} Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.156167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 25 12:31:38.158286 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.165501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da5ee3e2-f1ab-4936-8a9e-350f45b1a0e0 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:38.167524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da5ee3e2-f1ab-4936-8a9e-350f45b1a0e0 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049668 Aug 25 12:31:38.169410 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 143/297] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:31:38 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:38.193796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6dcffaf7-1b7e-4f68-aacb-44fefd3fe386 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.202796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6dcffaf7-1b7e-4f68-aacb-44fefd3fe386 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6dcffaf7-1b7e-4f68-aacb-44fefd3fe386 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:38.209935 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:31:38.211980 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:38.213397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:38.216889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6dcffaf7-1b7e-4f68-aacb-44fefd3fe386 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:38.225519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6dcffaf7-1b7e-4f68-aacb-44fefd3fe386 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.036040 Aug 25 12:31:38.225519 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 155/298] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:31:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:31:38.250677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d665c49-d65a-4f59-aae4-2dd6891b4f2b tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1907540814"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:38.264378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-7d665c49-d65a-4f59-aae4-2dd6891b4f2b tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid e1c5b783-fc7b-4590-a1a8-dbbc72db616c for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:38.318299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:38.352418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.358328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:38.359422 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d665c49-d65a-4f59-aae4-2dd6891b4f2b tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.120618 Aug 25 12:31:38.372390 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 144/299] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:38.393230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1b517da-1b62-45ca-ae0f-1f2dc26d1134 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:38.404773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:38.406935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:38.413885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:38.417797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:38.420696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b517da-1b62-45ca-ae0f-1f2dc26d1134 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:38.422068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b517da-1b62-45ca-ae0f-1f2dc26d1134 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:38.423185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b517da-1b62-45ca-ae0f-1f2dc26d1134 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:38.424549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:38.425426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:38.767613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1b517da-1b62-45ca-ae0f-1f2dc26d1134 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.386111 Aug 25 12:31:38.768405 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 145/300] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:38.774421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:38.775121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:38.793526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:38.794024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:38.794462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:38.795185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:38.795736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:38.796238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:39.015905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:39.034077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81c53921-f691-4baa-a99d-2a48f5d635cb tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1585 microversion: 2.1 time: 0.690226 Aug 25 12:31:39.035675 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 156/301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:38 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1585 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:39.056063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-912fbc0b-6159-4bd4-9d47-a776a4adca20 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:39.082475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-912fbc0b-6159-4bd4-9d47-a776a4adca20 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6349955b0d15463aa71e5d3c3a2b5fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc1d7bd2ac74867822cbdaeaa783a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-912fbc0b-6159-4bd4-9d47-a776a4adca20 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Request method failure captured: Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 43 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tfnegQRqnyJIbj1EcCuy-xCCU4xzJedBo-2nOBXHLnszjSeLiGnhOrBKZs_tVOGaXnXg1QRx8YUW2m55GWRZ3d8L8QnIsOvqR5LDiQAhJbwaGdsPYozQfWTWjVk6eLFgDqf7jqiVwC_1qvalDx6uTZdV73R5zNQ1wiMJ9B8Muah80 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:31:39.092968 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fbc1d7bd2ac74867822cbdaeaa783a10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fbc1d7bd2ac74867822cbdaeaa783a10 Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-305656728 Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6349955b0d15463aa71e5d3c3a2b5fdf Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-305656728-project Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: {"remove_host": {"host": "n-h2-850468-18"}} Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:31:39.094128 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-850468-18'}}} Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:39.094846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 25 12:31:39.095820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:31:39.100167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-912fbc0b-6159-4bd4-9d47-a776a4adca20 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:39.110373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-912fbc0b-6159-4bd4-9d47-a776a4adca20 tempest-AggregatesAdminNegativeTestJSON-305656728 tempest-AggregatesAdminNegativeTestJSON-305656728-project] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.068694 Aug 25 12:31:39.117227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 157/302] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:31:39.311205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:39.331129 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19ac42f8-e1ab-413d-93f2-4986d3aafd2b tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.561332 Aug 25 12:31:39.333871 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 146/303] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:38 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:39.342490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:39.343452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:39.356089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:39.356993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:39.357758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:39.359038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:39.359887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:39.360665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:39.677227 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40f1e45a-6905-4bfc-a0be-a3ebcbefb14e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.341197 Aug 25 12:31:39.690106 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 147/304] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:31:39 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:39.699305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20cd717b-7e80-46e1-9348-1d50f693c6c4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:39.718097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd717b-7e80-46e1-9348-1d50f693c6c4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:39.718961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd717b-7e80-46e1-9348-1d50f693c6c4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:39.719739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd717b-7e80-46e1-9348-1d50f693c6c4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:39.953396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20cd717b-7e80-46e1-9348-1d50f693c6c4 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.260167 Aug 25 12:31:39.956226 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 148/305] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:39.969682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c36ca9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:39.979895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-611f653c-ce55-4519-9130-25dd426f21cf tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:40.031969 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-611f653c-ce55-4519-9130-25dd426f21cf tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.065412 Aug 25 12:31:40.033472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 149/306] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:39 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:31:40.055229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14f683ba-c772-416b-80e2-a28c9ba155c7 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1518265435"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:40.062741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-14f683ba-c772-416b-80e2-a28c9ba155c7 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Generated uuid aa6d4073-bb9c-4199-a843-ca452953c28d for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 12:31:40.108870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14f683ba-c772-416b-80e2-a28c9ba155c7 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065795 Aug 25 12:31:40.111821 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 150/307] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 12:31:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:40.129734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:40.162563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:40.163785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:40.164797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:40.189648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:40.190653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:40.192026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:40.208414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.compute.aggregates [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 25 12:31:40.209084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Request method failure captured: Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 42 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tjMX0_NZwz-cwuNBWsVb7lfzBEEDYAGEQumG9cfGBwJRRroDhxcIFYhFHF28fbzBLAwKusd2UyctejFfM4hcc0AusibQ1V7gzJ3SQnnQfeQ1tUiMJhzLQfE1UoNEZIuVJFA0S2WsxyiANDAkb1_s6VcRGbhy3T0ucGgFX6BTk08wA Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:40.211521 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d986a0c6f7cc40acad40223987bb48fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d986a0c6f7cc40acad40223987bb48fb Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859 Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d2ad79911aff4aa2ab11200492d263c1 Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: {"remove_host": {"host": "nonexist_host"}} Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:40.213793 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 25 12:31:40.214921 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 25 12:31:40.217052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.223632 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-65c52271-5b42-4540-a2fb-4434544ca069 tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.095731 Aug 25 12:31:40.226600 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 151/308] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 12:31:40 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:31:40.241943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4eba5167-ecfc-47b4-9c62-95b0eb1dfc5d tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:40.313000 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4eba5167-ecfc-47b4-9c62-95b0eb1dfc5d tempest-AggregatesAdminNegativeTestJSON-2120413859 tempest-AggregatesAdminNegativeTestJSON-2120413859-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.082487 Aug 25 12:31:40.322502 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 152/309] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:31:40 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 25 12:31:40.381402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:40.382553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:40.421295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:40.423093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:40.424337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:40.428205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:40.430399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:40.432787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:40.755973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:40.767425 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-160b3114-5ddf-41c3-871e-0c24e72ab6fb tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.394157 Aug 25 12:31:40.780969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:40 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:40.780969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4431d2d-434e-4d0b-95ba-39f93aac3b19", "name": "network-vif-plugged", "status": "completed", "tag": "7bb811dd-3f64-44f2-804e-ffadbb99711c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:40.788554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:40.789373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:40.790115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:40.808035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] Creating event network-vif-plugged:7bb811dd-3f64-44f2-804e-ffadbb99711c for instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 on n-h1-850468-18 Aug 25 12:31:40.818714 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d9539f3a-457d-476c-b62c-5b0bdf072f59 req-80114529-6c51-4a8d-bdb0-e8cedf64624b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046916 Aug 25 12:31:40.820300 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 154/311] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:41.525641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:41.527141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:41.529692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:41.533107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:41.535699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:41.540092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:41.684868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-011d95e1-824a-4d09-945e-839017176288 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15" status: 200 len: 148 microversion: 2.57 time: 2.565727 Aug 25 12:31:41.696203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 158/312] 10.222.0.60 () {62 vars in 1303 bytes} [Thu Aug 25 12:31:39 2022] PUT /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15 => generated 148 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:41.709587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Calling method '.version_select at 0x7fc6c32e5160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:41.801496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:41.807346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:41.837110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:41.840603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:41.843133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:41.847047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:41.850725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:41.853611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:42.282894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:42.302960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b08af538-adee-411d-a344-5d12c028982c tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1319 microversion: 2.1 time: 0.511360 Aug 25 12:31:42.325587 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 159/313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:41 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:42.504579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:42.505476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:42.512636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:42.513132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:42.518789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:42.520786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:42.521286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:42.521734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:42.959388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:42.975441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:42.981194 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf1c967f-b665-4714-b37b-fdbd9b449171 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 200 len: 1585 microversion: 2.1 time: 0.482321 Aug 25 12:31:42.996303 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 160/314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:42 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 1585 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:43.017248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef194ae5-b778-4be7-9180-c09d1588cf69", "tag": "fafb5042-8900-45e3-bdb2-3b5527a0a97c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:43.043007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:43.044766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:43.046109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:43.064589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:43.065384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:43.066204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:43.067618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:43.075672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:43.080338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:43.081299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] Creating event network-changed:fafb5042-8900-45e3-bdb2-3b5527a0a97c for instance ef194ae5-b778-4be7-9180-c09d1588cf69 on n-h1-850468-18 Aug 25 12:31:43.095648 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7d209e3e-c2e6-4b75-acda-710cf742c7cd req-b463ae9d-f5b7-450b-8987-d3663dc9a87a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098913 Aug 25 12:31:43.099471 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 161/315] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:43.175057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5ea755c8-0075-439b-8c52-cc2c6fc69018 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15/detail" status: 200 len: 463 microversion: 2.57 time: 1.453170 Aug 25 12:31:43.178988 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 155/316] 10.222.0.60 () {60 vars in 1304 bytes} [Thu Aug 25 12:31:41 2022] GET /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15/detail => generated 463 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:43.349666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:43.351133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:43.372888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:43.375859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:43.381593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:43.383577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:43.384628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:43.385444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:43.912428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:43.946819 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a62e7468-55c5-44ff-92ea-29177c3765f3 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1469 microversion: 2.1 time: 0.602318 Aug 25 12:31:43.951714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 162/317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:43 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:44.679264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-778447246", "block_migration": true, "disk_over_commit": false}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:44.688589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:44.704965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:44.706320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:44.709148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:44.711005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:44.712337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:44.713662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.408228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Calling method '.version_select at 0x7fc6c31d8940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:45.445109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:45.447464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:45.452168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.479927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:45.481294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:45.482326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.499888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:45.500520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:45.501253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.511762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:45.520235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:45.521300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:45.522002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.553141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:45.553832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:45.554349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:45.563460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f5e7f0d-4a76-42b6-8c94-d264d3e7652b tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1747 microversion: 2.53 time: 1.219758 Aug 25 12:31:45.576383 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 163/318] 10.222.0.60 () {60 vars in 1243 bytes} [Thu Aug 25 12:31:44 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1747 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:45.583219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c319c8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:46.114634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lazy-loading 'flavor' on Instance uuid c4431d2d-434e-4d0b-95ba-39f93aac3b19 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:31:46.185246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Going to try to live migrate instance to tempest-host-778447246 {{(pid=122700) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:31:46.201487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] HTTP exception thrown: Compute host tempest-host-778447246 could not be found. Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Request method failure captured: Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19/action HTTP/1.1 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 106 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2uQeIA-PW28lz_gDJ2yaPYClZcpYwjRPv5XcOTWF6YYkyIOJXT8OBNoO6GDAicQlMiZdsBxXpcPGfcArtrBJd7P-DbfU1gnYYFyqKhfFuzPvq7nGd2KN046vYm69w4e4nIQFaW9DslJWx2sL8uujWW-Gm2sqbG8K5DTmjJtNZjwqx0 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5ac9d7444e0a441d857d7e7782971899 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:31:46.209591 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5ac9d7444e0a441d857d7e7782971899 Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveMigrationNegativeTest-1918459173-project-admin Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 750c3d6d9e144724b40dc4a6d18830d6 Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveMigrationNegativeTest-1918459173-project-admin Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: {"os-migrateLive": {"host": "tempest-host-778447246", "block_migration": true, "disk_over_commit": false}} Aug 25 12:31:46.212338 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: exception: Compute host tempest-host-778447246 could not be found. Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'c4431d2d-434e-4d0b-95ba-39f93aac3b19', 'body': {'os-migrateLive': {'host': 'tempest-host-778447246', 'block_migration': True, 'disk_over_commit': False}}} Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:31:46.213876 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-778447246 could not be found. Aug 25 12:31:46.215933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-778447246 could not be found. Aug 25 12:31:46.218749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-778447246 could not be found. Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Returning 400 to user: Compute host tempest-host-778447246 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-623ec1c2-39bd-46b4-94f9-27cf8ca651b9 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19/action" status: 400 len: 99 microversion: 2.1 time: 2.243731 Aug 25 12:31:46.221914 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 156/319] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Aug 25 12:31:43 2022] POST /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19/action => generated 99 bytes in 2246 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:31:46.227119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Calling method '.version_select at 0x7fc6c32e5b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:46.234917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.235807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.236647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.272286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.273143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.273975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.278058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:46.326368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.327210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.328072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.350730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.352096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.352352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.398637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.399834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.400842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.402150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.403053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.403648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.404086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.404855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.405096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.422833 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e54ff864-6e03-443f-b61d-1e9843d89cbe tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 438 microversion: 2.53 time: 0.205433 Aug 25 12:31:46.424538 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 157/320] 10.222.0.60 () {60 vars in 1222 bytes} [Thu Aug 25 12:31:46 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 438 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:46.435462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:46.437388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:46.452979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.454441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.455978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.458901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.460392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.461231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.491176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.492723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.493278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.494810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.495623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.496646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.687076 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe1093f7-ef92-4bcd-93d5-b309da0a1a6d tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15?user_id=0485a9e3a3804fe5adf364452f031488" status: 200 len: 148 microversion: 2.57 time: 1.108801 Aug 25 12:31:46.690548 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 164/321] 10.222.0.60 () {62 vars in 1384 bytes} [Thu Aug 25 12:31:45 2022] PUT /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15?user_id=0485a9e3a3804fe5adf364452f031488 => generated 148 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:46.776010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:46.785776 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8649c9f9-6925-4fe0-a509-85b553bffc80 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1469 microversion: 2.1 time: 0.358539 Aug 25 12:31:46.786368 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 158/322] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:46 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1469 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:46.815751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Calling method '.version_select at 0x7fc6c38d23a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:46.821215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.821670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.822009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.841483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:46.842220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:46.842812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:46.851304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cb71f67-0dd7-4b46-97a9-47ac0ef1170c tempest-HypervisorAdminV253TestBase-1417139583 tempest-HypervisorAdminV253TestBase-1417139583-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/7418052c-ed54-4cba-9f8e-34cddce44791" status: 200 len: 793 microversion: 2.53 time: 0.049207 Aug 25 12:31:46.852462 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 159/323] 10.222.0.60 () {60 vars in 1298 bytes} [Thu Aug 25 12:31:46 2022] GET /compute/v2.1/os-hypervisors/7418052c-ed54-4cba-9f8e-34cddce44791 => generated 793 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:46.858154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8f03ec7-f2d7-4faf-862c-f9da1cfe0ca6 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] Calling method '.version_select at 0x7fc6c3429430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:47.170276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1630140957", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:47.278413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:31:47.278840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:31:47.279526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:31:47.279912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:31:47.280351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:31:47.292066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:47.292581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:47.293013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:47.293750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:47.294269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:47.294689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:47.318125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Getting quotas for project 9862f5435ef44ec797690ed4455bc86f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:31:47.323076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Getting quotas for user 50683305d95349b39b2453da68daed22 and project 9862f5435ef44ec797690ed4455bc86f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:31:47.345977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:31:47.349725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:31:47.430951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bfee3502-ee52-431e-b6f7-ed9c11bd64ce tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.736628 Aug 25 12:31:47.436861 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 165/324] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:31:47.446666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-40183872", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:47.528822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:31:47.919397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:31:47.919997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:31:47.921069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:31:47.921806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:31:47.922470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:31:47.938434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:47.939280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:47.940021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:47.942106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:47.942896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:47.943808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:47.998364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Getting quotas for project da5f96a655f2428398c431b107624a95. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:31:48.011439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Getting quotas for user 02d83698bb4d405797a50af230d3bd01 and project da5f96a655f2428398c431b107624a95. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:31:48.037570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:31:48.044542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:31:48.134866 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8f03ec7-f2d7-4faf-862c-f9da1cfe0ca6 tempest-QuotasAdminTestV257-1738099014 tempest-QuotasAdminTestV257-1738099014-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15?user_id=0485a9e3a3804fe5adf364452f031488" status: 200 len: 190 microversion: 2.57 time: 1.280632 Aug 25 12:31:48.137767 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 160/325] 10.222.0.60 () {60 vars in 1364 bytes} [Thu Aug 25 12:31:46 2022] GET /compute/v2.1/os-quota-sets/662c4d5d6a7f4c38845d562059246b15?user_id=0485a9e3a3804fe5adf364452f031488 => generated 190 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:31:48.165351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44f14e67-5429-4617-a48e-08cfce547ddc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726094 Aug 25 12:31:48.167035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:48.168572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 166/326] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:31:48.173718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:48.203680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff48cc7b-da86-4d18-b5fe-71346d143917 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:48.207800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff48cc7b-da86-4d18-b5fe-71346d143917 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:48.372108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.416889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.422636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.463278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-99384ea1-fe8f-4855-9865-62a0cb080327 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "PUT /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1359 microversion: 2.75 time: 0.316078 Aug 25 12:31:48.480247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 161/327] 10.222.0.60 () {62 vars in 1297 bytes} [Thu Aug 25 12:31:48 2022] PUT /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:48.502632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:48.505180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:48.512266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ff48cc7b-da86-4d18-b5fe-71346d143917 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.554830 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff48cc7b-da86-4d18-b5fe-71346d143917 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1217 microversion: 2.1 time: 0.373125 Aug 25 12:31:48.560753 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 167/328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:48 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1217 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:48.974071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.990634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:48.992889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:49.008828 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fad7fca6-d435-4a79-9d5c-95cadd29adfa tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1359 microversion: 2.75 time: 0.512473 Aug 25 12:31:49.010578 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 162/329] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:48 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1359 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:49.606094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:49.606768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:49.624929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:49.627578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:49.630118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:49.632525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:49.634985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:49.635719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:49.807701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:49.843365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c630d4d-8651-4423-a6e7-a93647068862 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1221 microversion: 2.1 time: 0.242428 Aug 25 12:31:49.867825 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 168/330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:49 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:31:50.048235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:50.049575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:50.058819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:50.059621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:50.060407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:50.061317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:50.061945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:50.062527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:50.210606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:50.222620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:50.225065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:50.232312 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4695e4d1-307d-4d78-a6cb-d35534a88d96 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1417 microversion: 2.75 time: 0.188267 Aug 25 12:31:50.233261 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 163/331] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:50 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1417 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:31:50.903195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:50.904845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:50.917149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:50.918469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:50.919636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:50.921309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:50.922612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:50.923689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.341024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:51.359789 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dab63472-9082-41b8-bf2b-279ddcf6a927 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1277 microversion: 2.1 time: 0.465377 Aug 25 12:31:51.362141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 164/332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:50 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1277 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:51.373223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:51.374888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:51.389655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.391371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.392502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.395261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.396418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.397239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.620886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:51.653268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:51.662564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:51.674936 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1417 microversion: 2.75 time: 0.309463 Aug 25 12:31:51.676969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 165/333] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:51 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1417 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:51.678698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:51.679963 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96ce85b0-8c8e-4870-8f6a-d04cee243f15 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001690 Aug 25 12:31:51.680566 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 166/334] 10.222.0.60 () {56 vars in 886 bytes} [Thu Aug 25 12:31:51 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 12:31:51.785244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Calling method '.version_select at 0x7fc6c319c4c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:51.792461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.793794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.805271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.840413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.842352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.843536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.888386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.891087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.893045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.913511 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35303656-27c0-4d58-b59c-ce898992079d tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.168368 Aug 25 12:31:51.922648 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 169/335] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:51.933937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Calling method '.version_select at 0x7fc6c3828700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:51.939285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.940570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.942116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:51.973481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:51.975100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:51.976412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.030378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.032830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.033731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.049852 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-04d2b060-66de-4e77-b5cb-857e03018c00 tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-850468-18/servers" status: 200 len: 276 microversion: 2.1 time: 0.125174 Aug 25 12:31:52.068799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Calling method '.version_select at 0x7fc6c3107040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:52.071053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.071713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.072192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.077553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1215 bytes} [Thu Aug 25 12:31:51 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-18/servers => generated 276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:52.108934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.109844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.110668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.134041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.134951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.135783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.149571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-71ee9f53-978e-47f4-a1f0-f984cdc06f9a tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084945 Aug 25 12:31:52.151146 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 170/337] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:31:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:31:52.164580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Calling method '.version_select at 0x7fc6c30eee50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:52.167517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.168270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.168872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.193701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.194661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.195307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.209055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a90ad33-1da1-45e3-909b-24ad3a69705f tempest-HypervisorAdminUnderV252Test-1305027503 tempest-HypervisorAdminUnderV252Test-1305027503-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/n-h2-850468-18/search" status: 200 len: 105 microversion: 2.1 time: 0.048591 Aug 25 12:31:52.218598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 168/338] 10.222.0.60 () {58 vars in 1212 bytes} [Thu Aug 25 12:31:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-850468-18/search => generated 105 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:52.403208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:52.404166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:52.418345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.423895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.424604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.433512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.434557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.435283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.670657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:52.691658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df8a339c-5e69-493a-b785-b26197e960ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1275 microversion: 2.1 time: 0.292388 Aug 25 12:31:52.696143 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 171/339] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:52 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:52.711741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:52.712786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:52.740630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.742466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.744525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:52.748954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:52.751221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:52.754453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.054532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:53.089608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:53.091457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:53.094176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:53.111414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7badc97-6571-43cc-a2de-7f3ec6602a5c tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1438 microversion: 2.75 time: 0.412328 Aug 25 12:31:53.116030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 169/340] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:52 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1438 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:53.173521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:53.177791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:53.185783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.186802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.196934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.198107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.198832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.199467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.414007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:31:53.415502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:31:53.416265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:31:53.416887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:31:53.417503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:31:53.724223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:53.750145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:53.751398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:53.764844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.766785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:53.769510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.772402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.778757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.779774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.783479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.798624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.814316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.815600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:53.819318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:53.826559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:53.827639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:54.551492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.583798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.591144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.618179 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e7678b4-cef8-4434-a1bd-4191b612c2c2 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "POST /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99/action" status: 202 len: 1495 microversion: 2.75 time: 1.441909 Aug 25 12:31:54.622555 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 172/341] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:31:53 2022] POST /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99/action => generated 1495 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 12:31:54.680997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:54.682433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:54.694220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:54.695080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:54.695688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:54.696761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:54.697512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:54.698159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:54.782906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.819703 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a8123290-f374-4923-a697-c883649519da tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 1.082877 Aug 25 12:31:54.826099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 170/342] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:53 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:54.964651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.989145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:54.992691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:55.002239 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f87751e3-b01a-492a-b903-874857b5e817 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.331361 Aug 25 12:31:55.004047 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 173/343] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:54 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:31:55.411240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3567498-2fdc-4ca2-9485-ac4483b92d45", "tag": "a7fa12ed-8361-4648-a1df-5578988ca561"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:31:55.467761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:55.468660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:55.469459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:55.521416 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] Creating event network-changed:a7fa12ed-8361-4648-a1df-5578988ca561 for instance e3567498-2fdc-4ca2-9485-ac4483b92d45 on n-h2-850468-18 Aug 25 12:31:55.537708 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-53c4c6e5-5f34-494a-bc7d-eee732f15bd7 req-09b0c41a-0c0f-4245-9607-e7540f57fa86 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145440 Aug 25 12:31:55.538381 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 171/344] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:31:55.857922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:55.859343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:55.885872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:55.895739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:55.896553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:55.901348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:55.902355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:55.903154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:56.060926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:56.064073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:56.088958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:56.090948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:56.091770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:56.103922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:56.103922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:56.103922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:56.314987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:56.367124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:56.375258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:56.408914 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe35d64b-c282-4e30-8264-ff0c08004dae tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.363818 Aug 25 12:31:56.413872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 172/345] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:56 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:31:56.526978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:56.581671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb032e6c-46e7-4651-883d-7e2663bd4085 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 0.732550 Aug 25 12:31:56.598555 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 174/346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:55 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:57.478101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:57.480082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:57.496782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:57.498170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:57.499469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:57.501275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:57.502362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:57.503703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:57.644007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:57.645750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:57.661342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:57.662418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:57.663820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:57.664837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:57.667384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:57.668648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:57.669486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:57.685666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:57.690124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:57.708397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e5faae8-7a45-4641-8e2b-e209f990880a tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.236610 Aug 25 12:31:57.710554 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 173/347] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:57 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:57.955063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=15 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:58.205059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:58.219890 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85ef2531-cf4b-473b-80e2-f5a497392940 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 0.586011 Aug 25 12:31:58.221623 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 175/348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:57 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:31:58.753367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:58.756321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:58.771320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:58.774646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:58.775974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:58.779591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:58.781040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:58.782477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:58.937531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:58.951614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:58.954710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:58.961930 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4aad62e5-a63c-427b-a176-aed00959cca0 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.217555 Aug 25 12:31:58.963202 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 174/349] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:31:58 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:31:59.273228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:31:59.275461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:31:59.278830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:31:59.289786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:59.291165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:59.292330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:59.295080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:31:59.295929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:31:59.297062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:31:59.491553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:31:59.500857 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b28bc75-47f1-4606-a4d0-cb181499e6d1 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 0.244395 Aug 25 12:31:59.516134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 176/350] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:31:59 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:00.013970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:00.016677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:00.027444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:00.031480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:00.032708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:00.033854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:00.036284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:00.037444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:00.038551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:00.205916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:00.230842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:00.236267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:00.254711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5052a288-38f3-408c-a5dd-4d408680c2c7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.247286 Aug 25 12:32:00.285698 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 175/351] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:00 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:00.485880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3567498-2fdc-4ca2-9485-ac4483b92d45", "name": "network-vif-plugged", "status": "completed", "tag": "a7fa12ed-8361-4648-a1df-5578988ca561"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:00.508451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:00.509284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:00.510110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:00.528595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:00.529678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:00.540386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:00.542906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:00.545425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:00.546396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:00.547783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:00.550650 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] Creating event network-vif-plugged:a7fa12ed-8361-4648-a1df-5578988ca561 for instance e3567498-2fdc-4ca2-9485-ac4483b92d45 on n-h2-850468-18 Aug 25 12:32:00.551645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:00.552635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:00.573234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b6485f58-fd1a-4551-aa31-d92700b57544 req-37b2b177-7c49-4a8c-958d-17e70bd41ed0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092736 Aug 25 12:32:00.577986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 177/352] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:00.913695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:00.945353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-67111e70-fdb6-4f1b-806e-cb18e9c24e51 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 0.422221 Aug 25 12:32:00.951460 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 176/353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:00 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:01.295253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:01.296339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:01.311126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:01.312906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:01.313386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:01.314959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:01.315823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:01.317715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:01.571731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:01.584529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:01.594569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:01.602202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13768fbe-48f5-426e-88c8-dbaee41ad640 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.310874 Aug 25 12:32:01.604196 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 177/354] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:01 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:32:01.995824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:01.997418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:02.010238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:02.011580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:02.012762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:02.014664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:02.016204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:02.017279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:02.025988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:02.121733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af67dbf6-6222-4a41-b80f-9da3f2da0671 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c319c310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:02.477233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:02.516671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b39a239-2fba-4638-8f20-ff9badbdb838 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1317 microversion: 2.1 time: 0.522314 Aug 25 12:32:02.532221 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 178/355] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:01 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:02.914345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af67dbf6-6222-4a41-b80f-9da3f2da0671 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a" status: 200 len: 371 microversion: 2.1 time: 1.644746 Aug 25 12:32:02.926256 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 178/356] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 12:32:01 2022] GET /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a => generated 371 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:32:02.938774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:02.939927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:02.948707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:02.951400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:02.953300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:02.953965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:02.955618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:02.956347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:02.957253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:03.111135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:03.143106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:03.150298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:03.160661 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3df6d580-b60c-4c79-8dfb-31fdb4c857b7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.232079 Aug 25 12:32:03.176148 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 179/357] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:02 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:03.193831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c30b5b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:03.247049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1018522934", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:03.359215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:03.666241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:03.667614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:03.668086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:03.669034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:03.669826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:03.670388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:03.831535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:03.832414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:03.832990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:03.833794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:03.834364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:03.835200 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e447f95a-cb0f-41f4-8aea-f34d16377210 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a" status: 200 len: 328 microversion: 2.1 time: 0.659280 Aug 25 12:32:03.842845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 180/358] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:03 2022] PUT /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a => generated 328 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:03.860915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:03.862005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:03.864608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:03.874906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:03.879226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:03.881740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:04.026539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Getting quotas for project 3cc1137442554b27baf8ff45e7f128fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:04.055518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Getting quotas for user b77b9267a82a4e74a77bccfc532227cb and project 3cc1137442554b27baf8ff45e7f128fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:04.097031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:04.102361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:04.228146 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95e0df0d-804c-4851-b253-ac7bba42091b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692750 Aug 25 12:32:04.230764 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 179/359] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:32:04.262573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:04.263779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:04.277517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:04.278972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:04.280166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:04.281332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:04.281971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:04.282582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:04.761915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-66457302", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:04.898625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:04.918531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:04.918878 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb51e610-c991-4b03-93c3-ee4206e52d07 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1467 microversion: 2.1 time: 0.685150 Aug 25 12:32:04.919475 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 180/360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:04 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1467 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:04.971666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e62fb522-98e3-45bf-8a5d-fd4e2e21076a tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:05.022338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e62fb522-98e3-45bf-8a5d-fd4e2e21076a tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a" status: 202 len: 0 microversion: 2.1 time: 0.063697 Aug 25 12:32:05.022974 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 181/361] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 12:32:04 2022] DELETE /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:32:05.042309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:05.043635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:05.061931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.063173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.064925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.067235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.069285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.069732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.391202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:05.409544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:05.415567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:05.434638 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5651ef18-aa43-4d8e-bfa8-9caae0fb0ab7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.405050 Aug 25 12:32:05.435462 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 182/362] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:05 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:05.473019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:05.473496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:05.475408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:05.475861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:05.480523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:05.481091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:05.485066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:05.493134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.494092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.495465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.496667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.497395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.498203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.519788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.520349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.520801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.528153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.529262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.530138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.613671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Getting quotas for project c164b35071d044d2bd3ee89e0fd8e5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:05.619442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Getting quotas for user 1ac8d1e8a4b34947b3a98a4db4b058f9 and project c164b35071d044d2bd3ee89e0fd8e5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:05.655519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:05.660570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:05.676532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:05.707214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d095a031-9ca6-4758-9877-8164dd30074f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1224 microversion: 2.1 time: 0.268004 Aug 25 12:32:05.711783 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 183/363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:05 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1224 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:05.798983 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f68133a1-6453-4b4f-9194-ea8968e31a61 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.953609 Aug 25 12:32:05.802214 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 181/364] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:32:05.821715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:05.823286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:05.836633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.837864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.839101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:05.841242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:05.841888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:05.842937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.006270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lazy-loading 'flavor' on Instance uuid e3567498-2fdc-4ca2-9485-ac4483b92d45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:06.083406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Calling method '.version_select at 0x7fc6c30ee670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.093910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.100207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.101428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.175501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.176547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.178445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.211101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.213109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.214784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.229753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-140d3f55-e91b-4a55-9c22-cc4f53f29293 tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.514357 Aug 25 12:32:06.243698 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 184/365] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 12:32:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:32:06.257362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a365d4d6-97d9-4d56-81b5-c5d53a1ea01f tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c30eed30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.484294 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f62c87d0-a0ab-456c-8e87-a0f6244b73b6 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45/action" status: 202 len: 0 microversion: 2.1 time: 0.671409 Aug 25 12:32:06.485562 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 182/366] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:32:05 2022] POST /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:32:06.538862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebf435fd-300f-4fee-bc9a-f767fa924920 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.541722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ebf435fd-300f-4fee-bc9a-f767fa924920 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:06.724023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ebf435fd-300f-4fee-bc9a-f767fa924920 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:06.736080 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ebf435fd-300f-4fee-bc9a-f767fa924920 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1220 microversion: 2.1 time: 0.239450 Aug 25 12:32:06.740079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a365d4d6-97d9-4d56-81b5-c5d53a1ea01f tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a" status: 200 len: 371 microversion: 2.1 time: 0.494581 Aug 25 12:32:06.742535 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 183/367] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:06 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:06.746912 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 185/368] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 12:32:06 2022] GET /compute/v2.1/os-quota-sets/447c4a36e12d4508b1d98df8e165965a => generated 371 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:06.751274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Calling method '.version_select at 0x7fc6c30bf820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.754680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.755773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.756678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.761334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.762137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:06.784308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.786594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.788845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.789857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.793378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.794845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.822211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.823747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.824298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.846346 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-246b79a7-7ae1-4789-bb65-f72f36804d0d tempest-HypervisorAdminV228Test-98590479 tempest-HypervisorAdminV228Test-98590479-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.101746 Aug 25 12:32:06.848358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 184/369] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:32:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:32:06.864741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:06.865748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:06.886308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.887179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.888155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:06.889278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:06.906789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:06.907997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:07.063753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:07.076670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:07.087321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:07.102490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9070de2-a210-4e83-8d32-13996a36d5f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.353732 Aug 25 12:32:07.103429 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 186/370] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:06 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:07.125124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:07.126516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:07.145405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:07.146537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:07.147483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:07.148458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:07.149107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:07.150060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:07.656916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:07.686857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-563fda58-5c7d-4138-b8d0-92499f916dc4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1272 microversion: 2.1 time: 0.581104 Aug 25 12:32:07.700727 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 187/371] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:07 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1272 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:07.710168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa724e55-3eb1-4e65-bac8-ea39cb1bf417 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c304f4c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:08.385329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:08.415864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-410a0fd4-5848-4435-8a66-74a9e0837b4a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1475 microversion: 2.1 time: 1.565408 Aug 25 12:32:08.417020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 185/372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:06 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1475 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:08.449625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:08.450750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:08.473645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.474997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.479937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:08.481792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.493349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.494536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:08.717237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:08.728718 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd9d8f84-37a1-4ef7-a09d-8f256c69e6f6 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1272 microversion: 2.1 time: 0.309940 Aug 25 12:32:08.740293 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 186/373] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:08 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:08.746603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:08.752196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:08.770515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.771572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.772509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:08.773703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.774604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.775371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:08.869758 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa724e55-3eb1-4e65-bac8-ea39cb1bf417 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab/defaults" status: 200 len: 371 microversion: 2.1 time: 1.160200 Aug 25 12:32:08.881148 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 188/374] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:32:07 2022] GET /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab/defaults => generated 371 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:08.915254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:08.916499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:08.956046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.957067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.957821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:08.959053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:08.959825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:08.970202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:09.470032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:09.494710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:09.497756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:09.519532 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7260bf49-1526-42b1-88a1-fb35d4419650 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.776703 Aug 25 12:32:09.523375 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 187/375] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:08 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:09.544534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:09.553460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:09.554573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:09.573661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:09.578048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1e48571-00da-4d9d-b57e-1f431937b49a tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1278 microversion: 2.1 time: 0.704048 Aug 25 12:32:09.578338 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 189/376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:08 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1278 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:09.588414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:09.588414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:09.588414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:09.588414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:09.589690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:09.600615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c304f040>, body: {"quota_set": {"ram": "5120"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:10.122737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.126150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.127261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:10.131736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.133025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.134042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:10.311323 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c49f1742-080a-40fb-aabf-aae99e50a80d tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232" status: 200 len: 328 microversion: 2.1 time: 0.725066 Aug 25 12:32:10.313639 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 190/377] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:09 2022] PUT /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232 => generated 328 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:10.326491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:10.328403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:10.343194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.344292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.345227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:10.349755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.351599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.352989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:10.480510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:10.527035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99995a57-7965-4282-8ea7-b3e34076b3f9 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1458 microversion: 2.1 time: 0.998621 Aug 25 12:32:10.530228 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 188/378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:09 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1458 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:10.549228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c2ff6160>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:10.615098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:10.656644 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b45e78eb-03f9-45e8-b189-73abc07b1427 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1278 microversion: 2.1 time: 0.340368 Aug 25 12:32:10.660555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 191/379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:10 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:10.678301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:10.679368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:10.698018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.699275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.700695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:10.702515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:10.712856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:10.714118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.071242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.071887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.072538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.073535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.074190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.074906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.104795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-69be89f5-a2a7-4b82-af64-e8973a93a818 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232/detail" status: 200 len: 916 microversion: 2.1 time: 0.571127 Aug 25 12:32:11.116299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 189/380] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:32:10 2022] GET /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232/detail => generated 916 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:11.133854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:11.134549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:11.141873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.142566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.143170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.144167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.144903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.145613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.371979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:11.385418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:11.392584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:11.401121 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d9eef95-cdc1-4a11-8fab-d3ed8ce570b5 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.283551 Aug 25 12:32:11.401733 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 190/381] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:11 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:11.432728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:11.433963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:11.463695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.465381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.466483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.468164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:11.469299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:11.471248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:11.749821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:11.770499 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60052625-42c8-418c-916d-0bc01890b161 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1278 microversion: 2.1 time: 0.366687 Aug 25 12:32:11.771247 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 191/382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:11 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:11.787326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2f98b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:12.329517 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17259f82-3904-4030-ac40-3475b9692f98 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1611 microversion: 2.1 time: 1.652823 Aug 25 12:32:12.336330 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 192/383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:10 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1611 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:12.342430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:12.348413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:12.363478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.364592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.369730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.373384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.374480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.375198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.436293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.437094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.437769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.438894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.439758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.440511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.501526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.502181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.502734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.503685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.504381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.505015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.531955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:12.545472 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6d9b5af-6836-42eb-88fd-3c692168531c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1278 microversion: 2.1 time: 0.211648 Aug 25 12:32:12.546157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 193/384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:12 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:12.550977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:12.567521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.567880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.568542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.569470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.570088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.570707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.617185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28a63823-3ac6-416c-8ce6-37afd2e30d40 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.069322 Aug 25 12:32:12.619007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 194/385] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:32:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:12.621916 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe831d85-781d-4a43-9067-f055c0dd4f1b tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232?user_id=2252262997954f5c83ccc739de39dafe" status: 200 len: 328 microversion: 2.1 time: 0.847636 Aug 25 12:32:12.623496 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 192/386] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:32:11 2022] PUT /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232?user_id=2252262997954f5c83ccc739de39dafe => generated 328 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:12.648853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": true, "disk_over_commit": false}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:12.653165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:12.655953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:12.656219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:12.672524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:12.677261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.677788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.678279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.679049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.679518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.680001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.680679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.681220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.681967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:12.682797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:12.683272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:12.683696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.011707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Lazy-loading 'flavor' on Instance uuid e3567498-2fdc-4ca2-9485-ac4483b92d45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:13.039816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e3567498-2fdc-4ca2-9485-ac4483b92d45 while it is in vm_state suspended Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Request method failure captured: Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45/action HTTP/1.1 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 98 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2uQeIA-PW28lz_gDJ2yaPYClZcpYwjRPv5XcOTWF6YYkyIOJXT8OBNoO6GDAicQlMiZdsBxXpcPGfcArtrBJd7P-DbfU1gnYYFyqKhfFuzPvq7nGd2KN046vYm69w4e4nIQFaW9DslJWx2sL8uujWW-Gm2sqbG8K5DTmjJtNZjwqx0 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5ac9d7444e0a441d857d7e7782971899 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:32:13.044775 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5ac9d7444e0a441d857d7e7782971899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5ac9d7444e0a441d857d7e7782971899 Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1918459173 Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveMigrationNegativeTest-1918459173-project-admin Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 750c3d6d9e144724b40dc4a6d18830d6 Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveMigrationNegativeTest-1918459173-project-admin Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": true, "disk_over_commit": false}} Aug 25 12:32:13.047100 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: exception: Cannot 'os-migrateLive' instance e3567498-2fdc-4ca2-9485-ac4483b92d45 while it is in vm_state suspended Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e3567498-2fdc-4ca2-9485-ac4483b92d45', 'body': {'os-migrateLive': {'host': 'n-h1-850468-18', 'block_migration': True, 'disk_over_commit': False}}} Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 12:32:13.048367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:13.051406 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e3567498-2fdc-4ca2-9485-ac4483b92d45 while it is in vm_state suspended Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e3567498-2fdc-4ca2-9485-ac4483b92d45 while it is in vm_state suspended Aug 25 12:32:13.053663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.062343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e3567498-2fdc-4ca2-9485-ac4483b92d45 while it is in vm_state suspended {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:13.062343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e877890-8faa-4d72-95b4-34b2359563e8 tempest-LiveMigrationNegativeTest-1918459173 tempest-LiveMigrationNegativeTest-1918459173-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45/action" status: 409 len: 155 microversion: 2.1 time: 0.418219 Aug 25 12:32:13.062343 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 193/387] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:32:12 2022] POST /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45/action => generated 155 bytes in 424 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:32:13.071728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e84c0f84-bd3b-41bc-9fe6-134622718639 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c30b5af0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.138484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.154722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.157224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.167677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-807ed06d-e6c5-48c7-a738-3be2b4a143c6 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.546168 Aug 25 12:32:13.168562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 195/388] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:12 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:13.180381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.183324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:13.198578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.199584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.200410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.201984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.202944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.203950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.454963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e84c0f84-bd3b-41bc-9fe6-134622718639 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232?user_id=2252262997954f5c83ccc739de39dafe" status: 200 len: 370 microversion: 2.1 time: 0.397621 Aug 25 12:32:13.455495 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 194/389] 10.222.0.60 () {58 vars in 1323 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/os-quota-sets/789db9d046e5400086e5dbaddf2d7232?user_id=2252262997954f5c83ccc739de39dafe => generated 370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:13.676708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32c08f38-a8b7-44ae-abb3-0e8cfe9925f7 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Calling method '.version_select at 0x7fc6c2ff60d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.680487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32c08f38-a8b7-44ae-abb3-0e8cfe9925f7 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'fa31f88219e942fa97ceebe8437f506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089ac340fcae444580812f74c9838eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32c08f38-a8b7-44ae-abb3-0e8cfe9925f7 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Request method failure captured: Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vLiQNfodNfq75r-ENZS1buekXeOl5c2wgkZsgXwSHpaBaba9Yxt27cSOKtMhuTz39jih3mXiv0VEn-dUIRTKzGQhlIbnV9QJdRNUZ7q--sxQOVeUYzn7e5uHMg98y_24D0Cn5QF_ZpHoGYmyszcx3mViUbFp8XPmb7FIAl76vmthc Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:13.682796 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_089ac340fcae444580812f74c9838eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/089ac340fcae444580812f74c9838eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: fa31f88219e942fa97ceebe8437f506e Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:32:13.685504 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:13.687110 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 25 12:32:13.690545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.694510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32c08f38-a8b7-44ae-abb3-0e8cfe9925f7 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:13.694510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32c08f38-a8b7-44ae-abb3-0e8cfe9925f7 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.230629 Aug 25 12:32:13.694510 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:13.701391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.703672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:13.713872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.714943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.715523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.716519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.717444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.718462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.766274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:32:13.912508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:13.933461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.937315 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6cf760e2-9146-451c-ba66-04ddfdd5a778 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 204 len: 0 microversion: 2.1 time: 0.242601 Aug 25 12:32:13.944813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 196/391] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:32:13 2022] DELETE /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:32:13.960212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.961570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:13.963888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a8f0a199-ac6c-487e-b808-90dfb55a1ff0 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 0.793552 Aug 25 12:32:13.965118 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:13.972346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08921967-ff3e-4c88-8c76-c2d154b4abd2 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Calling method '.version_select at 0x7fc6c303b790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:13.974396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08921967-ff3e-4c88-8c76-c2d154b4abd2 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'fa31f88219e942fa97ceebe8437f506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089ac340fcae444580812f74c9838eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08921967-ff3e-4c88-8c76-c2d154b4abd2 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Request method failure captured: Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vLiQNfodNfq75r-ENZS1buekXeOl5c2wgkZsgXwSHpaBaba9Yxt27cSOKtMhuTz39jih3mXiv0VEn-dUIRTKzGQhlIbnV9QJdRNUZ7q--sxQOVeUYzn7e5uHMg98y_24D0Cn5QF_ZpHoGYmyszcx3mViUbFp8XPmb7FIAl76vmthc Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:13.981842 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_089ac340fcae444580812f74c9838eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/089ac340fcae444580812f74c9838eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: fa31f88219e942fa97ceebe8437f506e Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 12:32:13.983246 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:13.984033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 25 12:32:13.985183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:13.991355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.992093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.992930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08921967-ff3e-4c88-8c76-c2d154b4abd2 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:13.993086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:13.993805 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08921967-ff3e-4c88-8c76-c2d154b4abd2 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027073 Aug 25 12:32:13.994263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:13.994374 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:13.995109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:13.995835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:14.004856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:14.005232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:14.022036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:14.023201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:14.023673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:14.024481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:14.025010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:14.025440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:14.203593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.206713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:14.221839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82ff7c32-102f-45aa-a0e4-1f14e669d85f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1278 microversion: 2.1 time: 0.272412 Aug 25 12:32:14.223436 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:14.241135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e04fbdee-2725-48aa-8256-3c5cd1982467 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Calling method '.version_select at 0x7fc6c30c94c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:14.243496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e04fbdee-2725-48aa-8256-3c5cd1982467 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'fa31f88219e942fa97ceebe8437f506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089ac340fcae444580812f74c9838eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e04fbdee-2725-48aa-8256-3c5cd1982467 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Request method failure captured: Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vLiQNfodNfq75r-ENZS1buekXeOl5c2wgkZsgXwSHpaBaba9Yxt27cSOKtMhuTz39jih3mXiv0VEn-dUIRTKzGQhlIbnV9QJdRNUZ7q--sxQOVeUYzn7e5uHMg98y_24D0Cn5QF_ZpHoGYmyszcx3mViUbFp8XPmb7FIAl76vmthc Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:14.245364 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_089ac340fcae444580812f74c9838eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/089ac340fcae444580812f74c9838eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: fa31f88219e942fa97ceebe8437f506e Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:32:14.249205 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:14.252307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 25 12:32:14.256369 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:14.260146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e04fbdee-2725-48aa-8256-3c5cd1982467 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:14.260146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e04fbdee-2725-48aa-8256-3c5cd1982467 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022003 Aug 25 12:32:14.260146 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1179 bytes} [Thu Aug 25 12:32:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:14.260146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9668a63-c2df-4e03-98ab-86faa8738956 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Calling method '.version_select at 0x7fc6c48e0b80>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:14.511393 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9668a63-c2df-4e03-98ab-86faa8738956 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab/defaults" status: 200 len: 371 microversion: 2.1 time: 0.261493 Aug 25 12:32:14.512747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 199/396] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:32:14 2022] GET /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab/defaults => generated 371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:14.523265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:14.524407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:14.539823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:14.540733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:14.541546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:14.542846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:14.544133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:14.544514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:14.809662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.822783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.828798 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d8005fa-a844-4143-928f-62bcc5435c50 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1464 microversion: 2.1 time: 0.828373 Aug 25 12:32:14.829777 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 198/397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:13 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1464 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:14.857238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.872080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:14.883988 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f435103-21c1-430f-bece-5aca8d379464 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.369044 Aug 25 12:32:14.888261 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 200/398] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:14 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:14.897494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c30c93a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:15.149191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.151153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.151768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.153341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.157428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.159142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.175698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Calling method '.version_select at 0x7fc6c32e5430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:15.202037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.202558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.203049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.229458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.229962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.233786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.251544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.252386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.253290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.266300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d29ef05-21b1-489e-9209-16beb473481a tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.434734 Aug 25 12:32:15.270919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 199/399] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:32:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:15.282902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:15.283926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:15.317786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.321830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.323870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.325378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.327008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.328587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.682328 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c17ca54-574f-424a-abec-8694c80a3aae tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab" status: 200 len: 329 microversion: 2.1 time: 0.794670 Aug 25 12:32:15.683553 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 201/400] 10.222.0.60 () {60 vars in 1263 bytes} [Thu Aug 25 12:32:14 2022] PUT /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab => generated 329 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:15.688979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:15.689883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:15.702014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.703091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.704097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:15.705630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:15.706424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:15.707660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:16.623682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:16.642584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:16.678673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9804b23c-e770-48c3-81b2-cf29ba8f0e6b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 1.404668 Aug 25 12:32:16.684942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 200/401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:15 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:16.717496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7040350-5a30-4e11-ba48-495b2f7a37b4 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Calling method '.version_select at 0x7fc6c30d7e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:16.729688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7040350-5a30-4e11-ba48-495b2f7a37b4 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'fa31f88219e942fa97ceebe8437f506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089ac340fcae444580812f74c9838eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7040350-5a30-4e11-ba48-495b2f7a37b4 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Request method failure captured: Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vLiQNfodNfq75r-ENZS1buekXeOl5c2wgkZsgXwSHpaBaba9Yxt27cSOKtMhuTz39jih3mXiv0VEn-dUIRTKzGQhlIbnV9QJdRNUZ7q--sxQOVeUYzn7e5uHMg98y_24D0Cn5QF_ZpHoGYmyszcx3mViUbFp8XPmb7FIAl76vmthc Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:16.738644 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_089ac340fcae444580812f74c9838eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/089ac340fcae444580812f74c9838eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: fa31f88219e942fa97ceebe8437f506e Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1'} Aug 25 12:32:16.741394 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:16.742996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 25 12:32:16.745727 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:16.750701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7040350-5a30-4e11-ba48-495b2f7a37b4 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:16.753234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7040350-5a30-4e11-ba48-495b2f7a37b4 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.063858 Aug 25 12:32:16.756150 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:32:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:16.768199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c303e430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:16.813989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:16.831977 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bfe4c53f-43c3-48da-9e68-f6c7df5a849f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 1.147022 Aug 25 12:32:16.832707 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:15 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:16.860255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:16.861150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:16.875964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:16.885414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:16.885851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:16.886623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:16.887096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:16.887529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:16.999333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:17.019895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-290f4652-9ed7-495f-9444-20ac1d5ca3bc tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 200 len: 1422 microversion: 2.1 time: 0.173613 Aug 25 12:32:17.022107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 203/404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:16 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 1422 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:17.042307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:17.043107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:17.063673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.064195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.064640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.065460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.074341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.075046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.087459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.094782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.100664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.104802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.106844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.107383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.294626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:17.327648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:17.339404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:17.379194 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0624174e-c1bc-4f17-9b88-ab4bc6cd85dd tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.332838 Aug 25 12:32:17.396564 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 204/405] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:17.407560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a212f84-9155-4f46-825f-6f26d441288e tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Calling method '.version_select at 0x7fc6c30c9af0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:17.410748 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9a212f84-9155-4f46-825f-6f26d441288e tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] HTTP exception thrown: Hypervisor with ID '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' could not be found. Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a212f84-9155-4f46-825f-6f26d441288e tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Request method failure captured: Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed/uptime HTTP/1.1 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vM5crE4iRSIq1waRKIFkWXR2bcnZDUv7jKHXkL1jsnhSaYNTnEzgczwnQtc-_qB9i2pXguc-tJeqv31C0SEaAsnWu5v-ppe1bviVLWqdy-u3RXSXSYIgkWVTjj-Q3Q3_AFtR8y52qLhU8md-LIJsy2_0RsTjmOi6D4zSn7gYNKg1g Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 73f1c96074a844fea0697648304a6698 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:32:17.433501 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73f1c96074a844fea0697648304a6698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73f1c96074a844fea0697648304a6698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73f1c96074a844fea0697648304a6698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73f1c96074a844fea0697648304a6698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 73f1c96074a844fea0697648304a6698 Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a58d7adf90f44d3f80ddc4710bc11c9d Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: exception: Hypervisor with ID '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' could not be found. Aug 25 12:32:17.435074 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed'} Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 25 12:32:17.435987 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' could not be found. Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:17.437533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' could not be found. Aug 25 12:32:17.439136 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.441831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a212f84-9155-4f46-825f-6f26d441288e tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Returning 404 to user: Hypervisor with ID '7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed' could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:17.443460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a212f84-9155-4f46-825f-6f26d441288e tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed/uptime" status: 404 len: 123 microversion: 2.1 time: 0.045135 Aug 25 12:32:17.452170 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 205/406] 10.222.0.60 () {58 vars in 1278 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/os-hypervisors/7bfc7c0b-34a1-4d7e-88e6-2425ebeee5ed/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:17.464497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3567498-2fdc-4ca2-9485-ac4483b92d45", "name": "network-vif-deleted", "tag": "a7fa12ed-8361-4648-a1df-5578988ca561"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:17.491617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.492441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.493433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.509980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] Creating event network-vif-deleted:a7fa12ed-8361-4648-a1df-5578988ca561 for instance e3567498-2fdc-4ca2-9485-ac4483b92d45 on n-h2-850468-18 Aug 25 12:32:17.518044 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-af7ba087-9148-4016-983d-82eb73640e82 req-a24757e4-f744-494d-959e-5bf3c0f6ed20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064204 Aug 25 12:32:17.524467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 206/407] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:17.531724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8a4f29-0c78-49ad-a00d-426571af2570", "tag": "40aa7bed-2437-4b13-bee2-752a24f2c2e0"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:17.544599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.545056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.545682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.567800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] Creating event network-changed:40aa7bed-2437-4b13-bee2-752a24f2c2e0 for instance 3a8a4f29-0c78-49ad-a00d-426571af2570 on n-h2-850468-18 Aug 25 12:32:17.575079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-16cedaa3-afc4-4134-b624-db6b624e178a req-0f5aa7ff-6c65-4327-827c-7cfef2dc1d2a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048387 Aug 25 12:32:17.576467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 207/408] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:17.583938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Calling method '.version_select at 0x7fc6c30b5ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:17.586719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.587276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.587982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.607965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.608743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.609660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.631244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.632337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.632962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.663200 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ebd62a5-3f39-41eb-98d7-439e258015db tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084967 Aug 25 12:32:17.675179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 208/409] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:17.683951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ee2021b-9044-4fa0-9a52-1ba2451adc21 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Calling method '.version_select at 0x7fc6c30c9550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:17.686564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ee2021b-9044-4fa0-9a52-1ba2451adc21 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'fa31f88219e942fa97ceebe8437f506e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089ac340fcae444580812f74c9838eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ee2021b-9044-4fa0-9a52-1ba2451adc21 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Request method failure captured: Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vLiQNfodNfq75r-ENZS1buekXeOl5c2wgkZsgXwSHpaBaba9Yxt27cSOKtMhuTz39jih3mXiv0VEn-dUIRTKzGQhlIbnV9QJdRNUZ7q--sxQOVeUYzn7e5uHMg98y_24D0Cn5QF_ZpHoGYmyszcx3mViUbFp8XPmb7FIAl76vmthc Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:17.689583 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_089ac340fcae444580812f74c9838eef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/089ac340fcae444580812f74c9838eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/089ac340fcae444580812f74c9838eef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 089ac340fcae444580812f74c9838eef Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889 Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: fa31f88219e942fa97ceebe8437f506e Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2004987889-project Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '1'} Aug 25 12:32:17.691108 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:17.692078 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 25 12:32:17.693434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:17.696681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ee2021b-9044-4fa0-9a52-1ba2451adc21 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:17.698065 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ee2021b-9044-4fa0-9a52-1ba2451adc21 tempest-HypervisorAdminNegativeTestJSON-2004987889 tempest-HypervisorAdminNegativeTestJSON-2004987889-project] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020326 Aug 25 12:32:17.698891 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 209/410] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:17.712600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:17.713705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:17.724852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.726063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.726769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.727944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:17.728665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:17.729399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:17.991437 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98bce393-3424-4597-a9fc-4187ad85c250 tempest-QuotasAdminTestJSON-990534707 tempest-QuotasAdminTestJSON-990534707-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab" status: 200 len: 329 microversion: 2.1 time: 1.227578 Aug 25 12:32:17.996537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 202/411] 10.222.0.60 () {60 vars in 1263 bytes} [Thu Aug 25 12:32:16 2022] PUT /compute/v2.1/os-quota-sets/5c3120947999415cb4f45c68be75b1ab => generated 329 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:18.013267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a191ce5-555a-4ceb-97bb-67d30e3f1358 tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Calling method '.version_select at 0x7fc6c303eaf0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:18.016345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2a191ce5-555a-4ceb-97bb-67d30e3f1358 tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] HTTP exception thrown: Hypervisor with ID 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' could not be found. Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a191ce5-555a-4ceb-97bb-67d30e3f1358 tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Request method failure captured: Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hypervisors/f73185f9-73e7-4afc-b556-4e6b0fd70d12 HTTP/1.1 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vM5crE4iRSIq1waRKIFkWXR2bcnZDUv7jKHXkL1jsnhSaYNTnEzgczwnQtc-_qB9i2pXguc-tJeqv31C0SEaAsnWu5v-ppe1bviVLWqdy-u3RXSXSYIgkWVTjj-Q3Q3_AFtR8y52qLhU8md-LIJsy2_0RsTjmOi6D4zSn7gYNKg1g Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 73f1c96074a844fea0697648304a6698 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:32:18.019872 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73f1c96074a844fea0697648304a6698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73f1c96074a844fea0697648304a6698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73f1c96074a844fea0697648304a6698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73f1c96074a844fea0697648304a6698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 73f1c96074a844fea0697648304a6698 Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846 Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a58d7adf90f44d3f80ddc4710bc11c9d Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: exception: Hypervisor with ID 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' could not be found. Aug 25 12:32:18.021377 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f73185f9-73e7-4afc-b556-4e6b0fd70d12'} Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 25 12:32:18.022293 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:32:18.023620 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' could not be found. Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' could not be found. Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a191ce5-555a-4ceb-97bb-67d30e3f1358 tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] Returning 404 to user: Hypervisor with ID 'f73185f9-73e7-4afc-b556-4e6b0fd70d12' could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2a191ce5-555a-4ceb-97bb-67d30e3f1358 tempest-HypervisorAdminNegativeTestJSON-1331987846 tempest-HypervisorAdminNegativeTestJSON-1331987846-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors/f73185f9-73e7-4afc-b556-4e6b0fd70d12" status: 404 len: 123 microversion: 2.1 time: 0.024364 Aug 25 12:32:18.031021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 203/412] 10.222.0.60 () {58 vars in 1257 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/os-hypervisors/f73185f9-73e7-4afc-b556-4e6b0fd70d12 => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:18.033716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:18.034579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:18.058467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.059117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.059736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.060865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.061497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.062010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.496989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:18.513021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5a848fdf-83c1-451c-8c48-60a5c2fc5aa7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 0.805127 Aug 25 12:32:18.528153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 210/413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:17 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:18.531777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:18.533719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: e3567498-2fdc-4ca2-9485-ac4483b92d45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:18.553416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.554881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.556549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.558957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.562186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.562931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.613738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] HTTP exception thrown: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Request method failure captured: Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 HTTP/1.1 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2uOq6pT7Bj7XpVX5x0YStarmcnp9EdzB4-HAVk8ebjmdh18RWmDnA7NiG0-Gpj54jYX2UstxLgn4DbsEdAN178lHRT1uU5TcvbFp56SrgkhMsd9QrdJRBqBVhyX-1UNkPZa9yv7i9_-w-fsOow2S2OmeSX4vzGwWCzyOkc4uedZY4o Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: da5f96a655f2428398c431b107624a95 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:18.615834 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5f96a655f2428398c431b107624a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5f96a655f2428398c431b107624a95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5f96a655f2428398c431b107624a95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5f96a655f2428398c431b107624a95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: da5f96a655f2428398c431b107624a95 Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveMigrationNegativeTest-806960501-project Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 02d83698bb4d405797a50af230d3bd01 Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveMigrationNegativeTest-806960501-project Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. Aug 25 12:32:18.618019 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e3567498-2fdc-4ca2-9485-ac4483b92d45'} Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:18.619519 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. Aug 25 12:32:18.621845 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:18.624022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Returning 404 to user: Instance e3567498-2fdc-4ca2-9485-ac4483b92d45 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:18.625206 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8266583b-0454-4aa3-995f-2244e44ba604 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45" status: 404 len: 111 microversion: 2.1 time: 0.103542 Aug 25 12:32:18.639254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 211/414] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:18 2022] GET /compute/v2.1/servers/e3567498-2fdc-4ca2-9485-ac4483b92d45 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:18.640591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:18.640591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:18.666190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.666815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.668570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.669290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.669904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.672697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.876506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:18.886910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-55e1469d-7516-49ed-ab4f-3b0b4c4abc58 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 0.861525 Aug 25 12:32:18.892217 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 204/415] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:18 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:18.902314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:18.920839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:18.921685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:18.922705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:18.924716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:18.933761 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11857780-73a5-48d5-b22b-411a227a3d0f tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.297424 Aug 25 12:32:18.934599 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 212/416] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:18 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:18.951947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.953406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.957288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:18.958633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:18.959220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:18.959981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:19.074805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:32:19.354085 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acb7bf51-3f18-4150-aa18-e97cffdaf8ad tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 204 len: 0 microversion: 2.1 time: 0.457597 Aug 25 12:32:19.355161 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 205/417] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:32:18 2022] DELETE /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:32:19.372250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:19.379489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:19.412876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:19.413475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:19.414070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:19.416621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:19.417962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:19.418429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:19.559062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:19.560376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:19.592043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:19.593009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:19.593807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:19.595753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:19.596708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:19.605185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:19.925777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:19.949650 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa0fd483-2753-4001-b796-3b94b6e68cf4 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1475 microversion: 2.1 time: 0.588750 Aug 25 12:32:19.954004 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 213/418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:19 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1475 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:19.966550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85605dc4-6c51-4322-aae9-0eb2a0e502bf", "tag": "5c68e78a-73ee-4c7c-9378-90d40b9dcf0e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:19.989411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:19.991672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:19.995022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:19.996148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.000105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c56a1571-c701-4bea-948a-05b5845f430d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 0.459604 Aug 25 12:32:20.000747 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 206/419] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:19 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:20.007579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:20.009122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:20.024725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] Creating event network-changed:5c68e78a-73ee-4c7c-9378-90d40b9dcf0e for instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf on n-h2-850468-18 Aug 25 12:32:20.030803 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-508210d5-dd31-45d5-9925-edb2601b8653 req-57581b4c-0e51-4370-8732-581e51b525f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074042 Aug 25 12:32:20.032149 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 214/420] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:20.035108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:20.035970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:20.036474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.037321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:20.037799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:20.038238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.040702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:20.041625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:20.049150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:20.050488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:20.051326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.052479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:20.053350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:20.054075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.187863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:20.207767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:20.212457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:20.232012 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bb9fd81-b6a0-4ca3-8790-39c9f5bfc1c8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.195129 Aug 25 12:32:20.232701 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 215/421] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:20 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:20.732597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:20.766035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce6a3110-3b30-4720-82d3-9b9a3f65d3e9 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 0.761500 Aug 25 12:32:20.773582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 207/422] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:20 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:20.977963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:20.979140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:20.997026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:20.997892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:20.998706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:20.999694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:21.000346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:21.000917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:21.025897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:21.027027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:21.057620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:21.060675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:21.061355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:21.064100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:21.064923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:21.067441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:21.739709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:21.768932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a53bfda-59ff-44e3-850b-28510cf0b05e tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1475 microversion: 2.1 time: 0.793545 Aug 25 12:32:21.784061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 216/423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:20 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1475 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:21.791025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:21.791673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:21.808495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:21.816904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:21.817779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:21.821897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:21.823151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:21.824181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:22.064530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:22.111114 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5981b7a6-b9ec-4402-9a4a-75dd485483ee tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 1.089258 Aug 25 12:32:22.125212 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 208/424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:21 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:22.150989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:22.152660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:22.175842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:22.178515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:22.179806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:22.181783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:22.184103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:22.194245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:22.259799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:22.305350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:22.348327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:22.387089 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-390d7447-bb99-4ad2-bb7d-39347c3f84f4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1447 microversion: 2.75 time: 0.599884 Aug 25 12:32:22.393056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 217/425] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:21 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1447 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:22.798762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:22.800536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:22.832827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:22.834098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:22.858320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:22.860460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:22.861762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:22.864353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:24.470686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:24.521047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b4d8223-6c33-48c9-b335-6e9d0d67dc04 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 2.367296 Aug 25 12:32:24.522097 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 209/426] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:22 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:24.542795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:24.543730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:24.567898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=15 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:24.569073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:24.582016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:24.586597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:24.588656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7bc3631-80c2-4fc3-b513-8811732130ab tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1475 microversion: 2.1 time: 1.800338 Aug 25 12:32:24.589873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:24.590302 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 218/427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:22 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1475 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:24.591623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:24.594554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:24.595395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:24.596479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:24.600044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:24.613714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:24.614183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:24.614625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:24.615476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:24.615944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:24.627918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:24.841291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:24.874403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:24.886104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:24.908690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-304b214d-fb59-4c52-995e-4473176fede1 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1453 microversion: 2.75 time: 0.313680 Aug 25 12:32:24.911580 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 219/428] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:24 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1453 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:25.550392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:25.559459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:25.600859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=13 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:25.627447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:25.633212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:25.636390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:25.638521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:25.643782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:25.644939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:25.679366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=70 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:27.141879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:27.217194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:27.274159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4601330-2cdd-4364-9484-5ad93bd8e66b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 2.750241 Aug 25 12:32:27.303552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 210/429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:24 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:27.324174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:27.325238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:27.364860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.365688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.366685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.370131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.371112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.371863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.630903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d83698bb4d405797a50af230d3bd01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5f96a655f2428398c431b107624a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:27.647403 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ce835c7-d589-4cc6-9ec3-b78695c3b6a8 tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 200 len: 1304 microversion: 2.1 time: 0.339961 Aug 25 12:32:27.649013 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 211/430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:27 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:27.663170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4431d2d-434e-4d0b-95ba-39f93aac3b19", "name": "network-vif-unplugged", "status": "completed", "tag": "7bb811dd-3f64-44f2-804e-ffadbb99711c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:27.688943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:27.694852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.695354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.695802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.704464 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34681c89-a401-45da-a024-e4ca27ed6c34 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 2.161993 Aug 25 12:32:27.716312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 220/431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:25 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:27.736786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:27.746097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:27.771152 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] Creating event network-vif-unplugged:7bb811dd-3f64-44f2-804e-ffadbb99711c for instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 on n-h1-850468-18 Aug 25 12:32:27.780055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.781012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.786200 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-75afa0bd-4463-41e9-a431-9fb133355c5d req-431efb86-9800-4c1b-abe6-e1cec90d3caa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130979 Aug 25 12:32:27.789157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.790557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.790766 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 212/432] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:27.801974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.804450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.806427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4431d2d-434e-4d0b-95ba-39f93aac3b19", "name": "network-vif-deleted", "tag": "7bb811dd-3f64-44f2-804e-ffadbb99711c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:27.877559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:27.881545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:27.882072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:27.923309 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] Creating event network-vif-deleted:7bb811dd-3f64-44f2-804e-ffadbb99711c for instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 on n-h1-850468-18 Aug 25 12:32:27.935734 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6ef5d5fb-9c46-496a-aaed-a25013d1908b req-21300e89-c734-400b-9102-dc20c06a1d44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143414 Aug 25 12:32:27.941722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 213/433] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:28.015178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=50 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:28.149191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:28.169498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:28.185467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:28.199237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:28.224104 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f99bbd79-f99a-43eb-94f0-0beb94a52cea tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1438 microversion: 2.75 time: 0.503618 Aug 25 12:32:28.227458 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 221/434] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:27 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1438 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:28.847782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-755f89b6-6613-438c-a2df-a111de1b8be3 tempest-InstanceUsageAuditLogTestJSON-770104238 tempest-InstanceUsageAuditLogTestJSON-770104238-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:28.945212 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-755f89b6-6613-438c-a2df-a111de1b8be3 tempest-InstanceUsageAuditLogTestJSON-770104238 tempest-InstanceUsageAuditLogTestJSON-770104238-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25 12:32:28" status: 200 len: 318 microversion: 2.1 time: 0.931168 Aug 25 12:32:28.946228 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 214/435] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 12:32:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-25%2012%3A32%3A28 => generated 318 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:28.967808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:28.972065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:28.993348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:28.997321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:28.998417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.005344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.006623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.012196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.039056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:29.044623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:29.053643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:29.056246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.057432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.059272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.060333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.061148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.061855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.250943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:29.251384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:29.251915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:29.252462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:29.260583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:29.302493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:29.322618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d201c44-68a2-42ce-83ea-1d67b7e377fa tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 0.374552 Aug 25 12:32:29.331831 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 215/436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:28 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:29.337637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:29.338216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] [instance: c4431d2d-434e-4d0b-95ba-39f93aac3b19] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:29.357232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.358049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.358049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.358883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.359582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.360023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.377085 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] HTTP exception thrown: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Request method failure captured: Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 HTTP/1.1 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2uOq6pT7Bj7XpVX5x0YStarmcnp9EdzB4-HAVk8ebjmdh18RWmDnA7NiG0-Gpj54jYX2UstxLgn4DbsEdAN178lHRT1uU5TcvbFp56SrgkhMsd9QrdJRBqBVhyX-1UNkPZa9yv7i9_-w-fsOow2S2OmeSX4vzGwWCzyOkc4uedZY4o Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: da5f96a655f2428398c431b107624a95 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:29.379968 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5f96a655f2428398c431b107624a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5f96a655f2428398c431b107624a95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5f96a655f2428398c431b107624a95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5f96a655f2428398c431b107624a95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: da5f96a655f2428398c431b107624a95 Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-806960501 Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveMigrationNegativeTest-806960501-project Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 02d83698bb4d405797a50af230d3bd01 Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveMigrationNegativeTest-806960501-project Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. Aug 25 12:32:29.381440 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'c4431d2d-434e-4d0b-95ba-39f93aac3b19'} Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:29.382249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. Aug 25 12:32:29.383589 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:29.385960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] Returning 404 to user: Instance c4431d2d-434e-4d0b-95ba-39f93aac3b19 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:29.387245 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d4b2e859-9e6d-42e5-8663-aaac74671e2a tempest-LiveMigrationNegativeTest-806960501 tempest-LiveMigrationNegativeTest-806960501-project] 10.222.0.60 "GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19" status: 404 len: 111 microversion: 2.1 time: 0.053733 Aug 25 12:32:29.388302 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 216/437] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:29 2022] GET /compute/v2.1/servers/c4431d2d-434e-4d0b-95ba-39f93aac3b19 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:29.395133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:29.396563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:29.407262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:29.416607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.418218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.419131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.419465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.419583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.421273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.422279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.422822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.423474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.424232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:29.426383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:29.427096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:29.748709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:30.009125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:30.032542 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2237215d-75f1-4d94-8edb-7c034e6ccf3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 0.636595 Aug 25 12:32:30.036530 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 217/438] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:29 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:30.043883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ceeb26fd-71fb-4f46-8c20-2de79b3d805e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99/action" status: 202 len: 1944 microversion: 2.75 time: 1.767246 Aug 25 12:32:30.045676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9cba6ed6-7815-4cdf-9d9f-3c357fe2a06d tempest-InstanceUsageAuditLogTestJSON-770104238 tempest-InstanceUsageAuditLogTestJSON-770104238-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:30.057932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 222/439] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:32:28 2022] POST /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99/action => generated 1944 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 12:32:30.114093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9cba6ed6-7815-4cdf-9d9f-3c357fe2a06d tempest-InstanceUsageAuditLogTestJSON-770104238 tempest-InstanceUsageAuditLogTestJSON-770104238-project-admin] 10.222.0.60 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.070936 Aug 25 12:32:30.116002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 218/440] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:32:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:30.131283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8a4f29-0c78-49ad-a00d-426571af2570", "name": "network-vif-plugged", "status": "completed", "tag": "40aa7bed-2437-4b13-bee2-752a24f2c2e0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:30.193075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:30.197605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:30.199588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:30.245308 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] Creating event network-vif-plugged:40aa7bed-2437-4b13-bee2-752a24f2c2e0 for instance 3a8a4f29-0c78-49ad-a00d-426571af2570 on n-h2-850468-18 Aug 25 12:32:30.270593 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1bfb47a4-61e1-4f6f-9b07-ccc8d76783b8 req-5769e206-f73e-408b-8ede-b856ce8f5348 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142617 Aug 25 12:32:30.274799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 219/441] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:30.291613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:30.294285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:30.310470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:30.311304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:30.311980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:30.313858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:30.314855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:30.316497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:30.642392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-553970715", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:30.653236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:30.746278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:30.866156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ab3ed3f-986e-45fd-bd73-5d85dbf07583 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.583607 Aug 25 12:32:30.868872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 220/442] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:30 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:30.891248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:30.892935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:30.906403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:30.907304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:30.908091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:30.910402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:30.911296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:30.912243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:31.418335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:31.442787 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63ca3949-3b7e-4e01-be11-b72b0f1a84c3 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1320 microversion: 2.1 time: 0.567568 Aug 25 12:32:31.456157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 221/443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:30 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1320 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:31.465095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:31.466150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:31.473457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:31.474353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:31.475143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:31.476519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:31.477246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:31.477930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:31.527455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:31.528333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:31.529065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:31.530166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:31.531215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:31.549489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:31.551007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:31.552238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:31.554074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:31.555485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:31.556286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:31.602877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Getting quotas for project 48251c26e6f44b2a9e57c610713449e0. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:31.613604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Getting quotas for user b472bfcfc9864367977e13edfe1e2b48 and project 48251c26e6f44b2a9e57c610713449e0. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:31.642394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:31.651841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:31.755845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:31.760058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:31.766659 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f0e6434-3d0a-4033-b73a-3dd560065280 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706409 Aug 25 12:32:31.768187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 223/444] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:32:31.792735 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f2e94787-25b4-4447-9cbd-4f621f6c2a82 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 0.331257 Aug 25 12:32:31.794012 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 222/445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:31 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:31.804576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cae193b-13fc-43b3-b3be-193920563645 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:31.807301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6cae193b-13fc-43b3-b3be-193920563645 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:32.119138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6cae193b-13fc-43b3-b3be-193920563645 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:32.147315 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6cae193b-13fc-43b3-b3be-193920563645 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1213 microversion: 2.1 time: 0.351552 Aug 25 12:32:32.151336 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 223/446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:31 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1213 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:32.158341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:32.162777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:32.181799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:32.182832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:32.193109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:32.194253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:32.199148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:32.200518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:32.234410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-495525132", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "88522008-cbe6-46f9-95cf-76e2176a4cab"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:32.336396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] validate_networks() for [('88522008-cbe6-46f9-95cf-76e2176a4cab', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:32.382453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:32.469970 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-799f277c-4121-49e5-a44a-1616c7a68f5d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.307962 Aug 25 12:32:32.484369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 224/447] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:32 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:32.491916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85605dc4-6c51-4322-aae9-0eb2a0e502bf", "name": "network-vif-plugged", "status": "completed", "tag": "5c68e78a-73ee-4c7c-9378-90d40b9dcf0e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:32.538231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:32.539023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:32.539782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:32.601722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] Creating event network-vif-plugged:5c68e78a-73ee-4c7c-9378-90d40b9dcf0e for instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf on n-h2-850468-18 Aug 25 12:32:32.618738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6f5f8bb9-5961-46d5-9ce6-3103e9d57671 req-21900995-876d-4db0-ae23-9f0a70d6c44b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142098 Aug 25 12:32:32.620646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 225/448] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:32.629151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:32.641888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:32.652151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:32.653101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:32.654273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:32.655863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:32.656975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:32.657963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:33.707068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:33.735027 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bbdb588c-6693-4e14-b0db-2f75e94ca346 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1470 microversion: 2.1 time: 1.112011 Aug 25 12:32:33.741319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 226/449] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:32 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1470 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:33.772433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:33.777792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:33.827947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:33.831818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:33.832683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:33.839355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:33.840528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:33.841143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.092821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:34.095169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:34.096011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:34.097746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:34.098551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:34.143183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.143899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.148244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.151369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.153531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.157258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.213858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:34.230799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for user 3f41f5c8cf9e4d78b4fb62eac79b093e and project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:34.263404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:34.267147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:34.430308 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a62f7997-2965-4acc-96a5-839b80de2a2c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.647325 Aug 25 12:32:34.436809 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 224/450] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:32:34.464964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:34.470026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:34.475755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:34.495498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.498687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.500026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.502721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30edfa08-7533-46d3-a1f8-2be1fd82ee4a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1320 microversion: 2.1 time: 0.751536 Aug 25 12:32:34.503993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.505369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.506470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.520786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 227/451] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:33 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1320 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:34.533220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:34.535341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:34.555193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.562294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.566461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.570316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:34.572743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:34.573733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:34.948033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:34.963919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:34.975509 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a6f56f6-741d-4418-b927-99d4a26f6372 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1273 microversion: 2.1 time: 0.536657 Aug 25 12:32:34.986717 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19f75fd7-c084-43aa-95e6-54beda40fd5e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.464200 Aug 25 12:32:35.000411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 225/452] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:34 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1273 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:35.001418 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 228/453] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:34 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:35.015117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:35.016778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:35.105984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:35.120948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:35.123258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:35.125127 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-44ef20b9-ebd7-43be-8b86-e78626a87479 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1261 microversion: 2.25 time: 0.122335 Aug 25 12:32:35.126016 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 229/454] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:35 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:35.534754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:35.535410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:35.553349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:35.553349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:35.553821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:35.554551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:35.555193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:35.555675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:35.784452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:35.785877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:35.817656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:35.819105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:35.821059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:35.826614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:35.828014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:35.831687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:35.847398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:35.863539 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8bad611c-5b51-4ad9-9bf9-e6c1988f06de tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1470 microversion: 2.1 time: 0.333723 Aug 25 12:32:35.865282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 230/455] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:35 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:35.925858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:32:36.165884 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d85da7ce-c430-4fc9-b6f7-ebe9bc709f63 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 204 len: 0 microversion: 2.1 time: 1.168351 Aug 25 12:32:36.166971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 226/456] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:32:34 2022] DELETE /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:32:36.186457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:36.187364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:36.202394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.207163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.207824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.208528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.218268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.219101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.373326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:36.383231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f69768bd-a6d0-4be2-94f4-179433842400 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1271 microversion: 2.1 time: 0.212739 Aug 25 12:32:36.392350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:36 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:36.399002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:36.404467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:36.431277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.432734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.434322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.440493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.441734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.442300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.621974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:36.716560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d01c7456-ff1d-42ab-b1a3-2ffa079b1645 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.306570 Aug 25 12:32:36.737059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 228/458] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:36 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:36.751303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:36.751911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:36.759920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.760603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.761166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.761783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.762431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.762772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.793313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:36.793313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] [instance: 204c71f2-7d7a-4831-b79d-e6d59179e1dc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:36.816235 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] HTTP exception thrown: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Request method failure captured: Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/204c71f2-7d7a-4831-b79d-e6d59179e1dc/action HTTP/1.1 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vCBn26HZgIRU2BBnUllu2TEQPkEQhUO4mrDJsBDMnBveVvQz3dpcbAKxD4t56ObLxQ7sDySd1pPb7OZHOV4i8i5MyqiYsM2XinKWixhWYfO7m4fMFqsPmIfRJhvlLEYm3dSXRGSK9OLPxFIE1r5ainaMQut-tPtVeDtKhhACoVOs8 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:32:36.827134 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a18364790d324a329649ee3bc9f81aee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9e259db9ab0446c1a0ee82fe993e4d8f Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: {"migrate": {}} Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:32:36.828567 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '204c71f2-7d7a-4831-b79d-e6d59179e1dc', 'body': {'migrate': {}}} Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:36.829551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. Aug 25 12:32:36.832058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:36.837303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Returning 404 to user: Instance 204c71f2-7d7a-4831-b79d-e6d59179e1dc could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:36.845202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ade4c6f0-67d0-47f1-967b-540bae726991 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/204c71f2-7d7a-4831-b79d-e6d59179e1dc/action" status: 404 len: 111 microversion: 2.1 time: 0.952981 Aug 25 12:32:36.856308 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 231/459] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:32:35 2022] POST /compute/v2.1/servers/204c71f2-7d7a-4831-b79d-e6d59179e1dc/action => generated 111 bytes in 971 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:32:36.877513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:36.879769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:36.916038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.929816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.942157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:36.947255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:36.952014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:36.954862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:37.048782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:37.072425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:37.076233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:37.085877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02705f66-7f2e-47a0-818d-b916624cca92 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1313 microversion: 2.25 time: 0.347146 Aug 25 12:32:37.087247 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 229/460] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:36 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:37.313860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1903032332", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:37.491478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:38.087443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:38.097536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ecd65e37-5e20-474c-8294-b15573e0877b tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1476 microversion: 2.1 time: 1.239266 Aug 25 12:32:38.108919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 232/461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:36 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1476 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:38.117378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:38.118536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:38.131551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.136383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.137112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:38.138146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.138900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.139528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:38.227028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:38.227517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:38.228998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:38.229501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:38.229987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:38.249284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.249791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.250684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:38.252340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.255393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.262927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:38.317922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Getting quotas for project c164b35071d044d2bd3ee89e0fd8e5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:38.329592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Getting quotas for user 1ac8d1e8a4b34947b3a98a4db4b058f9 and project c164b35071d044d2bd3ee89e0fd8e5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:38.368742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:38.375684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:38.526334 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4217b12f-36a7-4fec-8910-9cff6b4e1c5c tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218454 Aug 25 12:32:38.532396 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 230/462] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:32:38.563354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:38.565103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:38.592406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.600500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.601613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:38.603174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:38.605517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:38.609771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.105295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:39.168215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7c89a00-bd8b-4126-a3b0-b16b2bb74aa7 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.629529 Aug 25 12:32:39.187089 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 231/463] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:38 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:39.223440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:39.225140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:39.239612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.241708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.242754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.255589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.257032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.262905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.422266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:39.433800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84b883bb-24d2-4851-9e29-690f41830287 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 1.323404 Aug 25 12:32:39.449283 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 233/464] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:38 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:39.449283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:39.449283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:39.449764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.449983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.450727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.451914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.452760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.453433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.548799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:39.560517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:39.562535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:39.564154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47a08216-cd6f-4bbb-b518-82b85c43322d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1319 microversion: 2.25 time: 0.362315 Aug 25 12:32:39.565362 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 232/465] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:39 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:39.680136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:39.713123 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1faab099-a763-4210-ae70-8cacd7d52f5e tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1226 microversion: 2.1 time: 0.276630 Aug 25 12:32:39.739365 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 234/466] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:39 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:39.777689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:39.778854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:39.794604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.795921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.797082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:39.798764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:39.800631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:39.801830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.042220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1589198835", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:40.053988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:40.104172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-01f9b0d8-5869-478c-9381-9ce3c15528a5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 200 len: 1434 microversion: 2.1 time: 0.346249 Aug 25 12:32:40.110042 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 235/467] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:39 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 1434 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:40.132318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5d206a-082f-4d30-8ff3-22e721cd7346", "tag": "e6b4b06f-1538-4622-89db-7b721e2a8657"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:40.150944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.151805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.152618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.169919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:40.185121 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] Creating event network-changed:e6b4b06f-1538-4622-89db-7b721e2a8657 for instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 on n-h1-850468-18 Aug 25 12:32:40.198880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f56bd8fb-b2ea-4f32-ae4c-3579d4d0ab65 req-c92c004c-8ad3-4ed9-931c-6cb721ec63ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085815 Aug 25 12:32:40.199967 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 236/468] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:40.317928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34479828-a224-42ca-a1bf-4e0c9099b59c tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Calling method '.version_select at 0x7fc6c2e4eee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:40.435575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34479828-a224-42ca-a1bf-4e0c9099b59c tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 371 microversion: 2.1 time: 0.231350 Aug 25 12:32:40.436897 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 237/469] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 12:32:40 2022] GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:40.442663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8a4f29-0c78-49ad-a00d-426571af2570", "name": "network-vif-deleted", "tag": "40aa7bed-2437-4b13-bee2-752a24f2c2e0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:40.453046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.453529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.454248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.468427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] Creating event network-vif-deleted:40aa7bed-2437-4b13-bee2-752a24f2c2e0 for instance 3a8a4f29-0c78-49ad-a00d-426571af2570 on n-h2-850468-18 Aug 25 12:32:40.474588 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d72929bb-36a3-4ab4-a509-189371a77930 req-ef5d64c1-0f8f-485a-8d65-83868a83d0a6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Aug 25 12:32:40.475207 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 238/470] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:40.481222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:40.481506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:40.489010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.489532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.490113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.490833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.491386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.491897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.702414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:40.735014 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17786124-0be7-49eb-953c-88ca4e5762de tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.257837 Aug 25 12:32:40.736701 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 239/471] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:40 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:40.746210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2ea2ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:40.774923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:40.775945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:40.784598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:40.785793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:40.787182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:40.821921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.824634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.825793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.829156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.831610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.832839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.835725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.836452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.837024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.838015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.838735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.839239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.888635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Getting quotas for project f4c32956eae2487c947e88e086e7a862. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:40.899848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Getting quotas for user 4bad1a98ce0a461f83ab2d56b6b914bd and project f4c32956eae2487c947e88e086e7a862. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:40.923351 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f5b49de-8571-4ddd-aa27-1ad2fd0d54dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 328 microversion: 2.1 time: 0.181521 Aug 25 12:32:40.936149 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 240/472] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:40 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:40.936375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:40.936375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:40.936589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:40.936589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:40.950888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.950888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.950888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:40.950888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:40.952390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:40.953967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.036467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95665f2b-b431-45a3-89a3-0d2555c93c8e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469039 Aug 25 12:32:41.038382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 233/473] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:32:41.048367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:41.054969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:41.092619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.094173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.095113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.097965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.099043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.099974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.262173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.282237 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84be70d1-a5d9-4a25-aa3d-3afa5e5bbc9b tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 0.355572 Aug 25 12:32:41.283261 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 241/474] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:40 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:41.307549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:41.308383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:41.317168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.317769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.318292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.319203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.320378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.321148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.381465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.399832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.403673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.406292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc616ad2-66e2-4356-8337-37cd71776629 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.365792 Aug 25 12:32:41.407646 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 234/475] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:41 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:41.422087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a4e54e1-162c-4b8b-ac0a-84cea6d5755d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:41.422886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.423845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9a4e54e1-162c-4b8b-ac0a-84cea6d5755d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:41.436009 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9345de58-f563-4b24-95bc-8423b00b2d3f tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1282 microversion: 2.1 time: 0.135984 Aug 25 12:32:41.438108 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 242/476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:41 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:41.448648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:41.531245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9a4e54e1-162c-4b8b-ac0a-84cea6d5755d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:41.532889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2079049955", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:41.540646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a4e54e1-162c-4b8b-ac0a-84cea6d5755d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1223 microversion: 2.1 time: 0.131401 Aug 25 12:32:41.541419 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 235/477] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:41 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:41.546809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:41.548075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:41.556760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.557532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.558316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.559121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:41.559587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:41.560018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:41.577491 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 HTTP/1.1 Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:41.579919 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:32:41.583605 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3a8a4f29-0c78-49ad-a00d-426571af2570'} Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:41.584659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:32:41.586111 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:41.587372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:41.588789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5fa1b053-0527-4e50-afcf-a6fc377133e7 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 404 len: 111 microversion: 2.1 time: 0.045955 Aug 25 12:32:41.589570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 236/478] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:41 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:41.629241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:41.760492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2147065224", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:41.845663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:42.453771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:42.454682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:42.455697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:42.457621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:42.458526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:42.478032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.479139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.480087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.481711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.482654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.484393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.521775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:42.529851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for user ed4be15e1a6e42f8baf85843710d0737 and project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:42.554361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.utils [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] cores quota exceeded for d97073a5556247e9b20ed62c013cad3a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122700) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:32:42.555957 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Request method failure captured: Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 145 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vlfN53pfwxI9VNfnynoH4EceFUh64TdlDspUYpyAZgG0xXwJ-ZwJhFlr-6Gk5ZBYYRvN8-G9bSy2MknuL_aMtELPJmF0sNdsW-wY732UJnOkRmPMzOQnLX6a-VEeQFNx-Mbj2DwLYebMThFUkvF3tFjzScvntfG8CWgGFimm4UJA0 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:42.563577 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed4be15e1a6e42f8baf85843710d0737 Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2079049955", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} Aug 25 12:32:42.565226 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2079049955', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452'}}} Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:32:42.566203 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:42.568188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.570883 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c78dcbf-386d-4a87-be59-152bd0ce6ef2 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.126740 Aug 25 12:32:42.574079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 243/479] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:41 2022] POST /compute/v2.1/servers => generated 111 bytes in 1135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:42.583855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:42.585061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:42.591177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:42.606450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.607341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.608146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.609480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.610658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.611466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.919391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:42.941053 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-050e4ff2-c038-40d7-9a72-6b9108c1f82b tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.365331 Aug 25 12:32:42.941796 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 244/480] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:42 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:42.947000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:42.948354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:42.957177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.957863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.958405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.959222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:42.959688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:42.960278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:42.979063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:43.053194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:43.054947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:43.056026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:43.057005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:43.057748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:43.074314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.075034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.075768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.077047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.077745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.078324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.105588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Getting quotas for project 3cc1137442554b27baf8ff45e7f128fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:43.110481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Getting quotas for user b77b9267a82a4e74a77bccfc532227cb and project 3cc1137442554b27baf8ff45e7f128fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:43.127847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:32:43.131068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:32:43.188289 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85d7443b-c597-4898-8992-de74d42ae139 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436125 Aug 25 12:32:43.203018 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 237/481] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:32:43.214724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:43.217199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:43.242336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.243914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.246305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.248406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.249808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.250932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.310480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:43.696462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:43.713596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3cfd5e7-e7c2-40c7-a306-c7726ff32be1 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 0.770216 Aug 25 12:32:43.726348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 245/482] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:42 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:43.742402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:43.743724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:43.761855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.762725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.763526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.765201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:43.766058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:43.767091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:43.885614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:43.914375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:43.923107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:43.929180 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-185bd81f-82d5-41eb-8363-fc7750fe51d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.724557 Aug 25 12:32:43.963452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 238/483] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:43 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:43.985709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:43.986669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:44.006797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.007444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.008215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.012331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.013322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.019594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.225049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:44.244642 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2be904a1-df5a-4273-9c47-0c9df7b7e068 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1281 microversion: 2.1 time: 0.294136 Aug 25 12:32:44.245613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 239/484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:43 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1281 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:44.254601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2f989d0>, body: {"quota_set": {"cores": 20}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:44.382653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.384345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.386759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.389267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.391578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.394380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.519234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e11f6d5-4d7a-40c1-839c-98bd7387a184 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 329 microversion: 2.1 time: 0.271576 Aug 25 12:32:44.528671 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 240/485] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:44 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 329 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:44.540247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:44.541320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:44.555975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.556922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.557699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.558884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.559827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.560534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.638618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:44.654939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df134b7c-2648-4690-b97d-a49d8c5c0480 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 0.922059 Aug 25 12:32:44.655572 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 246/486] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:43 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:44.674161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:44.683396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:44.710158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.711244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.711244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.711894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:44.712392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:44.712986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:44.836709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:44.848270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c55d3d0-e3b5-4341-ad1e-02f998c8f2d1 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1272 microversion: 2.1 time: 0.315875 Aug 25 12:32:44.860681 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 241/487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:44 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:44.907597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ecc093d-79ae-4bbf-a821-bf8b1f6423de tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Calling method '.version_select at 0x7fc6c2f980d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:45.018108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ecc093d-79ae-4bbf-a821-bf8b1f6423de tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 371 microversion: 2.1 time: 0.128159 Aug 25 12:32:45.026020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 242/488] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 12:32:44 2022] GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:45.028311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:45.030559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:45.043113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:45.044107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:45.045664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:45.047826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:45.049442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:45.051618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:45.078891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:45.120570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a96fb76-036e-4c43-9de7-1f23a83eddeb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.450510 Aug 25 12:32:45.121840 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 247/489] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:44 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:45.139668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:45.141535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:45.155579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:45.157899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:45.158813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:45.160340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:45.161377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:45.162499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.435809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.445382 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73e72573-fc33-49f8-99a0-1ee2054cd5f7 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 1.424491 Aug 25 12:32:46.446117 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 243/490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:45 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:46.451551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2f980d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:46.461927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.481414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.485030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.487202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ecc92d7e-03da-4d26-a38b-0030b08f37cb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 1.363086 Aug 25 12:32:46.492621 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 248/491] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:45 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:46.498377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:46.499527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:46.510167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.510544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.510991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.512080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.512640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.513069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.534308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.535097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.535617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.536449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.536919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.537540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.596792 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b18eba6f-55c5-42f9-98d0-70a1ae7cdd36 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 328 microversion: 2.1 time: 0.148900 Aug 25 12:32:46.597874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 244/492] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:46 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:46.602840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a", "tag": "a1aa3406-3069-4cb3-b85d-b7a1eaac1978"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:46.613697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.614188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.614602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.628855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] Creating event network-changed:a1aa3406-3069-4cb3-b85d-b7a1eaac1978 for instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a on n-h1-850468-18 Aug 25 12:32:46.637764 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6be5e7c1-3ca7-4fe1-8544-d169f1740e89 req-13aa20c9-788c-4259-b014-07217cc31de5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037445 Aug 25 12:32:46.638058 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 245/493] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:46.649867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:46.650802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:46.666321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.667370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.668138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.669351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.670155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.670891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.718192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.734019 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-57fe2c1a-80c4-4d3a-8a1a-b8578c827b0a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1281 microversion: 2.1 time: 0.244245 Aug 25 12:32:46.734900 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 249/494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:46 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:46.743581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:46.744522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:46.754937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.755688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.756750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.758462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.760390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.762004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.924419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:46.943525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78c19612-eb00-4fae-b141-2cd76371e5ba tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1278 microversion: 2.1 time: 0.207179 Aug 25 12:32:46.944913 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 250/495] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:46 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:46.950472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:46.951396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:46.963263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.964731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.965950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:46.968389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:46.969514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:46.970540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:47.146565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:47.181037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-298d6518-d21b-4043-8f20-717be54e3543 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.234339 Aug 25 12:32:47.181372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:47.182722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 251/496] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:46 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:47.205592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1335585758", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:47.211039 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a6ece108-066a-45eb-8ac8-873c27475744 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 0.567097 Aug 25 12:32:47.230714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 246/497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:46 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:47.252359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4c57fc-07ea-4210-8211-f4fcbc2c6a62", "tag": "6fbd848b-4761-489b-af7c-e2c1399d1bda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:47.290091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:47.291371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:47.292758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:47.321153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:47.322171 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] Creating event network-changed:6fbd848b-4761-489b-af7c-e2c1399d1bda for instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 on n-h1-850468-18 Aug 25 12:32:47.333986 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5ff5e783-e342-4c5d-b3a4-000034f3488e req-90e79df2-8e1b-4c5a-8cce-5219418b9414 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100094 Aug 25 12:32:47.335502 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 247/498] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:47.348467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5d206a-082f-4d30-8ff3-22e721cd7346", "name": "network-vif-plugged", "status": "completed", "tag": "e6b4b06f-1538-4622-89db-7b721e2a8657"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:47.376769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:47.377524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:47.378851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:47.408682 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] Creating event network-vif-plugged:e6b4b06f-1538-4622-89db-7b721e2a8657 for instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 on n-h1-850468-18 Aug 25 12:32:47.418368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-04c20b66-60d1-459d-9aae-086ab1d7dee7 req-1ecad709-5f58-4442-844d-5f5facd9c6eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079400 Aug 25 12:32:47.419423 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 248/499] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:47.470743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:47.472611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:47.481896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:47.482618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:47.483369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:47.484668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:47.485388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:47.486109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.036883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:48.045808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1606019c-e76a-4685-98b0-9ab401172f2f tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 0.580940 Aug 25 12:32:48.046410 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 249/500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:47 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:48.058712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:48.058712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:48.061096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.061683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.062280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.063074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.063619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.064234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.231178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:48.231834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:48.232440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:48.233048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:48.233631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:48.245664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.246196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.246969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.247841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.248354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.248826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.271141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:48.283107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for user ed4be15e1a6e42f8baf85843710d0737 and project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:48.300475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.utils [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] instances quota exceeded for d97073a5556247e9b20ed62c013cad3a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122700) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:32:48.301285 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Request method failure captured: Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 145 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vlfN53pfwxI9VNfnynoH4EceFUh64TdlDspUYpyAZgG0xXwJ-ZwJhFlr-6Gk5ZBYYRvN8-G9bSy2MknuL_aMtELPJmF0sNdsW-wY732UJnOkRmPMzOQnLX6a-VEeQFNx-Mbj2DwLYebMThFUkvF3tFjzScvntfG8CWgGFimm4UJA0 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:48.303778 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed4be15e1a6e42f8baf85843710d0737 Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1335585758", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} Aug 25 12:32:48.305248 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1335585758', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452'}}} Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:32:48.305990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:48.307599 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.308975 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ef51130-56e0-4da9-9022-4f3d65c07a52 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.120855 Aug 25 12:32:48.312863 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 252/501] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:47 2022] POST /compute/v2.1/servers => generated 119 bytes in 1126 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:48.315345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:48.316617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:48.323408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.323915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.324552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.325400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.325871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.326301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.806678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:48.820062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:48.823303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:48.825545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b6fc1b01-ab8a-40b5-823d-588056f61d91 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.777717 Aug 25 12:32:48.826520 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 250/502] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:48 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:48.833790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:48.834493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:48.845841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.847191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.848017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.849718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.850550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.851290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.880565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:48.899772 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acd80436-0723-40cc-89a3-663f24f7f168 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.588324 Aug 25 12:32:48.901356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 253/503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:48 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:48.923407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:48.927006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:48.943505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.944654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.945308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:48.947159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:48.948696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:48.949489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:49.445936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:49.471300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34d459ec-87cf-4d15-93ea-25e72e6fe92d tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.567613 Aug 25 12:32:49.493706 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 254/504] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:48 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:49.506328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:49.506993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:49.515606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:49.516588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:49.517186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:49.517941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:49.519869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:49.520742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:49.995623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.011281 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89c52368-4073-40ca-8b0f-beb089356b9f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 1.182933 Aug 25 12:32:50.013970 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 251/505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:48 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:50.023966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2f980d0>, body: {"quota_set": {"instances": 10}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:50.120812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.121593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.122275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.123301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.123921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.124490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.223574 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09cdaba8-0b36-4bb1-8ab8-cfc095c290dc tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 329 microversion: 2.1 time: 0.206941 Aug 25 12:32:50.224665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 252/506] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:50 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:50.233219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:50.234635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:50.245646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.246326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.246839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.247672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.248271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.248782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.280908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.308919 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cdb16334-61b1-4eb4-8feb-e8036d67b9f8 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 0.812621 Aug 25 12:32:50.310282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 255/507] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:49 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:50.317854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:50.318645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:50.325539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.326465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.327321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.328334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.329024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.329671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.810779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.822097 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-924727f1-a3fa-4357-9e0d-7fc38c4635c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1313 microversion: 2.1 time: 0.595279 Aug 25 12:32:50.825211 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 253/508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:50 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:50.829062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:50.829692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:50.839011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.851508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.853055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:50.854230 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-252ec138-8b46-440f-a677-dabeb4acfca5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.542281 Aug 25 12:32:50.856424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.857151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.857759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.858365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:50.858807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:50.859429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:50.863859 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 256/509] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:50 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:50.870556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d7bda832-760c-4c49-9d72-2d4b9128d7a3 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Calling method '.version_select at 0x7fc6c2ec5af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:50.989133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d7bda832-760c-4c49-9d72-2d4b9128d7a3 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 371 microversion: 2.1 time: 0.123161 Aug 25 12:32:51.002080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 257/510] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 12:32:50 2022] GET /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:51.002080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:51.002080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:51.012634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.013529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.014316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.015637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.016815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.017577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.328524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:51.376052 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0035365-49be-42a1-a58c-136ab7737578 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.383675 Aug 25 12:32:51.388154 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 258/511] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:50 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:51.388154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb97fb3-76c4-4216-a69d-5efb28cd10b9", "tag": "0dc2c76d-5b4a-430a-a4d3-996466abb6d3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:51.405942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.406883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.416580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.435675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] Creating event network-changed:0dc2c76d-5b4a-430a-a4d3-996466abb6d3 for instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 on n-h2-850468-18 Aug 25 12:32:51.443861 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1836b2d8-c1ad-4e7d-acb9-6d8cbef4e26a req-895acdad-41b4-4582-9fa1-efc389c17184 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063784 Aug 25 12:32:51.445030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 259/512] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:51.455171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2dc3670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:51.500301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:51.520418 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e1cffa5-8e1c-4c65-adec-6fcffa294295 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.695794 Aug 25 12:32:51.522000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 254/513] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:50 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:51.532019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:51.533990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:51.547604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.548862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.550276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.551918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.552976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.553808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.576966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.577747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.578697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.579840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.580511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.581933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.661336 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d1fca4a-96b4-4441-b41a-d321d9986d24 tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 325 microversion: 2.1 time: 0.214435 Aug 25 12:32:51.662909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 260/514] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:51 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:51.676320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a", "name": "network-vif-plugged", "status": "completed", "tag": "a1aa3406-3069-4cb3-b85d-b7a1eaac1978"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:51.704874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.706909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.706909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.722260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] Creating event network-vif-plugged:a1aa3406-3069-4cb3-b85d-b7a1eaac1978 for instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a on n-h1-850468-18 Aug 25 12:32:51.733372 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0447703e-1e92-4246-bc0c-e345062f1656 req-61c66277-616d-4bc4-ba9f-1003fdc1cb1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064173 Aug 25 12:32:51.735326 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 261/515] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:51.746771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:51.748069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:51.756951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.757759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.758514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:51.759810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:51.760348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:51.761778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:52.651013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:52.674439 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a59ee263-30ff-4390-95c0-3da0a89f990c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 1.150410 Aug 25 12:32:52.677364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 255/516] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:51 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:52.699936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-516689830", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:52.776908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:32:52.863844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:52.874521 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d102467e-e034-478b-8c18-f361f953b012 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 1.135046 Aug 25 12:32:52.876075 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 262/517] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:51 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:52.885265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:52.886439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:52.902967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:52.903500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:52.904010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:52.904864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:52.905427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:52.906010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.356300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:53.376728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d8e1e9f-6f92-47b1-8100-9734614c0f65 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1463 microversion: 2.1 time: 0.499221 Aug 25 12:32:53.378858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 263/518] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:52 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1463 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:53.389296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:53.390369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:53.404095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.405018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.405809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.407013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.407813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.408618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.415950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:32:53.416315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:32:53.417441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:32:53.417441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:32:53.417877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:32:53.420822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:53.437629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.438108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.438708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.439701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.440902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.441479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.447876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:53.467800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:32:53.473973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Getting quotas for user ed4be15e1a6e42f8baf85843710d0737 and project d97073a5556247e9b20ed62c013cad3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:32:53.492711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.utils [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] ram quota exceeded for d97073a5556247e9b20ed62c013cad3a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122701) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 25 12:32:53.493702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Request method failure captured: Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 144 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vlfN53pfwxI9VNfnynoH4EceFUh64TdlDspUYpyAZgG0xXwJ-ZwJhFlr-6Gk5ZBYYRvN8-G9bSy2MknuL_aMtELPJmF0sNdsW-wY732UJnOkRmPMzOQnLX6a-VEeQFNx-Mbj2DwLYebMThFUkvF3tFjzScvntfG8CWgGFimm4UJA0 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:32:53.499294 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed4be15e1a6e42f8baf85843710d0737 Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-516689830", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} Aug 25 12:32:53.501341 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-516689830', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452'}}} Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 12:32:53.503803 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:53.506985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.510096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7dd68f27-096d-4707-9428-d9ab8b257b0b tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.822469 Aug 25 12:32:53.512815 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 256/519] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:32:52 2022] POST /compute/v2.1/servers => generated 110 bytes in 824 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:53.514216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:53.514911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:53.523440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.523993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.524486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.525253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.525726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.526209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.629200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:53.660940 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9e8bc16-7ec9-40be-90c1-6d0bbe4648ea tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.156482 Aug 25 12:32:53.661639 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 257/520] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:53 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:53.667026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:53.668009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:53.668957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:53.677792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:53.678141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.678832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.679460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:53.679645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.680859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.681084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12b3df51-4946-4f9d-9526-f7d7cde509b4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.299279 Aug 25 12:32:53.681679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.681852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 264/521] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:53 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:53.682652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.878675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:53.888539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Calling method '.version_select at 0x7fc6c2dc9e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:53.889698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8ba978e-6bf0-4109-877a-45365a218cba tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.226439 Aug 25 12:32:53.890485 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 258/522] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:53 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:53.899599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff7ca6d-857e-414a-af4a-40b8a38c8426", "tag": "f216e059-7f29-4fed-a2f3-1b9f129c3211"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:53.911519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.912812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.913614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.919926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.921016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.921808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.939163 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] Creating event network-changed:f216e059-7f29-4fed-a2f3-1b9f129c3211 for instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 on n-h2-850468-18 Aug 25 12:32:53.945512 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ea53fdd1-e0ee-4031-93dc-c76ae15c6be3 req-6595aafa-9e91-4d88-9287-5511f55438e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053015 Aug 25 12:32:53.946131 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 259/523] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:53.951620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2eed790>, body: {"quota_set": {"ram": 51200}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:53.955599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:53.956614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:53.957351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:53.993692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1aa6a2f-79f5-4903-80c4-5b6363ca366c tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/48251c26e6f44b2a9e57c610713449e0?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532" status: 200 len: 694 microversion: 2.1 time: 0.310275 Aug 25 12:32:53.994751 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 265/524] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Aug 25 12:32:53 2022] GET /compute/v2.1/os-simple-tenant-usage/48251c26e6f44b2a9e57c610713449e0?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532 => generated 694 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:54.012041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.013174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:54.025054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.025923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.026950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.028321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.029467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.030153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.043484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.044883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.045972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.047735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.048984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.050707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.155645 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e1ed559-9ed8-4753-a9f1-25bfe33d5faf tempest-QuotasAdminNegativeTest-2006401051 tempest-QuotasAdminNegativeTest-2006401051-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 200 len: 329 microversion: 2.1 time: 0.208208 Aug 25 12:32:54.161573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 260/525] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:53 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:54.163096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.164091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:54.180876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.181719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.182642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.183849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.185007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.188302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.511053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:54.521748 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-890dab2e-b83a-4fda-a741-1acd3fb66fa6 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.525414 Aug 25 12:32:54.522740 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 266/526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:53 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:54.528909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '.version_select at 0x7fc6c2dc9040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.539911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.540458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.541063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.553625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.554120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.554565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.570291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cd9d2bb-5dcd-4365-9c1f-f6770b06436e tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/48251c26e6f44b2a9e57c610713449e0?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532" status: 200 len: 694 microversion: 2.1 time: 0.046338 Aug 25 12:32:54.570891 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 267/527] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Aug 25 12:32:54 2022] GET /compute/v2.1/os-simple-tenant-usage/48251c26e6f44b2a9e57c610713449e0?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532 => generated 694 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:32:54.586917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dae17e2e-8b39-447f-bd2f-779e595912c5 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Action: 'update', calling method: .version_select at 0x7fc6c2dc30d0>, body: {"quota_set": {"ram": 0}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:54.593048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dae17e2e-8b39-447f-bd2f-779e595912c5 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ed4be15e1a6e42f8baf85843710d0737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd97073a5556247e9b20ed62c013cad3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dae17e2e-8b39-447f-bd2f-779e595912c5 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Request method failure captured: Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a HTTP/1.1 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 25 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vlfN53pfwxI9VNfnynoH4EceFUh64TdlDspUYpyAZgG0xXwJ-ZwJhFlr-6Gk5ZBYYRvN8-G9bSy2MknuL_aMtELPJmF0sNdsW-wY732UJnOkRmPMzOQnLX6a-VEeQFNx-Mbj2DwLYebMThFUkvF3tFjzScvntfG8CWgGFimm4UJA0 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:32:54.595734 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d97073a5556247e9b20ed62c013cad3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d97073a5556247e9b20ed62c013cad3a Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-151223978 Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed4be15e1a6e42f8baf85843710d0737 Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-QuotasAdminNegativeTest-151223978-project Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: {"quota_set": {"ram": 0}} Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:32:54.599415 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd97073a5556247e9b20ed62c013cad3a', 'body': {'quota_set': {'ram': 0}}} Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:32:54.601233 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:54.603674 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dae17e2e-8b39-447f-bd2f-779e595912c5 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dae17e2e-8b39-447f-bd2f-779e595912c5 tempest-QuotasAdminNegativeTest-151223978 tempest-QuotasAdminNegativeTest-151223978-project] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a" status: 403 len: 116 microversion: 2.1 time: 0.027000 Aug 25 12:32:54.609935 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 268/528] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:32:54 2022] PUT /compute/v2.1/os-quota-sets/d97073a5556247e9b20ed62c013cad3a => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:32:54.614871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Calling method '.version_select at 0x7fc6c2ec59d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.627330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.628586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.629134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.651323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.652183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.653895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.712102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3eeefefe-13e7-4660-a379-a93e16f54460 tempest-TenantUsagesTestJSON-211677062 tempest-TenantUsagesTestJSON-211677062-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532&detailed=1" status: 200 len: 5206 microversion: 2.1 time: 0.103222 Aug 25 12:32:54.713138 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 269/529] 10.222.0.60 () {58 vars in 1335 bytes} [Thu Aug 25 12:32:54 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A32%3A53.395532&end=2022-08-26T12%3A32%3A53.395532&detailed=1 => generated 5206 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:54.746350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.746939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:54.748038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:54.753690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:54.759174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.759988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.760745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.761941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.762754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.763788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.766061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec589248-e1dd-4618-859b-5a3ca1e72930 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 0.607934 Aug 25 12:32:54.768055 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 261/530] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:54 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:54.776787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:54.788679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:54.806721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.812682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.813190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.814197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:54.814936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:54.815402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:54.969908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:55.019813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e58c7648-357c-455c-a558-d803bd0c6ceb tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.288494 Aug 25 12:32:55.020556 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 270/531] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:54 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:55.034566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:55.035015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:55.042610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.043219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.043741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.044583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.045195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.045734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.081304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:32:55.095425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.105620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.107297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.108813 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00c2a94a-7dc2-4b2b-ad74-16d5f7159094 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.339077 Aug 25 12:32:55.109480 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 262/532] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:54 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:55.115757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:55.116795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:55.123382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.124345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.125025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.125953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.126485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.127146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.204251 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f813f3b-1180-4374-bcd7-61159855d303 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 204 len: 0 microversion: 2.1 time: 0.182051 Aug 25 12:32:55.208411 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 271/533] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:32:55 2022] DELETE /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:32:55.217854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:55.219006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:55.226519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.227074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.227597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.228378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.228917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.229272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.393329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.406230 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0bd20817-3a90-43ee-b6eb-53252243a59c tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.295089 Aug 25 12:32:55.406864 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 263/534] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:55 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:55.466460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.503916 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21e6e0e9-cc93-4686-a89a-8bc6e7a062ba tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1469 microversion: 2.1 time: 0.291034 Aug 25 12:32:55.509736 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 272/535] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:55 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:55.557597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:55.558703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:55.567249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.567902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.568889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.569748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.570278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.570912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.770162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:55.786585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1a6d6ed-4c75-4139-b806-b4e0d09c3c0e tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.233886 Aug 25 12:32:55.787672 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 264/536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:55 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:55.790430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:55.790973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:55.805926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.806692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.807650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.809283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:55.810807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:55.811649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:55.989828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:56.006434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eaec14aa-4e1b-4407-bda0-eaad5a55ecf2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1322 microversion: 2.1 time: 0.220523 Aug 25 12:32:56.021196 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 273/537] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:55 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:56.053805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:56.054921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:56.067031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.068303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.069542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.071342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.072393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.073082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.146541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:56.148013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:56.154941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:32:56.164044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.165516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.166619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.168179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.169267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.170248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.266157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:56.290791 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c4174c3f-4349-445e-971d-f6c4f4f9355e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1931 microversion: 2.75 time: 0.245928 Aug 25 12:32:56.292275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 265/538] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:56 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:56.434922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:56.436836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:56.452524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.453399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.454200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.455455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.456923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.457720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.817205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:56.833831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:56.837564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:56.839808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d66b3470-bcfe-426c-b0e5-ab4691fcf683 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.706491 Aug 25 12:32:56.844246 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 274/539] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:56 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:32:56.850952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:56.851927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:56.868369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.869877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.871920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.873849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.874606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.875432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.893276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:56.902915 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-949f93e8-098c-4007-9875-895713b9c282 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.475523 Aug 25 12:32:56.903849 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 266/540] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:56 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:56.931931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:56.933050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:56.943226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.943946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.944573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:56.945503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:56.946321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:56.947444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:57.762672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:57.772247 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0cd9183-4d19-4094-b330-4fd56cf2bd5d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.867218 Aug 25 12:32:57.773263 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 267/541] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:56 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:57.774899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:57.778610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:57.779259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:57.795033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:57.797998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:57.798368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f70824e7-9168-4fdd-bf9a-66899b647726 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1469 microversion: 2.1 time: 0.955276 Aug 25 12:32:57.799301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:57.803453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:57.804577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:57.808625 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 275/542] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:56 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1469 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:57.808968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:57.814546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:57.815665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:57.827001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:57.827822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:57.828596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:57.830210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:57.831757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:57.832965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:57.968033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:58.021939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-130ff825-e147-4598-9ed1-36cf82453455 tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1937 microversion: 2.75 time: 0.214963 Aug 25 12:32:58.023552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 276/543] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:57 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1937 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:58.031297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:58.032378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:58.055795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:58.065226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.065999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.068408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.071198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.072469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.073347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.073882 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6f1fea9-2c68-4682-917b-fd314747b432 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1472 microversion: 2.1 time: 0.298835 Aug 25 12:32:58.074925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 268/544] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:57 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:58.084434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:58.085886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:58.106768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.107433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.108659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.109559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.110106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.110602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.363836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:58.380109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:58.385413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:58.387994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d86c172a-6758-45bb-af5f-5d7ef51c84e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.362013 Aug 25 12:32:58.395500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:58.405526 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 277/545] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:32:58 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:32:58.415823 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80b0802d-6287-47bd-a8fe-e81e768165dc tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.336923 Aug 25 12:32:58.418155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:32:58.418702 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 269/546] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:58 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:32:58.419315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:58.428036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.428584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.429009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.429745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.431538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.431982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.546105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lazy-loading 'flavor' on Instance uuid 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:32:58.714461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17fcc995-3500-41ea-8327-b89dced93ae4 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a/action" status: 202 len: 0 microversion: 2.1 time: 0.301918 Aug 25 12:32:58.715246 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 278/547] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:32:58 2022] POST /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:32:58.731537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:58.739350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:58.775811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.779563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.780824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.783352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.788243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.789077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.825203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:58.826652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:58.850197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.850987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.851772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:58.853094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:58.860521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:58.861973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:59.495182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:32:59.506098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08c69991-5c6d-47de-8f50-1a6cec01ba9d tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.685542 Aug 25 12:32:59.507175 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 279/548] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:58 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:32:59.516923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:32:59.517767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:32:59.532342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:59.533271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:59.536515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:59.538928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:32:59.540784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:32:59.542078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:32:59.554273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:00.121617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b897fff-3b09-492d-bf12-8e39696b3093 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1633 microversion: 2.1 time: 1.401196 Aug 25 12:33:00.129055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b472bfcfc9864367977e13edfe1e2b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48251c26e6f44b2a9e57c610713449e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:00.134785 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 270/549] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:58 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1633 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:00.150101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8038f376-ce5e-4d8f-bd1a-c582e9cd7f5a tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 200 len: 1469 microversion: 2.1 time: 0.641257 Aug 25 12:33:00.151144 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 280/550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:32:59 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 1469 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:00.153663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb97fb3-76c4-4216-a69d-5efb28cd10b9", "name": "network-vif-plugged", "status": "completed", "tag": "0dc2c76d-5b4a-430a-a4d3-996466abb6d3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:00.171790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.186289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.187490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.200369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:00.203225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:00.233799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] Creating event network-vif-plugged:0dc2c76d-5b4a-430a-a4d3-996466abb6d3 for instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 on n-h2-850468-18 Aug 25 12:33:00.243931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.246925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.248106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.249854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.253315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.255235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.258056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ec34bc34-3ddf-4300-b662-772987070a8b req-e34ed72e-5af6-4bc4-8993-d2b2c8b38700 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115965 Aug 25 12:33:00.265132 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 271/551] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:00.282552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:00.288575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:00.314892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.317927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.320958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.324432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.325654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.328722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.727586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] Lazy-loading 'services' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:00.781429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebea65b2-a866-4b8c-a994-307e4de9198e tempest-ServersAdmin275Test-1108447874 tempest-ServersAdmin275Test-1108447874-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1922 microversion: 2.75 time: 0.596316 Aug 25 12:33:00.782378 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 281/552] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:00 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1922 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:00.790194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:00.791508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:00.800970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.802212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.803099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.804704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:00.805854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:00.806542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:00.987529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:01.006557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:01.008376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:01.009618 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39f07338-952d-4ccc-b01c-a710014f08ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.742212 Aug 25 12:33:01.010205 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 272/553] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:00 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:01.025362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:01.026183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:01.046281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.049955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.050702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.053075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.056081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.056777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.206379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:01.220626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d4cb52b-f69e-403e-ade8-9e956061321d tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1323 microversion: 2.1 time: 0.436775 Aug 25 12:33:01.228631 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 282/554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:00 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:01.245462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5d206a-082f-4d30-8ff3-22e721cd7346", "name": "network-vif-deleted", "tag": "e6b4b06f-1538-4622-89db-7b721e2a8657"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:01.278451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.279322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.280056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.298722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] Creating event network-vif-deleted:e6b4b06f-1538-4622-89db-7b721e2a8657 for instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 on n-h1-850468-18 Aug 25 12:33:01.319297 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2cefff4f-311a-4f96-a137-2c471ed3e031 req-313ecd87-1e5a-468f-91e2-d588b83b8064 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082937 Aug 25 12:33:01.320808 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 283/555] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:01.333059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:01.336424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:01.384574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.388204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.390733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.396587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.397375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.398416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.439474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:01.457373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c98a3b78-162d-4dd7-9587-5a28862a167c tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.440404 Aug 25 12:33:01.462353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:01.473549 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 273/556] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:01 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:01.508718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:01.524957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:01.554050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.556038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.556960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.562333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.567622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.569463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.650376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=44 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:01.727779 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5dca1e0e-d8c1-4a95-9c0f-994fcdd686d4 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 204 len: 0 microversion: 2.75 time: 0.404244 Aug 25 12:33:01.733990 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 284/557] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:33:01 2022] DELETE /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:33:01.753345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:01.757258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] [instance: 7f5d206a-082f-4d30-8ff3-22e721cd7346] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:01.770837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.771859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.772860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.774634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.775782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.777082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.808924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] HTTP exception thrown: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Request method failure captured: Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 HTTP/1.1 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vaBbidPTRgBQBJHI_Cqvc5SDEkvboXug2hRm0kclePQB9r6CF4yhvR6lZUII6z5STsvdLctYAoTqK-rvZTJzpVGkYyp-kfO7YlSxUuxl3vDBN_TVKxx05zblunFs2pN57ffYvqngrofWWNk9nm1zUYkCS0xG5r2E_vZqxgymro86w Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 48251c26e6f44b2a9e57c610713449e0 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TenantUsagesTestJSON-401444625 Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:01.812840 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48251c26e6f44b2a9e57c610713449e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48251c26e6f44b2a9e57c610713449e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48251c26e6f44b2a9e57c610713449e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48251c26e6f44b2a9e57c610713449e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TenantUsagesTestJSON-401444625 Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 48251c26e6f44b2a9e57c610713449e0 Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TenantUsagesTestJSON-401444625 Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TenantUsagesTestJSON-401444625-project Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b472bfcfc9864367977e13edfe1e2b48 Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TenantUsagesTestJSON-401444625-project Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. Aug 25 12:33:01.821184 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7f5d206a-082f-4d30-8ff3-22e721cd7346'} Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:01.822976 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. Aug 25 12:33:01.826504 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:01.829048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] Returning 404 to user: Instance 7f5d206a-082f-4d30-8ff3-22e721cd7346 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:01.829048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-525c03d0-467b-461e-9ad1-c56ddce675c4 tempest-TenantUsagesTestJSON-401444625 tempest-TenantUsagesTestJSON-401444625-project] 10.222.0.60 "GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346" status: 404 len: 111 microversion: 2.1 time: 0.080479 Aug 25 12:33:01.829048 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 285/558] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:01 2022] GET /compute/v2.1/servers/7f5d206a-082f-4d30-8ff3-22e721cd7346 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:01.847204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:01.848799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:01.866918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.868260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.869258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:01.870974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:01.872295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:01.874040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.027577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-143861b2-c639-415a-a6ed-04767a9adc6a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1616 microversion: 2.1 time: 0.549810 Aug 25 12:33:02.029414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 274/559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:01 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1616 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:02.043772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.052152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:02.055106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:02.079956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.085247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.086806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.094860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.096147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.100387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.108953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.121618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.157148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f9d1c78-ce01-4d8a-8050-e8f298328293 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1444 microversion: 2.75 time: 0.319731 Aug 25 12:33:02.160253 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 286/560] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:01 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1444 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:02.206419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:02.213258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:02.273464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.274847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.276073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.277736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.279379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.281593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.530618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] HTTP exception thrown: Cannot 'migrate' instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a while it is in vm_state suspended Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Request method failure captured: Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a/action HTTP/1.1 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vCBn26HZgIRU2BBnUllu2TEQPkEQhUO4mrDJsBDMnBveVvQz3dpcbAKxD4t56ObLxQ7sDySd1pPb7OZHOV4i8i5MyqiYsM2XinKWixhWYfO7m4fMFqsPmIfRJhvlLEYm3dSXRGSK9OLPxFIE1r5ainaMQut-tPtVeDtKhhACoVOs8 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:02.534952 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a18364790d324a329649ee3bc9f81aee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9e259db9ab0446c1a0ee82fe993e4d8f Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: {"migrate": {}} Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:02.538025 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'migrate' instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a while it is in vm_state suspended Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a', 'body': {'migrate': {}}} Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a in vm_state suspended. Cannot resize while the instance is in this state. Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:02.539489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a while it is in vm_state suspended Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:02.543774 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:02.549775 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:02.549775 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:02.549775 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a while it is in vm_state suspended Aug 25 12:33:02.549775 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:02.551493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Returning 409 to user: Cannot 'migrate' instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a while it is in vm_state suspended {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:02.553481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6f05646a-8df8-4299-b570-2a2320839530 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a/action" status: 409 len: 148 microversion: 2.1 time: 0.391472 Aug 25 12:33:02.555272 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 287/561] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:33:02 2022] POST /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a/action => generated 148 bytes in 394 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:02.564583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:02.566206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:02.580494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.582561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.583694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.585370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.586897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.588677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.611508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.633020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.637892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:02.640495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24c5c82c-f321-442a-b9e5-3ca50653d125 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.596020 Aug 25 12:33:02.642169 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 275/562] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:02 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:02.686807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff7ca6d-857e-414a-af4a-40b8a38c8426", "name": "network-vif-plugged", "status": "completed", "tag": "f216e059-7f29-4fed-a2f3-1b9f129c3211"}, {"server_uuid": "0c4c57fc-07ea-4210-8211-f4fcbc2c6a62", "name": "network-vif-plugged", "status": "completed", "tag": "6fbd848b-4761-489b-af7c-e2c1399d1bda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:02.703777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.704312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.704755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.723136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Creating event network-vif-plugged:f216e059-7f29-4fed-a2f3-1b9f129c3211 for instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 on n-h2-850468-18 Aug 25 12:33:02.724047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] Creating event network-vif-plugged:6fbd848b-4761-489b-af7c-e2c1399d1bda for instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 on n-h1-850468-18 Aug 25 12:33:02.736884 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a4a1cebc-4b31-47ad-a72f-9ac6cd9e9f04 req-e4571055-91fd-483a-a5b7-48049cc739e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091415 Aug 25 12:33:02.738533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 276/563] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:02.747547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:02.749275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:02.757716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.758494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.759134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:02.760525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:02.760988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:02.761492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.248246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.260203 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1baf545c-dd5c-4b1e-a4c0-8692aca0d28e tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1473 microversion: 2.1 time: 0.702752 Aug 25 12:33:03.273237 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 288/564] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:02 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1473 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:03.285797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be0dc10b-3af1-4966-95fc-cf948838718f tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be0dc10b-3af1-4966-95fc-cf948838718f tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Request method failure captured: Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action HTTP/1.1 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 39 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vCBn26HZgIRU2BBnUllu2TEQPkEQhUO4mrDJsBDMnBveVvQz3dpcbAKxD4t56ObLxQ7sDySd1pPb7OZHOV4i8i5MyqiYsM2XinKWixhWYfO7m4fMFqsPmIfRJhvlLEYm3dSXRGSK9OLPxFIE1r5ainaMQut-tPtVeDtKhhACoVOs8 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:03.290494 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a18364790d324a329649ee3bc9f81aee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9e259db9ab0446c1a0ee82fe993e4d8f Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: {"os-resetState": {"state": "invalid"}} Aug 25 12:33:03.293224 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85605dc4-6c51-4322-aae9-0eb2a0e502bf', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.294729 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:33:03.304738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be0dc10b-3af1-4966-95fc-cf948838718f tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be0dc10b-3af1-4966-95fc-cf948838718f tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action" status: 400 len: 144 microversion: 2.1 time: 0.018770 Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 289/565] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:33:03 2022] POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:03.307619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:03.315966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.316844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.317437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.318373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.318949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.319508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.450261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.465856 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f996cd5-aa59-4474-9015-fda1df4bb8c5 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.725151 Aug 25 12:33:03.482422 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 277/566] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:02 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:03.487907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.489012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:03.489540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:03.499362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.499878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.500363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.501150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.501842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.502497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.508908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.513016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.523404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a5114e3-a79f-43e1-9a54-cb8ccecfaec9 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1444 microversion: 2.75 time: 0.225018 Aug 25 12:33:03.530291 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 290/567] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:03 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:03.536326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c78d104-4b37-493f-91b6-747ee9c821b3 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c78d104-4b37-493f-91b6-747ee9c821b3 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Request method failure captured: Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action HTTP/1.1 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 31 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vCBn26HZgIRU2BBnUllu2TEQPkEQhUO4mrDJsBDMnBveVvQz3dpcbAKxD4t56ObLxQ7sDySd1pPb7OZHOV4i8i5MyqiYsM2XinKWixhWYfO7m4fMFqsPmIfRJhvlLEYm3dSXRGSK9OLPxFIE1r5ainaMQut-tPtVeDtKhhACoVOs8 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:03.541603 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a18364790d324a329649ee3bc9f81aee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9e259db9ab0446c1a0ee82fe993e4d8f Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: {"os-resetState": {"state": 1}} Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:03.544838 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85605dc4-6c51-4322-aae9-0eb2a0e502bf', 'body': {'os-resetState': {'state': 1}}} Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 1 Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:03.546779 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 25 12:33:03.552881 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.557979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c78d104-4b37-493f-91b6-747ee9c821b3 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:03.557979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c78d104-4b37-493f-91b6-747ee9c821b3 tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action" status: 400 len: 120 microversion: 2.1 time: 0.011981 Aug 25 12:33:03.557979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 291/568] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:33:03 2022] POST /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:03.558765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Request method failure captured: Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9/diagnostics HTTP/1.1 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vkxmlSK2nNQPat1ZGVI_-Cw_2GMA6XmHUCe0aVlTm1f92M9j9bECvGKVOZwu3PSQvzCvsMe_lotsPF2tyiGfwh9qmRMOJvfxXQIVL3WBOt9z6AqYb1oZlt7cEtgRFpZBdEE1FM3PMBIdic2J_GMz8JaKo1znWUMRa_3OleBP83cJI Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: f4c32956eae2487c947e88e086e7a862 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:03.562337 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4c32956eae2487c947e88e086e7a862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: f4c32956eae2487c947e88e086e7a862 Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiagnosticsNegativeTest-574583458-project Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4bad1a98ce0a461f83ab2d56b6b914bd Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-574583458-project Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:03.569360 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': '6fb97fb3-76c4-4216-a69d-5efb28cd10b9'} Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:03.570825 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.573378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:03.575948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9874558f-6f58-4447-b19e-104f9822c4b9 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.086632 Aug 25 12:33:03.575948 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 278/569] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:33:03 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9/diagnostics => generated 117 bytes in 89 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Failed to fetch instance by id 999 {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Request method failure captured: Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 37 Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vCBn26HZgIRU2BBnUllu2TEQPkEQhUO4mrDJsBDMnBveVvQz3dpcbAKxD4t56ObLxQ7sDySd1pPb7OZHOV4i8i5MyqiYsM2XinKWixhWYfO7m4fMFqsPmIfRJhvlLEYm3dSXRGSK9OLPxFIE1r5ainaMQut-tPtVeDtKhhACoVOs8 Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:03.578218 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a18364790d324a329649ee3bc9f81aee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a18364790d324a329649ee3bc9f81aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a18364790d324a329649ee3bc9f81aee Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1311015935 Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9e259db9ab0446c1a0ee82fe993e4d8f Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1311015935-project-admin Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:03.581211 n-d-850468-18 devstack@n-api.service[122700]: {"os-resetState": {"state": "error"}} Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 999 could not be found. Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:03.585001 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:03.588187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:03.590915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dcf2ec1f-478c-42e6-b195-8c116bb8282a tempest-ServersAdminNegativeTestJSON-1311015935 tempest-ServersAdminNegativeTestJSON-1311015935-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025875 Aug 25 12:33:03.602974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:03.603807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:03.614670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 292/570] 10.222.0.60 () {60 vars in 1179 bytes} [Thu Aug 25 12:33:03 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:33:03.624935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:03.626138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:03.634592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.635455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.637264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.638711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.639690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.640595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.646619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.651987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.654753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.656652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.659301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.660519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.700585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:03.707213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:03.749577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:03.879201 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74cddcbf-1576-40f4-bf3c-87d93a9dccb3 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 204 len: 0 microversion: 2.1 time: 0.291808 Aug 25 12:33:03.884784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 279/571] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:03 2022] DELETE /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:03.898457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:03.899575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:03.919493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.919493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.919493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:03.919493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:03.920202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:03.920202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.008474 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9f3fdf9c-5ede-44f4-9219-2cd6a6d2925a tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "DELETE /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 204 len: 0 microversion: 2.1 time: 0.390400 Aug 25 12:33:04.009352 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 293/572] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:03 2022] DELETE /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:04.026041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:04.028297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:04.045519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.047800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.050929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.052326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.053214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.054040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.075420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:04.148946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=72 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:04.308336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.334263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.337721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.339976 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c4a5d08-d0c1-484e-b1a7-3b1681e8a533 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.451921 Aug 25 12:33:04.344320 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 280/573] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:03 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:04.355383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:04.357919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:04.383901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.385361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.386487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.388011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.390095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.390936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.421576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.449448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42f80ec0-b289-4541-a882-28ff52bec1ab tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1479 microversion: 2.1 time: 0.437269 Aug 25 12:33:04.452469 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 294/574] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:04 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1479 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:04.512178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:04.516248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:04.542628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.543520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.544379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.549879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.550863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.551659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.643820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:04.785889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.814234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c769fd9-0c91-49e3-ab30-3a45a0c6b870 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1469 microversion: 2.1 time: 0.471220 Aug 25 12:33:04.820865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 281/575] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:04 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1469 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:04.828454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:04.829088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:04.850876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.851387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.851831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.853003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:04.854700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:04.858272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:04.905708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:04.919222 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20792bdf-f9de-4801-9824-75e805b9981f tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.414918 Aug 25 12:33:04.921304 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 295/576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:04 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:04.988899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.006281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.009663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.020006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d036aa1-202e-4039-bdbb-3dfd71c4bf66 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1444 microversion: 2.75 time: 0.197571 Aug 25 12:33:05.021461 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 282/577] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:04 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1444 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:05.387390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:05.390097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:05.406070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.407642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.408714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:05.410588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.411676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.413019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:05.498174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:05.499235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:05.523018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.524341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.525400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:05.527314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.528498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.529582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:05.781582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.792690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.794549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.795937 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e4bed2c-e3ed-42da-8b74-6ecdee342ae7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1361 microversion: 2.25 time: 0.415523 Aug 25 12:33:05.796771 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 296/578] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:05 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:33:05.823585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:05.833900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4542cc4-3483-41ac-806c-c8138c48e9a5 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1479 microversion: 2.1 time: 0.345097 Aug 25 12:33:05.834710 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 283/579] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:05 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:05.856906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:05.858379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:05.888239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.889293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.889857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:05.890678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:05.891244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:05.892017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.280247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:06.322100 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73848ff9-6feb-47f0-9d1a-aa58838ed2a2 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1469 microversion: 2.1 time: 0.464868 Aug 25 12:33:06.341023 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 284/580] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:05 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1469 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:06.349412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:06.354482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:06.354876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:06.366240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.367020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.367825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.367983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.368994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.369822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.369958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.370652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.371280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.372957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.374874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.378883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.447882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6c5a186-0928-4937-a3fb-00501b715727 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.649471 Aug 25 12:33:06.449100 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 297/581] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:33:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:06.459596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:06.461135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:06.474665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.475537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.476457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.477987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.479524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.480665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.520794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:06.546028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.546836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.547347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.548061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lazy-loading 'fault' on Instance uuid d55c8c7d-addf-4948-ba55-bd6951b80b99 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:06.672812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:06.692186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:06.695329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50683305d95349b39b2453da68daed22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9862f5435ef44ec797690ed4455bc86f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:06.713870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-518a70ae-9eb4-4354-8784-9e614590c6e8 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 200 len: 1449 microversion: 2.75 time: 0.262339 Aug 25 12:33:06.717353 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 298/582] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:06 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 1449 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:06.727507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:06.742804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.745655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.746428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.747585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.751763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.753697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.789928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:06.801238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ecece3c5-b395-4df0-b987-f214f883fa17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1320 microversion: 2.1 time: 0.457383 Aug 25 12:33:06.803005 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 285/583] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:06 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:06.811112 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d438e3d8-f4a8-4d88-8d1e-ace6f4ab58bb tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-850468-18" status: 200 len: 581 microversion: 2.1 time: 0.090652 Aug 25 12:33:06.822477 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 299/584] 10.222.0.60 () {58 vars in 1174 bytes} [Thu Aug 25 12:33:06 2022] GET /compute/v2.1/os-services?host=n-d-850468-18 => generated 581 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:06.828004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:06.828723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:06.856390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.857867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.859025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:06.864030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:06.865843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:06.866718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.000526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e34083e3-1dd5-4086-b691-406f9ca9146e tempest-ListImageFiltersNegativeTestJSON-183002151 tempest-ListImageFiltersNegativeTestJSON-183002151-project] Calling method '.version_select at 0x7fc6c2e87430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:07.029364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e34083e3-1dd5-4086-b691-406f9ca9146e tempest-ListImageFiltersNegativeTestJSON-183002151 tempest-ListImageFiltersNegativeTestJSON-183002151-project] HTTP exception thrown: Image not found. Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e34083e3-1dd5-4086-b691-406f9ca9146e tempest-ListImageFiltersNegativeTestJSON-183002151 tempest-ListImageFiltersNegativeTestJSON-183002151-project] Request method failure captured: Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/6b44d15f-f69a-4546-b91f-255ba2616bba HTTP/1.1 Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wCuzhU_wyYJrDIAGSjE63tG71avrS_V_GATP1FaRrsYL3wKi4uJJz9UBQCIU-4CUR4b7q1OHsHUxvyTw7Zrqg0hwNbsfAK5Y7TD19pNFm4s0sCqIsfrz1eiNDkIWtNTMmTrz0II_uAKdd-f5YiD06JCDSFKjvcLlznFuhIfBylYTY Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: f6aeec0366b447ea8c7136f2bb66061c Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-183002151 Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:07.052627 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f6aeec0366b447ea8c7136f2bb66061c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f6aeec0366b447ea8c7136f2bb66061c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6aeec0366b447ea8c7136f2bb66061c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f6aeec0366b447ea8c7136f2bb66061c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-183002151 Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: f6aeec0366b447ea8c7136f2bb66061c Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-183002151 Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListImageFiltersNegativeTestJSON-183002151-project Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b4dbba7104b74766b29c8e43af0e5f83 Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-183002151-project Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6b44d15f-f69a-4546-b91f-255ba2616bba'} Aug 25 12:33:07.054709 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:33:07.055675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6b44d15f-f69a-4546-b91f-255ba2616bba Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:33:07.057002 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b44d15f-f69a-4546-b91f-255ba2616bba could not be found. Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:07.058297 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:07.059393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e34083e3-1dd5-4086-b691-406f9ca9146e tempest-ListImageFiltersNegativeTestJSON-183002151 tempest-ListImageFiltersNegativeTestJSON-183002151-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:07.060582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e34083e3-1dd5-4086-b691-406f9ca9146e tempest-ListImageFiltersNegativeTestJSON-183002151 tempest-ListImageFiltersNegativeTestJSON-183002151-project] 10.222.0.60 "GET /compute/v2.1/images/6b44d15f-f69a-4546-b91f-255ba2616bba" status: 404 len: 62 microversion: 2.1 time: 0.249912 Aug 25 12:33:07.060582 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 286/585] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:33:06 2022] GET /compute/v2.1/images/6b44d15f-f69a-4546-b91f-255ba2616bba => generated 62 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:07.062173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:07.069197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.072002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.073194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.074521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.075433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.076445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.132471 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddb2da7c-0a47-4d6e-a79b-705b94028d51 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.074333 Aug 25 12:33:07.133100 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 287/586] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:33:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:07.140632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:07.142041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:07.150610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.151733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.152481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.153524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.154271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.154771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.363168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bad1a98ce0a461f83ab2d56b6b914bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c32956eae2487c947e88e086e7a862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:07.386081 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-86652c8f-fd4c-4679-81e9-6c1e4c65055a tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 200 len: 1437 microversion: 2.1 time: 0.250887 Aug 25 12:33:07.387165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 288/587] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:07 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 1437 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:07.397098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:07.403802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.404699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.405912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.407478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.408385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.410334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.454044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:07.501554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:07.509030 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6b77aa8d-75da-48bf-8a79-a5368e7bb2b8 tempest-ServicesAdminTestJSON-393716170 tempest-ServicesAdminTestJSON-393716170-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.119549 Aug 25 12:33:07.510720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 289/588] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:33:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:07.520764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:07.521975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:07.524515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:07.526156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:07.527546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d7ecd4dd-6302-4ea9-ba3f-02ad24d524a8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1558 microversion: 2.25 time: 0.703694 Aug 25 12:33:07.532151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 300/589] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:06 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1558 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:07.545566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb97fb3-76c4-4216-a69d-5efb28cd10b9", "name": "network-vif-deleted", "tag": "0dc2c76d-5b4a-430a-a4d3-996466abb6d3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:07.568059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.570908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.571931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.573581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.574768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.575502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.587908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:07.588798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:07.588798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:07.635563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] Creating event network-vif-deleted:0dc2c76d-5b4a-430a-a4d3-996466abb6d3 for instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 on n-h2-850468-18 Aug 25 12:33:07.655442 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6cd54d12-b22a-4541-86dd-02fc7e4b9f8e req-e9c0a69c-b3df-48a0-bc44-9de1d7c7fca6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113168 Aug 25 12:33:07.658147 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 301/590] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:07.969761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:08.010169 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc3da842-9e88-4f12-85c4-acca3ef08b13 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 200 len: 1469 microversion: 2.1 time: 0.493215 Aug 25 12:33:08.011287 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 290/591] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:07 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:08.034887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:08.036835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] [instance: d55c8c7d-addf-4948-ba55-bd6951b80b99] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.063262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.075699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.077673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.087665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.089257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.090641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.143886 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] HTTP exception thrown: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Request method failure captured: Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 HTTP/1.1 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2utFFWARNer06jT66EJrd34dibVO9pBQqxn_bb_XrymgRjh5s7MIcvJo1hmDuS-ZgrrvhGY2BKD78HxL3YLxQUMgUtQ2UG6vJa2slSi4k6y3XHfLOQqNTQX5k2oguxbDYprHVlH7d_DCze8SqobxDDcI3odXeJ7I5hFuMsPisAuhVQ Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.75 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9862f5435ef44ec797690ed4455bc86f Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersAdmin275Test-413144738 Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:08.163260 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9862f5435ef44ec797690ed4455bc86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9862f5435ef44ec797690ed4455bc86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9862f5435ef44ec797690ed4455bc86f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9862f5435ef44ec797690ed4455bc86f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersAdmin275Test-413144738 Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9862f5435ef44ec797690ed4455bc86f Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersAdmin275Test-413144738 Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersAdmin275Test-413144738-project Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 50683305d95349b39b2453da68daed22 Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersAdmin275Test-413144738-project Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. Aug 25 12:33:08.165890 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd55c8c7d-addf-4948-ba55-bd6951b80b99'} Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:08.167286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. Aug 25 12:33:08.169525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.185497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] Returning 404 to user: Instance d55c8c7d-addf-4948-ba55-bd6951b80b99 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:08.193139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9591f3c9-7c6b-4d73-b256-1fec0276b9a7 tempest-ServersAdmin275Test-413144738 tempest-ServersAdmin275Test-413144738-project] 10.222.0.60 "GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99" status: 404 len: 111 microversion: 2.75 time: 0.179053 Aug 25 12:33:08.194564 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 291/592] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:08 2022] GET /compute/v2.1/servers/d55c8c7d-addf-4948-ba55-bd6951b80b99 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:08.207600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:08.209296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.223388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.224860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.226006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.227706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.228982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.230058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.579649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:08.604857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:08.607035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.613182 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf0c565e-d53e-488c-ad98-8743290a05ec tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1470 microversion: 2.1 time: 0.414598 Aug 25 12:33:08.616481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 292/593] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:08 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1470 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:08.626318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.627118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.629474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.630598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.632372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:08.633091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.633919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] [instance: 6fb97fb3-76c4-4216-a69d-5efb28cd10b9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.635352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.654149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.661012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.661780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.663229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.664107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.670227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.704507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] HTTP exception thrown: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Request method failure captured: Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 HTTP/1.1 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vkxmlSK2nNQPat1ZGVI_-Cw_2GMA6XmHUCe0aVlTm1f92M9j9bECvGKVOZwu3PSQvzCvsMe_lotsPF2tyiGfwh9qmRMOJvfxXQIVL3WBOt9z6AqYb1oZlt7cEtgRFpZBdEE1FM3PMBIdic2J_GMz8JaKo1znWUMRa_3OleBP83cJI Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: f4c32956eae2487c947e88e086e7a862 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:08.708010 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4c32956eae2487c947e88e086e7a862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4c32956eae2487c947e88e086e7a862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: f4c32956eae2487c947e88e086e7a862 Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-574583458 Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiagnosticsNegativeTest-574583458-project Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4bad1a98ce0a461f83ab2d56b6b914bd Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-574583458-project Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. Aug 25 12:33:08.711163 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6fb97fb3-76c4-4216-a69d-5efb28cd10b9'} Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:08.712754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. Aug 25 12:33:08.715829 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:08.722246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] Returning 404 to user: Instance 6fb97fb3-76c4-4216-a69d-5efb28cd10b9 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:08.722246 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3dcc7c7c-5b6b-49ee-9434-9cc8bd76ef93 tempest-ServerDiagnosticsNegativeTest-574583458 tempest-ServerDiagnosticsNegativeTest-574583458-project] 10.222.0.60 "GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9" status: 404 len: 111 microversion: 2.1 time: 0.091440 Aug 25 12:33:08.722246 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 293/594] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:08 2022] GET /compute/v2.1/servers/6fb97fb3-76c4-4216-a69d-5efb28cd10b9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:08.726980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:08.729600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.737154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.737796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.738296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.739259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.739739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.740229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.900222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a28e1314-9162-45d7-8a55-ee9bc3006a43 tempest-DeleteServersAdminTestJSON-150249655 tempest-DeleteServersAdminTestJSON-150249655-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426/action" status: 202 len: 0 microversion: 2.1 time: 0.177175 Aug 25 12:33:08.901610 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 294/595] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:33:08 2022] POST /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:33:08.918850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:08.919935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:08.929874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.931262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.931896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.932908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.933551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.934927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.979430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:08.979934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:08.980604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:08.981325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lazy-loading 'fault' on Instance uuid 2ff7ca6d-857e-414a-af4a-40b8a38c8426 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:09.043227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:09.082535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5595901-6359-4136-873e-0896ba5bf909 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 2052 microversion: 2.25 time: 1.419759 Aug 25 12:33:09.086203 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 302/596] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:07 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 2052 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:09.099906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:09.101453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:09.126037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.126904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.129389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.130777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.132838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.133472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.224800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] HTTP exception thrown: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Request method failure captured: Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a HTTP/1.1 Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2u_LW8ITKgAhWedshIo3Le_4RJONbRcexl0HpR2NjYYXYblWRPtZSYov3dMQduvhlTrXMfzmHw5N6hooNHcz2YMjTMPdHS6pIP2qt9EsFiN6GQLCnL2LePyRv1M40Km3a6xnLsRADb9Ji3ZjYcTXhqr0_j2xGEDUGFueFeKSSUPaTg Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c164b35071d044d2bd3ee89e0fd8e5fa Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:09.233590 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c164b35071d044d2bd3ee89e0fd8e5fa Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1797002256-project Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1ac8d1e8a4b34947b3a98a4db4b058f9 Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1797002256-project Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. Aug 25 12:33:09.237426 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a'} Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:09.238895 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. Aug 25 12:33:09.241489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:09.243810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Returning 404 to user: Instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:09.244795 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae615b83-dc70-4940-99a7-a42069e0b278 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a" status: 404 len: 111 microversion: 2.1 time: 0.154471 Aug 25 12:33:09.246431 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 303/597] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:09 2022] GET /compute/v2.1/servers/92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:09.258735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:09.260732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:09.274374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.275655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.276727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.278387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.279310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.280186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.668040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:09.711969 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6b62c80b-4ab3-463e-8c78-a2c70e33c122 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1453 microversion: 2.1 time: 0.802646 Aug 25 12:33:09.714808 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 295/598] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:08 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1453 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:09.728783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:09.730908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:09.766392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.767318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.770858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.771863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.772652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:09.773191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:09.805492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:09.820350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:09.866083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:09.929562 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f8b4b5e8-bf30-475b-8c67-0f2a6421de71 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 2052 microversion: 2.25 time: 0.680888 Aug 25 12:33:09.930655 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 304/599] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:09 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 2052 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:09.960922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a", "name": "network-vif-deleted", "tag": "a1aa3406-3069-4cb3-b85d-b7a1eaac1978"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:09.996413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:09.998803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.000411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.056989 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] Creating event network-vif-deleted:a1aa3406-3069-4cb3-b85d-b7a1eaac1978 for instance 92a6fbd2-53e0-44a5-b4d7-05fb4758fb8a on n-h1-850468-18 Aug 25 12:33:10.075783 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1a62983c-38d3-4447-ac3c-aa2483c2d46b req-f947e618-97cc-4ab4-889c-24da689e048c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142041 Aug 25 12:33:10.083332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 305/600] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:10.104822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:10.106416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:10.121359 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31e3caae-113e-49b7-9861-9ef7e5651989 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 204 len: 0 microversion: 2.1 time: 0.404042 Aug 25 12:33:10.122187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 296/601] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:09 2022] DELETE /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:10.133189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.133702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.134250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.135934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.136457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.137278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.138332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:10.151906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.152810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.159745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.161352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.170823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.175595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.235876 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c55f77f-7478-4f3d-8cc2-f4081f1347de tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.111746 Aug 25 12:33:10.237760 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 297/602] 10.222.0.60 () {60 vars in 1217 bytes} [Thu Aug 25 12:33:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:33:10.240061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:10.246559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:10.252092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:10.269841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.271312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.272424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.273994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.275136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.276227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.469677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a8d7d67-f750-4dbe-a82b-0c67a076be94 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 204 len: 0 microversion: 2.1 time: 0.383204 Aug 25 12:33:10.472734 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 306/603] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:10 2022] DELETE /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:10.485579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-18", "block_migration": "auto"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:10.490582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:10.498662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.499178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.499663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.500447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.500973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.501407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.538857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'flavor' on Instance uuid 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:10.568149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Going to try to live migrate instance to n-h2-850468-18 {{(pid=122700) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:33:10.632546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:10.671881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc5d82b8-ab24-41a0-8a6a-70f5f3eb6cf7 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1476 microversion: 2.1 time: 0.431963 Aug 25 12:33:10.688867 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 298/604] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:10 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:10.728046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:10.729587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:10.743169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.744389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.745369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.747897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.749808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.750793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.839505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:10.841073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:10.842195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:10.843813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lazy-loading 'fault' on Instance uuid 2ff7ca6d-857e-414a-af4a-40b8a38c8426 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:11.106368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:11.119802 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce2f5ac7-f7cd-4100-a070-2372a86cbb17 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1459 microversion: 2.1 time: 0.422011 Aug 25 12:33:11.120709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 299/605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:10 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1459 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:11.726278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:11.729465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:11.740993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:11.741473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:11.742122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:11.742699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:11.743210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:11.743554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:12.086734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:12.113901 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e75be7f7-b4f6-418e-828b-fb244e9dcb62 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1476 microversion: 2.1 time: 0.391955 Aug 25 12:33:12.126463 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 300/606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:11 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:12.168353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:12.170416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:12.184581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:12.185969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:12.187209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:12.188947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:12.190446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:12.191327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:12.286609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:12.291351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:12.292632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:12.293800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lazy-loading 'fault' on Instance uuid 2ff7ca6d-857e-414a-af4a-40b8a38c8426 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:12.556046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:12.588011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-59070f01-39de-4e5e-833d-215a6b7ade34 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1459 microversion: 2.1 time: 0.429383 Aug 25 12:33:12.589262 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 301/607] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:12 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1459 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:13.148351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:13.150013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:13.167027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:13.168620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:13.169931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:13.171754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:13.172976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:13.174101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:13.849466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac8d1e8a4b34947b3a98a4db4b058f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c164b35071d044d2bd3ee89e0fd8e5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:13.861495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d405071-d42f-466f-943e-6f8459c0a544 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 200 len: 1476 microversion: 2.1 time: 0.720993 Aug 25 12:33:13.863614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 302/608] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:13 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 1476 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:13.871344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:13.872334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:13.895544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:13.896349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:13.897126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:13.898312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:13.899423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:13.900215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:13.986373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:13.989069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:13.989905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:13.990975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lazy-loading 'fault' on Instance uuid 2ff7ca6d-857e-414a-af4a-40b8a38c8426 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:14.458238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77b9267a82a4e74a77bccfc532227cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc1137442554b27baf8ff45e7f128fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:14.472062 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c2646a0-d4b3-4488-9f9b-516536a6a746 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 200 len: 1459 microversion: 2.1 time: 0.606729 Aug 25 12:33:14.487221 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 303/609] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:13 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 1459 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:14.493774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:14.495172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:14.510641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:14.511037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:14.511493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:14.512288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:14.512988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:14.513730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:14.640734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:33:14.948411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c1217be-ae05-4167-bd57-b0e77c982231 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 204 len: 0 microversion: 2.1 time: 0.458921 Aug 25 12:33:14.949450 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 304/610] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:14 2022] DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:15.369640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Calling method '.version_select at 0x7fc6c2c7d4c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:15.427257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:15.428087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:15.428870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:15.430228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:15.431016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:15.431739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:15.502460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23d301c2-1b31-4e75-a28e-9a4d74548570 tempest-AbsoluteLimitsTestJSON-484381200 tempest-AbsoluteLimitsTestJSON-484381200-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.541777 Aug 25 12:33:15.532717 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 305/611] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 25 12:33:14 2022] GET /compute/v2.1/limits => generated 511 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:16.277879 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1540712a-e467-455b-8178-14e5aa94d937 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62/action" status: 202 len: 0 microversion: 2.25 time: 5.802795 Aug 25 12:33:16.285819 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 307/612] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:33:10 2022] POST /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62/action => generated 0 bytes in 5807 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:33:16.324418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85605dc4-6c51-4322-aae9-0eb2a0e502bf", "name": "network-vif-deleted", "tag": "5c68e78a-73ee-4c7c-9378-90d40b9dcf0e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:16.389123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.397703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.397703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.422867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] Creating event network-vif-deleted:5c68e78a-73ee-4c7c-9378-90d40b9dcf0e for instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf on n-h2-850468-18 Aug 25 12:33:16.438505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4b35dada-5df5-46e2-aef3-2778594fd2db req-f3559111-8755-4889-aabc-3b7c8ecb7c76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146190 Aug 25 12:33:16.441015 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 308/613] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:16.459739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:16.461393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] [instance: 85605dc4-6c51-4322-aae9-0eb2a0e502bf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:16.471138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:16.481383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.484988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.489729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.490657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.491334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.492182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.525557 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] HTTP exception thrown: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Request method failure captured: Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf HTTP/1.1 Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2u_LW8ITKgAhWedshIo3Le_4RJONbRcexl0HpR2NjYYXYblWRPtZSYov3dMQduvhlTrXMfzmHw5N6hooNHcz2YMjTMPdHS6pIP2qt9EsFiN6GQLCnL2LePyRv1M40Km3a6xnLsRADb9Ji3ZjYcTXhqr0_j2xGEDUGFueFeKSSUPaTg Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c164b35071d044d2bd3ee89e0fd8e5fa Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:16.529597 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c164b35071d044d2bd3ee89e0fd8e5fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c164b35071d044d2bd3ee89e0fd8e5fa Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1797002256 Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1797002256-project Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1ac8d1e8a4b34947b3a98a4db4b058f9 Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1797002256-project Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. Aug 25 12:33:16.531078 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85605dc4-6c51-4322-aae9-0eb2a0e502bf'} Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:16.531820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. Aug 25 12:33:16.533900 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.541247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] Returning 404 to user: Instance 85605dc4-6c51-4322-aae9-0eb2a0e502bf could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:16.542504 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2757adb3-194e-4b53-8e00-095057b84a93 tempest-ServersAdminNegativeTestJSON-1797002256 tempest-ServersAdminNegativeTestJSON-1797002256-project] 10.222.0.60 "GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf" status: 404 len: 111 microversion: 2.1 time: 0.097792 Aug 25 12:33:16.548512 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 309/614] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:16 2022] GET /compute/v2.1/servers/85605dc4-6c51-4322-aae9-0eb2a0e502bf => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:16.556412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-70009828", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "253568095", "adminPass": "***", "networks": [{"uuid": "3e4619a7-d03e-4d15-b146-6e3538f68286"}], "security_groups": [{"name": "tempest-securitygroup--1856348433"}], "key_name": "tempest-keypair-1417181888", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:16.640477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90b6a0b1-a4a8-4bae-8e1d-ed568b3f3203 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:16.663383 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90b6a0b1-a4a8-4bae-8e1d-ed568b3f3203 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.129630 Aug 25 12:33:16.684056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 306/615] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:33:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:16.735782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:16.742839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:16.765808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.767335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.769128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.769294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:16.772723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.777832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.778684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.822380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 HTTP/1.1 Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:16.827401 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:16.829354 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2ff7ca6d-857e-414a-af4a-40b8a38c8426'} Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:16.830164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:16.832248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:16.842068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:16.843571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e333f25-2b3b-4f63-8844-01f1bc1122bf tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 404 len: 111 microversion: 2.1 time: 0.145044 Aug 25 12:33:16.844542 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 307/616] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:16 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:16.858324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:16.858324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:16.879578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.880763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.882173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:16.885802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:16.886646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:16.887447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:17.228102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] validate_networks() for [('3e4619a7-d03e-4d15-b146-6e3538f68286', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:33:18.225959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:18.254839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:18.277633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:18.282144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-154d59af-360b-4911-8f71-20ee2ac40704 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.436088 Aug 25 12:33:18.284637 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 308/617] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:16 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:18.297155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:18.298360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:18.327270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.328818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.332729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.334442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.336070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.337092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.390435 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 HTTP/1.1 Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:18.394909 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.397854 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2ff7ca6d-857e-414a-af4a-40b8a38c8426'} Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:18.399604 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.402418 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.408474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:18.411298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2eff3dfa-d5ca-4d2a-bc42-a147fa9104f4 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 404 len: 111 microversion: 2.1 time: 0.122171 Aug 25 12:33:18.413333 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 309/618] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:18 2022] DELETE /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:18.451719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:18.453234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 2ff7ca6d-857e-414a-af4a-40b8a38c8426] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:18.464210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.464654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.465092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.465919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.466615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.467259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.517848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 HTTP/1.1 Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:18.524175 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.527090 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2ff7ca6d-857e-414a-af4a-40b8a38c8426'} Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:18.532380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. Aug 25 12:33:18.544945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.560351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:18.562866 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4287c91d-d26c-4450-af4a-0c7b482bec24 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426" status: 404 len: 111 microversion: 2.1 time: 0.130221 Aug 25 12:33:18.572747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 310/619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:18 2022] GET /compute/v2.1/servers/2ff7ca6d-857e-414a-af4a-40b8a38c8426 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:18.585343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:18.585972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:18.613714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.614260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.617166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.621368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.622000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.622641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.665945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 HTTP/1.1 Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:18.677030 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.679753 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3a8a4f29-0c78-49ad-a00d-426571af2570'} Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:18.681870 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.684667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.687278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:18.687278 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ccd1eb21-bcc5-4a91-aafb-dbfd69522d59 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 404 len: 111 microversion: 2.1 time: 0.103559 Aug 25 12:33:18.687278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 311/620] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:33:18 2022] DELETE /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:18.711394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:18.712434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] [instance: 3a8a4f29-0c78-49ad-a00d-426571af2570] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:18.723448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.724450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.725143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.727076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.727822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.728621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.751779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] HTTP exception thrown: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Request method failure captured: Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 HTTP/1.1 Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2u-Zr6w7vbkpT9z7cq7OygXsXuqMWd0Z6NrxX9LJud1fQNJmCAjRVDM3K5hDafoy8KRQN8UOmB5bMV_24vwWJjwANCA_UBCCYtve0U1C7DieOunHV_LkaTfAiNY_dSPCOTutayJ8b8vtqiYDvELE5CGgJPI7WDrXMMvjuhor6DNSGA Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:18.754313 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3cc1137442554b27baf8ff45e7f128fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3cc1137442554b27baf8ff45e7f128fd Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1903991313 Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b77b9267a82a4e74a77bccfc532227cb Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersAdminTestJSON-1903991313-project Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.755953 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3a8a4f29-0c78-49ad-a00d-426571af2570'} Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:18.756824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. Aug 25 12:33:18.758688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:18.764107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] Returning 404 to user: Instance 3a8a4f29-0c78-49ad-a00d-426571af2570 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:18.765624 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9de2a64-586e-49a4-b307-434e5778b3a2 tempest-DeleteServersAdminTestJSON-1903991313 tempest-DeleteServersAdminTestJSON-1903991313-project] 10.222.0.60 "GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570" status: 404 len: 111 microversion: 2.1 time: 0.075576 Aug 25 12:33:18.767648 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 312/621] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:18 2022] GET /compute/v2.1/servers/3a8a4f29-0c78-49ad-a00d-426571af2570 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:18.802265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff7ca6d-857e-414a-af4a-40b8a38c8426", "name": "network-vif-deleted", "tag": "f216e059-7f29-4fed-a2f3-1b9f129c3211"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:18.836277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:18.836919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:18.839460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:18.882519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] Creating event network-vif-deleted:f216e059-7f29-4fed-a2f3-1b9f129c3211 for instance 2ff7ca6d-857e-414a-af4a-40b8a38c8426 on n-h2-850468-18 Aug 25 12:33:18.895749 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-827032a4-bb32-4a09-85e0-945a3addd8b1 req-01ba0c44-0743-471f-8d1a-eb50d84f3608 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101952 Aug 25 12:33:18.897034 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 313/622] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:19.331643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:19.334953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:19.364899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:19.367603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:19.372399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:19.375827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:19.380095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:19.397283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:21.031271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:21.061656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:21.063727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:21.066001 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e207c79-9c06-4c3f-95a2-43c3c1517570 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.741263 Aug 25 12:33:21.067027 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 314/623] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:19 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:21.077890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef194ae5-b778-4be7-9180-c09d1588cf69", "name": "network-vif-unplugged", "status": "completed", "tag": "fafb5042-8900-45e3-bdb2-3b5527a0a97c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:21.113832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:21.114725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:21.115355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:21.122729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:21.138423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:33:21.139049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:33:21.139328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:33:21.139801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:33:21.140671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:33:21.164323 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] Creating event network-vif-unplugged:fafb5042-8900-45e3-bdb2-3b5527a0a97c for instance ef194ae5-b778-4be7-9180-c09d1588cf69 on n-h1-850468-18 Aug 25 12:33:21.184072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:21.185189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:21.186189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:21.186691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a0d13ecb-6614-4f6d-854a-acbf68bdecf7 req-22e2b99c-91ff-4cfe-85b0-d4979ea152c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117805 Aug 25 12:33:21.187766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 315/624] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:21.187898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:21.191916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:21.192942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:21.198951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-528543478", "imageRef": "dff3f5aa-dc59-4776-9b11-4690ccb83f9b", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:21.271271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for project 89c932bd810047c7915941697021fdb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:21.278311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Getting quotas for user 1aa2df29675141de952756ad23f15926 and project 89c932bd810047c7915941697021fdb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:21.302455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:33:21.309070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:33:21.321395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:33:21.427235 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-efe973ab-1c6d-4e1c-94be-15f0478929b5 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.875093 Aug 25 12:33:21.429950 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 310/625] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:33:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 4881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:33:22.269887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1240875943", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:22.446422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:33:22.993312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] Request method failure captured: Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 142 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wKun0vnGa3zRSs9RRWruuzBaC_q99qeC79ByCq1bvfDLxXGaAWs7c-0hWR8pZ6Xpt0qem0ioR9BdiHvme_tLVnafsYbLozR02vNAn8nmCi77c9Lw3bzoFnhxpKq_je6ilvmJ7Fujp91_p5fsgNVDynlpX--IfKxJdxzP579DmWI7o Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0683c523a1204daf8c24259a05749509 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FlavorsV2NegativeTest-1847778117 Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:22.999716 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0683c523a1204daf8c24259a05749509"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0683c523a1204daf8c24259a05749509"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0683c523a1204daf8c24259a05749509"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0683c523a1204daf8c24259a05749509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FlavorsV2NegativeTest-1847778117 Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0683c523a1204daf8c24259a05749509 Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1847778117 Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FlavorsV2NegativeTest-1847778117-project Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 06d9267f449543638d1ee4f8b3cb6efa Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FlavorsV2NegativeTest-1847778117-project Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-528543478", "imageRef": "dff3f5aa-dc59-4776-9b11-4690ccb83f9b", "flavorRef": "452"}} Aug 25 12:33:23.003074 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: exception: Flavor's memory is too small for requested image. Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-528543478', 'imageRef': 'dff3f5aa-dc59-4776-9b11-4690ccb83f9b', 'flavorRef': '452'}}} Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:23.004543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:23.008826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:23.017185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:23.022614 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fd2f2bb5-81f4-4187-bf83-79c45e0e16f9 tempest-FlavorsV2NegativeTest-1847778117 tempest-FlavorsV2NegativeTest-1847778117-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.824967 Aug 25 12:33:23.027414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 316/626] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:33:21 2022] POST /compute/v2.1/servers => generated 93 bytes in 1839 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:33:23.047078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:23.052163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:23.068953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:23.070299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:23.072557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:23.074374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:23.075385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:23.076558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:24.647814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:24.722399 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f988f4a-1b4c-4ef4-a632-e0b79166f057 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1257 microversion: 2.1 time: 1.689539 Aug 25 12:33:24.726773 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 317/627] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:23 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1257 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:24.766833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:24.767739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:24.779421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:24.793684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:24.796227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:24.805393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:24.808962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:24.809735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:25.271093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:33:25.272381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:33:25.273104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:33:25.273807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:33:25.274449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:33:25.326043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:25.328615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:25.334058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:25.338713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:25.343608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:25.349822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:25.412307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:25.449387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:25.461793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:25.472379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:25.541862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:33:25.552860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:33:25.856106 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2bf90514-3fbf-4fb1-b311-2f89654b6eb7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.421378 Aug 25 12:33:25.879646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 311/628] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:33:25.905293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef194ae5-b778-4be7-9180-c09d1588cf69", "name": "network-vif-deleted", "tag": "fafb5042-8900-45e3-bdb2-3b5527a0a97c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:25.953248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:25.954866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:25.957247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:25.984506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] Creating event network-vif-deleted:fafb5042-8900-45e3-bdb2-3b5527a0a97c for instance ef194ae5-b778-4be7-9180-c09d1588cf69 on n-h1-850468-18 Aug 25 12:33:26.000680 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-11283018-266a-4f22-bf43-08000be61621 req-aa7f1709-23da-4bca-9110-f223dfa5c3d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115906 Aug 25 12:33:26.005109 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 312/629] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:26.017393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:26.020564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:26.032933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:26.035441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:26.037054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:26.038771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:26.040244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:26.041404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:26.983340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:27.033110 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d35e3a88-0850-4d0b-8f01-d562ff1f3405 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1319 microversion: 2.1 time: 1.024897 Aug 25 12:33:27.035347 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 313/630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:26 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1319 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:27.055379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33ec72a1-afb1-4ddd-95d3-33c25f535744 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:27.056893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33ec72a1-afb1-4ddd-95d3-33c25f535744 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:27.699160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33ec72a1-afb1-4ddd-95d3-33c25f535744 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:27.771552 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33ec72a1-afb1-4ddd-95d3-33c25f535744 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1217 microversion: 2.1 time: 0.733361 Aug 25 12:33:27.784797 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 314/631] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:27 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1217 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:28.045263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:28.070918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:28.075516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:28.083299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3717b045-13d1-44a4-8369-1e7cce0ceda3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 3.346380 Aug 25 12:33:28.084643 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 318/632] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:24 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 3357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:28.098616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:28.102845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:28.124264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.125803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.129023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.132318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.134247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.135116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.647876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c2d3a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:28.678528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:28.679501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.683136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.686378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.716672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b6bc144-43e8-4759-9fa0-48347daa2ff2 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1319 microversion: 2.1 time: 0.627969 Aug 25 12:33:28.721670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 319/633] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:28 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:28.745570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.746660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.747732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.753996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4c57fc-07ea-4210-8211-f4fcbc2c6a62", "name": "network-vif-unplugged", "status": "completed", "tag": "6fbd848b-4761-489b-af7c-e2c1399d1bda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:28.778363 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] HTTP exception thrown: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Request method failure captured: Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c HTTP/1.1 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 56 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wVUXx6dTY_aVmRoG9qpPupKuMLAAS721XvyH-7J7PaI8mODjT9umfeQept5Xqg0XZe7UXkTux6edtDNuUAjK_TTEKkKClwVHFhoQrDkl-QGl8rAfGfMcU0esxmJDA4ci60Duu566N5xMgISawVBSOIxp9hJM3HMXw8vpW3qlEPRBU Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:28.797748 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1a696a944aed4a8f98dd0f5902f018c5 Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:28.801295 n-d-850468-18 devstack@n-api.service[122700]: exception: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7b2edcdd-db2f-42d6-abcc-09ac1da22d7c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.802918 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:28.805731 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:28.811822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:28.811822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:28.811822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:28.812387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.812387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.812387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.813114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Returning 404 to user: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:28.818882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29b8778c-fb48-4adb-b58b-a534faf3cc04 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c" status: 404 len: 110 microversion: 2.53 time: 1.030400 Aug 25 12:33:28.821424 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 315/634] 10.222.0.60 () {62 vars in 1309 bytes} [Thu Aug 25 12:33:27 2022] PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c => generated 110 bytes in 1036 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:28.835138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:28.837155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:28.860190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.879637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.883820 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] Creating event network-vif-unplugged:6fbd848b-4761-489b-af7c-e2c1399d1bda for instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 on n-h1-850468-18 Aug 25 12:33:28.885460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.890106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.891869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.895152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.920611 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1465990d-6b20-490a-92f8-63659a086299 req-4978c332-ef50-44dc-8cb7-3a712c8e91d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.192281 Aug 25 12:33:28.922986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 320/635] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:28.943016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2f37dc0>, body: {"status": "disabled"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:28.962908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.963658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.964498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:28.991531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:28.992798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:28.998574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.030518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] HTTP exception thrown: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Request method failure captured: Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c HTTP/1.1 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 22 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wVUXx6dTY_aVmRoG9qpPupKuMLAAS721XvyH-7J7PaI8mODjT9umfeQept5Xqg0XZe7UXkTux6edtDNuUAjK_TTEKkKClwVHFhoQrDkl-QGl8rAfGfMcU0esxmJDA4ci60Duu566N5xMgISawVBSOIxp9hJM3HMXw8vpW3qlEPRBU Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:33:29.036874 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1a696a944aed4a8f98dd0f5902f018c5 Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: {"status": "disabled"} Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: exception: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.039075 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7b2edcdd-db2f-42d6-abcc-09ac1da22d7c', 'body': {'status': 'disabled'}} Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.040573 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:29.042831 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:29.047462 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.047462 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.049955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Returning 404 to user: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:29.051403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de1ad502-6ea4-4165-90d6-ddb962144bbf tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c" status: 404 len: 110 microversion: 2.53 time: 0.125623 Aug 25 12:33:29.055042 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 321/636] 10.222.0.60 () {62 vars in 1309 bytes} [Thu Aug 25 12:33:28 2022] PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c => generated 110 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:29.078611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c7daf0>, body: {"status": "enabled"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:29.092442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.093368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.094105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.119078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.119576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.120024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.133874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] HTTP exception thrown: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Request method failure captured: Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c HTTP/1.1 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 21 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wVUXx6dTY_aVmRoG9qpPupKuMLAAS721XvyH-7J7PaI8mODjT9umfeQept5Xqg0XZe7UXkTux6edtDNuUAjK_TTEKkKClwVHFhoQrDkl-QGl8rAfGfMcU0esxmJDA4ci60Duu566N5xMgISawVBSOIxp9hJM3HMXw8vpW3qlEPRBU Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:33:29.135574 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ffc73cc16d5245eba71d8ea348d41a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ffc73cc16d5245eba71d8ea348d41a03 Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943 Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1a696a944aed4a8f98dd0f5902f018c5 Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: {"status": "enabled"} Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: exception: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.137021 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7b2edcdd-db2f-42d6-abcc-09ac1da22d7c', 'body': {'status': 'enabled'}} Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.137927 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:29.139270 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:29.140603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. Aug 25 12:33:29.140603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:29.140603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Returning 404 to user: Service 7b2edcdd-db2f-42d6-abcc-09ac1da22d7c could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:29.140603 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7821652-ded3-44cb-99e7-a9403abbeaff tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c" status: 404 len: 110 microversion: 2.53 time: 0.076193 Aug 25 12:33:29.140603 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 322/637] 10.222.0.60 () {62 vars in 1309 bytes} [Thu Aug 25 12:33:29 2022] PUT /compute/v2.1/os-services/7b2edcdd-db2f-42d6-abcc-09ac1da22d7c => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 12:33:29.150414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:29.151167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:29.165523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.166025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.166469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.167202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.167824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.168496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.727627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:29.759917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-04c3d406-8553-4115-aa1b-47a564865b8c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1287 microversion: 2.1 time: 0.936132 Aug 25 12:33:29.761052 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 316/638] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:28 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1287 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:29.786534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:29.801252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.802101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.815948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:29.817412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:29.818299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:29.820280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.011907 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1677a950-5928-4ac3-ac7d-f69c68c14aa6 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.239654 Aug 25 12:33:30.015619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 317/639] 10.222.0.60 () {60 vars in 1178 bytes} [Thu Aug 25 12:33:29 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:30.066663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.067531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:30.084515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.085358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.092674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.095361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.100583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.101489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.223655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:30.242789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:30.244390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:30.245661 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-052825c9-7800-4826-a8fb-4572cecd39ac tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.105834 Aug 25 12:33:30.246296 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 323/640] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:29 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:30.368096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:30.380565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:30.391743 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77322f12-7e9f-4f1a-82b7-67f099a451f9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1319 microversion: 2.1 time: 0.347328 Aug 25 12:33:30.413279 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 318/641] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:30.427819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.440938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.444945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.447800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.450169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.453402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.464289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.558059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7af3d142-c29a-432d-b8ec-5694b8725d34 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.141884 Aug 25 12:33:30.570931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 319/642] 10.222.0.60 () {60 vars in 1211 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:30.582650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.597593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.598367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.598965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.599982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.601053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.601783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.652085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Calling method '.version_select at 0x7fc6c2d244c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.663662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.664666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.684520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.687505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.691380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.697114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.732341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6df27482-341b-44ed-8f0c-43cd9ccba2c2 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.156605 Aug 25 12:33:30.744706 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 320/643] 10.222.0.60 () {60 vars in 1178 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:30.763142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.770667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.776959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.779590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.780474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.780956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.781400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.800905 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c581164b-6ef7-4624-b15e-e50d6c7da554 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.546907 Aug 25 12:33:30.811838 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 324/644] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:30.854149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:30.886476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:30.928347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.942718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.943515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.944837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:30.951403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:30.957841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:30.989960 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-266a6ddb-df84-407c-8150-8a1bc08b5a7e tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-850468-18&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.236729 Aug 25 12:33:31.000687 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 321/645] 10.222.0.60 () {60 vars in 1237 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/os-services?host=n-d-850468-18&binary=xxx => generated 16 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:31.603289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f73d4103-0d2f-498d-8bc3-9932abc3ae92 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Calling method '.version_select at 0x7fc6c2e5e550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:31.624234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f73d4103-0d2f-498d-8bc3-9932abc3ae92 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f73d4103-0d2f-498d-8bc3-9932abc3ae92 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:31.632952 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 12:33:31.635922 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:31.637559 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 25 12:33:31.640400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:31.644345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f73d4103-0d2f-498d-8bc3-9932abc3ae92 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:31.645597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f73d4103-0d2f-498d-8bc3-9932abc3ae92 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.636355 Aug 25 12:33:31.646819 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 322/646] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:33:31 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:31.666143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:31.682908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:31.684793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:31.687165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:31.693485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:31.696471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:31.698611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:31.748676 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-491fa735-a841-40ab-a702-4f9ea6459db5 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.099706 Aug 25 12:33:31.751240 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 323/647] 10.222.0.60 () {60 vars in 1178 bytes} [Thu Aug 25 12:33:31 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:31.760960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4c57fc-07ea-4210-8211-f4fcbc2c6a62", "tag": "6fbd848b-4761-489b-af7c-e2c1399d1bda"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:31.781546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:31.782753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:31.783932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:31.822259 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] Creating event network-changed:6fbd848b-4761-489b-af7c-e2c1399d1bda for instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 on n-h1-850468-18 Aug 25 12:33:31.851851 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6fe8524a-30a1-4a3b-8bec-bab8a061907b req-434b18fc-8bd1-438c-9760-f0e4bfdf01ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097926 Aug 25 12:33:31.855215 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 324/648] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:31.867679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:31.872741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:31.890114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:31.890922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:31.891532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:31.893547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:31.894373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:31.894955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:31.914811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:31.958816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f160440-b466-43d0-839e-12de3fb3ef88 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1275 microversion: 2.1 time: 1.142495 Aug 25 12:33:31.979901 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 325/649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:30 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1275 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:32.004769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:32.005962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:32.030151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:32.039868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:32.041309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:32.042439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:32.045415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:32.046929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:32.059577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:32.944290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:32.974101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45994b4d-3786-478c-b065-c203edeec656 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1319 microversion: 2.1 time: 0.988645 Aug 25 12:33:32.975432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 326/650] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:31 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1319 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:33.004675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba372e7-1081-4154-8e53-84c21b0cce2c tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Calling method '.version_select at 0x7fc6c2d67f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.014834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ba372e7-1081-4154-8e53-84c21b0cce2c tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba372e7-1081-4154-8e53-84c21b0cce2c tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hosts/n-d-850468-18/reboot HTTP/1.1 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:33.029729 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'n-d-850468-18'} Aug 25 12:33:33.032249 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:33.035436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 25 12:33:33.039584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.046011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba372e7-1081-4154-8e53-84c21b0cce2c tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:33.049689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ba372e7-1081-4154-8e53-84c21b0cce2c tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-850468-18/reboot" status: 403 len: 111 microversion: 2.1 time: 0.070386 Aug 25 12:33:33.051625 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 327/651] 10.222.0.60 () {58 vars in 1191 bytes} [Thu Aug 25 12:33:32 2022] GET /compute/v2.1/os-hosts/n-d-850468-18/reboot => generated 111 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:33.069178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.078210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:33.079024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:33.080624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:33.082670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:33.083528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:33.084167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.084911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:33.103270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.120721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.123824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-89eba1af-0920-422a-bb6f-f5f10996b051 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.267265 Aug 25 12:33:33.131111 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 325/652] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:31 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:33.147807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.151005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:33.172181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:33.173219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:33.175910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:33.178391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:33.179949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:33.180723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:33.226778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14f6308f-e38e-4a60-ab2f-6dc2ef9e30f4 tempest-ServicesAdminNegativeV253TestJSON-243129943 tempest-ServicesAdminNegativeV253TestJSON-243129943-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.171688 Aug 25 12:33:33.233401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 328/653] 10.222.0.60 () {60 vars in 1239 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:33.248585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d45225b-03cb-4a35-b343-9f8d760a712e tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Calling method '.version_select at 0x7fc6c2f37a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.291580 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9d45225b-03cb-4a35-b343-9f8d760a712e tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d45225b-03cb-4a35-b343-9f8d760a712e tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:33:33.296600 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:33:33.300065 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:33:33.302086 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:33:33.304891 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d45225b-03cb-4a35-b343-9f8d760a712e tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d45225b-03cb-4a35-b343-9f8d760a712e tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.064100 Aug 25 12:33:33.309248 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 329/654] 10.222.0.60 () {58 vars in 1212 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:33.911274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.928385 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d72dba6-5eb8-454d-b987-83d6cfe566fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1275 microversion: 2.1 time: 0.790959 Aug 25 12:33:33.944152 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 326/655] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1275 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:33.944152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ede5a290-181f-4bac-af8d-ebe86c627cf6 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Calling method '.version_select at 0x7fc6c2c734c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.945387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ede5a290-181f-4bac-af8d-ebe86c627cf6 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ede5a290-181f-4bac-af8d-ebe86c627cf6 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts/n-d-850468-18 HTTP/1.1 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:33.954118 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'n-d-850468-18'} Aug 25 12:33:33.956330 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:33.957702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 25 12:33:33.966971 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:33.968892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ede5a290-181f-4bac-af8d-ebe86c627cf6 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:33.968892 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ede5a290-181f-4bac-af8d-ebe86c627cf6 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-850468-18" status: 403 len: 109 microversion: 2.1 time: 0.023496 Aug 25 12:33:33.968892 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 327/656] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/os-hosts/n-d-850468-18 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:33.971529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eef070d2-ef2c-4e8c-8104-1399ae85e995 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Calling method '.version_select at 0x7fc6c2c2dd30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.991681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7173e69-b51b-4832-8b09-698ace31ed14 tempest-ServicesAdminNegativeV253TestJSON-495645597 tempest-ServicesAdminNegativeV253TestJSON-495645597-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:33.996489 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-eef070d2-ef2c-4e8c-8104-1399ae85e995 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eef070d2-ef2c-4e8c-8104-1399ae85e995 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:34.001618 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:33:34.004962 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.007228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.012215 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.018747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eef070d2-ef2c-4e8c-8104-1399ae85e995 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:34.018747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eef070d2-ef2c-4e8c-8104-1399ae85e995 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041090 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7173e69-b51b-4832-8b09-698ace31ed14 tempest-ServicesAdminNegativeV253TestJSON-495645597 tempest-ServicesAdminNegativeV253TestJSON-495645597-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c9b4ef66fcd347a4a2c3e0baf43894c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00991be3594d4f59a27f36443d1e8050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7173e69-b51b-4832-8b09-698ace31ed14 tempest-ServicesAdminNegativeV253TestJSON-495645597 tempest-ServicesAdminNegativeV253TestJSON-495645597-project] Request method failure captured: Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wTdHKGYIVdmUqB5sZNW_IBpJoTNAwemdgeXVRwb9d3I4sdqjZce2dE6F1v3wErDgq9e5PyxTpU-Y6NUsLjyQce46pEYMytzHO6fSZqu7Mo1wjOwrObPg4ybB0yLqpy1pvJKxxbm1oRUu6t8LoWbzOWjHdCg7OtyqB1Iu_o9g7o2j0 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.53 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 00991be3594d4f59a27f36443d1e8050 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-495645597 Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:34.019030 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_00991be3594d4f59a27f36443d1e8050"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/00991be3594d4f59a27f36443d1e8050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00991be3594d4f59a27f36443d1e8050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/00991be3594d4f59a27f36443d1e8050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-495645597 Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 00991be3594d4f59a27f36443d1e8050 Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-495645597 Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServicesAdminNegativeV253TestJSON-495645597-project Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: c9b4ef66fcd347a4a2c3e0baf43894c4 Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-495645597-project Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:33:34.025280 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:34.030257 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:33:34.040430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.041841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7173e69-b51b-4832-8b09-698ace31ed14 tempest-ServicesAdminNegativeV253TestJSON-495645597 tempest-ServicesAdminNegativeV253TestJSON-495645597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:34.041841 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7173e69-b51b-4832-8b09-698ace31ed14 tempest-ServicesAdminNegativeV253TestJSON-495645597 tempest-ServicesAdminNegativeV253TestJSON-495645597-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.705257 Aug 25 12:33:34.041841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 330/658] 10.222.0.60 () {60 vars in 1178 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 711 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:34.042076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 328/658] 10.222.0.60 () {58 vars in 1191 bytes} [Thu Aug 25 12:33:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:34.042166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:34.042166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:34.042321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b6a230-47de-4cf1-a6da-583a381e4e27 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Calling method '.version_select at 0x7fc6c2c73670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:34.043637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14b6a230-47de-4cf1-a6da-583a381e4e27 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b6a230-47de-4cf1-a6da-583a381e4e27 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts/n-d-850468-18/shutdown HTTP/1.1 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:34.046188 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'n-d-850468-18'} Aug 25 12:33:34.047851 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:34.048924 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 25 12:33:34.050830 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.055452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b6a230-47de-4cf1-a6da-583a381e4e27 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:34.062106 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14b6a230-47de-4cf1-a6da-583a381e4e27 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-850468-18/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.031384 Aug 25 12:33:34.064989 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 329/659] 10.222.0.60 () {58 vars in 1197 bytes} [Thu Aug 25 12:33:34 2022] GET /compute/v2.1/os-hosts/n-d-850468-18/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:34.070689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:34.071200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:34.071649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:34.072431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:34.072905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:34.073342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:34.093067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0e30762-c4d3-4ce6-bd58-22ed6824ae78 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Calling method '.version_select at 0x7fc6c2c2de50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:34.150675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b0e30762-c4d3-4ce6-bd58-22ed6824ae78 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0e30762-c4d3-4ce6-bd58-22ed6824ae78 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:34.160951 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:33:34.162422 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:33:34.163340 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:33:34.164595 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0e30762-c4d3-4ce6-bd58-22ed6824ae78 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:34.165675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b0e30762-c4d3-4ce6-bd58-22ed6824ae78 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.092853 Aug 25 12:33:34.180444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 330/660] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 12:33:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:34.210020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:34.213565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:34.243440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:34.246481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:34.253613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:34.258869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:34.260801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:34.262497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:35.628954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.640642 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48a7b798-1f27-4c9f-b962-67930c392f42 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.616730 Aug 25 12:33:35.641526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 331/661] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:34 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:35.648730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892b1c33-1253-4c66-9792-a8c8c9afc902 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Calling method '.version_select at 0x7fc6c2c7d670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:35.652844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-892b1c33-1253-4c66-9792-a8c8c9afc902 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892b1c33-1253-4c66-9792-a8c8c9afc902 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-hosts/n-d-850468-18/startup HTTP/1.1 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:33:35.655333 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'n-d-850468-18'} Aug 25 12:33:35.656713 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:35.657466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 25 12:33:35.659308 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.664892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892b1c33-1253-4c66-9792-a8c8c9afc902 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.666915 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-892b1c33-1253-4c66-9792-a8c8c9afc902 tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "GET /compute/v2.1/os-hosts/n-d-850468-18/startup" status: 403 len: 110 microversion: 2.1 time: 0.023174 Aug 25 12:33:35.668162 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 332/662] 10.222.0.60 () {58 vars in 1194 bytes} [Thu Aug 25 12:33:35 2022] GET /compute/v2.1/os-hosts/n-d-850468-18/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:35.673599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:35.675326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:35.683437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:35.684476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:35.684959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:35.685690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:35.686158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:35.686588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:35.731748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.745060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.747042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.748719 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc8eb447-79a2-4c8d-9e6f-c0de1e958291 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.563246 Aug 25 12:33:35.749376 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 331/663] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:34 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:35.754928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d70aaa98-5fb4-4e96-b18e-eea2618bfc93 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Calling method '.version_select at 0x7fc6c2c4d1f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:35.776273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d70aaa98-5fb4-4e96-b18e-eea2618bfc93 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d70aaa98-5fb4-4e96-b18e-eea2618bfc93 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:35.780813 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'nonexistent_hostname'} Aug 25 12:33:35.782186 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:33:35.782943 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 25 12:33:35.786911 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.788161 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.791781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d70aaa98-5fb4-4e96-b18e-eea2618bfc93 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.793159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d70aaa98-5fb4-4e96-b18e-eea2618bfc93 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.042483 Aug 25 12:33:35.793728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 332/664] 10.222.0.60 () {58 vars in 1215 bytes} [Thu Aug 25 12:33:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:35.809734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ad13ceb-3eb1-4624-be3f-b9037373a92f tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2d68ee0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ad13ceb-3eb1-4624-be3f-b9037373a92f tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-hosts/n-d-850468-18 HTTP/1.1 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 51 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:35.820353 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: {"status": "enable", "maintenance_mode": "invalid"} Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:35.822408 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'n-d-850468-18', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.823371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.825133 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.826526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ad13ceb-3eb1-4624-be3f-b9037373a92f tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.828211 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ad13ceb-3eb1-4624-be3f-b9037373a92f tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-850468-18" status: 400 len: 199 microversion: 2.1 time: 0.026004 Aug 25 12:33:35.834383 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 333/665] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:33:35 2022] PUT /compute/v2.1/os-hosts/n-d-850468-18 => generated 199 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 12:33:35.846905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c7a4a86-9ec8-4e11-9f48-da3680fbb453 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c17160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c7a4a86-9ec8-4e11-9f48-da3680fbb453 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-hosts/n-d-850468-18 HTTP/1.1 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 51 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:35.853636 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: {"status": "invalid", "maintenance_mode": "enable"} Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:35.855500 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'n-d-850468-18', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.856495 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.858371 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c7a4a86-9ec8-4e11-9f48-da3680fbb453 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c7a4a86-9ec8-4e11-9f48-da3680fbb453 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-850468-18" status: 400 len: 189 microversion: 2.1 time: 0.019634 Aug 25 12:33:35.865524 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 334/666] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:33:35 2022] PUT /compute/v2.1/os-hosts/n-d-850468-18 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:35.877976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd5dd94-0235-41f8-b881-6ee0c04323ca tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Action: 'update', calling method: .version_select at 0x7fc6c2d68ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:35.885946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.887984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7cd5dd94-0235-41f8-b881-6ee0c04323ca tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '812a36eaa57c447a94160a4ac97d3c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '761fd78c8d754250b1f62677919ce67d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:35.898643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-797b3d91-4176-4f48-8e1e-ef06d1ca96e3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1275 microversion: 2.1 time: 0.229096 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd5dd94-0235-41f8-b881-6ee0c04323ca tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Request method failure captured: Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-hosts/n-d-850468-18 HTTP/1.1 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 50 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wYl5d8YcmFZep-aRE-HgyTgEO6KIGtwYhCXbGNsnPS2RMwpFxkixwzV1fIHP2Ixy2X29CaG9qooNCGMVIbflpe5ZtiUVtINc2bLI6C_I6tfWFyXaQrLn-w86hZ1Z3ejBOZWMEIWMbl_rtUn273cGGQuNKfaLVk9DaKj8tl2nFLDJ8 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:33:35.898790 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_761fd78c8d754250b1f62677919ce67d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/761fd78c8d754250b1f62677919ce67d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 761fd78c8d754250b1f62677919ce67d Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1086247510 Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 812a36eaa57c447a94160a4ac97d3c57 Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1086247510-project Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: {"status": "enable", "maintenance_mode": "enable"} Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:33:35.900176 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'n-d-850468-18', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:35.901446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 25 12:33:35.902710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.903867 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 333/667] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:35 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:35.904376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd5dd94-0235-41f8-b881-6ee0c04323ca tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.905690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cd5dd94-0235-41f8-b881-6ee0c04323ca tempest-HostsAdminNegativeTestJSON-1086247510 tempest-HostsAdminNegativeTestJSON-1086247510-project] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-850468-18" status: 403 len: 111 microversion: 2.1 time: 0.038503 Aug 25 12:33:35.914350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 335/668] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:33:35 2022] PUT /compute/v2.1/os-hosts/n-d-850468-18 => generated 111 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:33:35.929750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6f7c11-8d11-4535-a9de-b3f0117f7a9a tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c7d5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6f7c11-8d11-4535-a9de-b3f0117f7a9a tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/os-hosts/n-d-850468-18 HTTP/1.1 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 42 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:33:35.934814 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: {"status": null, "maintenance_mode": null} Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:33:35.937874 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'n-d-850468-18', 'body': {'status': None, 'maintenance_mode': None}} Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'disable', Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'Enable', Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'Disable', Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance: Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi None Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.940858 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.946817 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6f7c11-8d11-4535-a9de-b3f0117f7a9a tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb6f7c11-8d11-4535-a9de-b3f0117f7a9a tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/n-d-850468-18" status: 400 len: 127 microversion: 2.1 time: 0.023269 Aug 25 12:33:35.949045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 334/669] 10.222.0.60 () {60 vars in 1190 bytes} [Thu Aug 25 12:33:35 2022] PUT /compute/v2.1/os-hosts/n-d-850468-18 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:33:35.950548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c308b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:35.954125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.hosts [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Enabling host nonexistent_hostname. Aug 25 12:33:35.965115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Request method failure captured: Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 50 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wZsHYsQzF1kZZsXWnrc13wwg3rCCrA0uePl7Zpcn9r77zrEXmb3cCkjfzJg89bOJYGITPkFqJp3OzdajFD5vGzFJysK-iPK2mw1uWWLqcQUXGS_Rmce1U1kxrGFSmpJQ9seU5EZRqLR9rJSPIHG7e2ytYcPdarNWc33bvHrkE1zHM Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:33:35.968080 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57e0c3043b8a41f68e402e41a3effa79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 57e0c3043b8a41f68e402e41a3effa79 Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1139845675 Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94490f8df6bb499a81e804cb5320f4cd Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1139845675-project-admin Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: {"status": "enable", "maintenance_mode": "enable"} Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.970633 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 25 12:33:35.977382 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:33:35.983218 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:33:35.989219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:33:35.993861 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5be76df9-e288-49d1-a317-5c6666167b14 tempest-HostsAdminNegativeTestJSON-1139845675 tempest-HostsAdminNegativeTestJSON-1139845675-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023820 Aug 25 12:33:35.993861 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 336/670] 10.222.0.60 () {60 vars in 1211 bytes} [Thu Aug 25 12:33:35 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:33:36.704373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:36.711624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:36.753658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:36.755451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:36.758393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:36.767511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:36.771686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:36.774446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:36.811148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:36.819275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:36.846516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:36.853935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:36.858795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:36.866939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:36.868195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:36.872157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:37.718065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:39.052917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:39.082947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:39.087626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:39.094159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fc22048-45d7-416d-8000-40ddb1c5f06c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 2.296651 Aug 25 12:33:39.128685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:39.141627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 337/671] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:36 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:39.154346 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e91c0e40-f22e-43cb-a6fd-649157a4b2c4 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 2.461958 Aug 25 12:33:39.158951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:39.159882 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 335/672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:36 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:39.161004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:39.181796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:39.182703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:39.183311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:39.184501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:39.185159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:39.185744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:40.120601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519b617d-0180-4dfe-aa10-db9209b73838", "tag": "df39056c-cfa7-4020-a7db-693239148f08"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:40.155450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:40.156896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:40.157578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:40.172532 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] Creating event network-changed:df39056c-cfa7-4020-a7db-693239148f08 for instance 519b617d-0180-4dfe-aa10-db9209b73838 on n-h2-850468-18 Aug 25 12:33:40.183439 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d45d4276-9c7f-4d1c-8056-2d795fb9164d req-90842484-699a-4ad0-a2c3-98339a35d9b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066715 Aug 25 12:33:40.184896 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 336/673] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:40.203663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:40.204435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:40.229946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:40.230466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:40.230914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:40.231678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:40.232171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:40.239952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:40.255284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:40.273044 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95425ea4-2f55-462d-9597-d8343185522e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 1.127148 Aug 25 12:33:40.275921 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 338/674] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:39 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:40.291036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:40.292442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:40.341652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:40.352909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:40.353685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:40.355812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:40.363212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:40.363947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:41.579249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:41.601751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:41.603598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:41.614838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45666e81-f9c2-4495-8a0b-fc677d4ac483 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.425087 Aug 25 12:33:41.619535 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 337/675] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:40 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:41.655067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:41.656344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:41.671998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:41.673616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:41.675153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:41.679038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:41.680968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:41.682149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:41.698553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:41.717028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:41.721677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b587a980-4991-420b-b881-394bc872093d tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.443710 Aug 25 12:33:41.740188 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 339/676] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:40 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:42.658832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:42.659483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:42.679532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:42.680033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:42.694086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:42.694891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:42.695482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:42.700551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:43.126113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:43.595952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:43.633332 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ffe53394-f0be-4ba5-8b7a-d88f5e2f06cb tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 2.002866 Aug 25 12:33:43.635127 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 338/677] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:41 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:43.657897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:43.671053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:43.717774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:43.719129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:43.720284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:43.724676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:43.727820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:43.729004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:45.128715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:45.155576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-127b2ac6-710b-44f2-95b7-89af6689fbf1 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.514435 Aug 25 12:33:45.158088 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 339/678] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:43 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:45.167318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a61c5bb-e595-4272-a2db-69cd3886a0c4", "tag": "c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:45.195773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:45.196624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:45.197268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:45.226075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] Creating event network-changed:c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327 for instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 on n-h1-850468-18 Aug 25 12:33:45.239058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3de3653b-397a-4a8d-ba67-d41a54791dbc req-ccd8d195-3cef-497b-87f1-ff22a9bfe492 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078258 Aug 25 12:33:45.243258 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 340/679] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:33:45.281090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:45.282924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:45.312681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:45.317541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:45.321910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:45.328234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:45.329511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:45.334294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:45.786321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:45.808411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:45.812518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:45.819665 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5535f7d1-4ba2-4d0c-9d42-c9a19d6c2387 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 3.166785 Aug 25 12:33:45.821299 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 340/680] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:42 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 3170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:46.114172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:46.182041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-58be3a69-73da-4c5c-9917-9047f267f52e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.935006 Aug 25 12:33:46.194250 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 341/681] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:45 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:46.209079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:46.209079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:46.237235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:46.242172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:46.242940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:46.244242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:46.246862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:46.259063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:46.762084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:46.782308 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef883083-aa3a-4f21-b047-0bbf5ff00f09 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 0.589482 Aug 25 12:33:46.803365 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 341/682] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:46 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:33:46.878693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:46.881265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:46.898403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:46.902301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:46.903769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:46.905846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:46.913714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:46.914910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:47.271881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:47.274051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:47.286003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:47.292491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:47.294418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:47.295914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:47.297486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:47.298655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:47.299946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:47.790032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:47.831523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:47.849407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:47.853098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35a1bebc-cda2-4b72-a0c9-d72ea295ac66 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 0.986483 Aug 25 12:33:47.854165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 342/683] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:46 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:47.916807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:47.921753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:47.964699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:47.967020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:47.975412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:47.978581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:47.983135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:47.987404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:48.093780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:33:48.105742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:48.142145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72f777de-b847-4e1a-a744-be44b2c607bc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.903569 Aug 25 12:33:48.145440 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 342/684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:47 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:49.049270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:49.082557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d43b450-3e2e-4a12-ab99-2a4aa7b30a48 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.183317 Aug 25 12:33:49.084106 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 343/685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:47 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:49.108184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:49.109897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:49.136617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:49.138286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:49.144204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:49.146332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:49.150627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:49.151679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:49.623969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-596734097", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:49.774288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:33:50.502558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:50.561862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:50.567520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:50.576613 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4060362c-829e-4fe0-b78f-b67c1f75d88a tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1568 microversion: 2.25 time: 1.482736 Aug 25 12:33:50.600364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 344/686] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:49 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1568 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:50.765768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-330662b8-5f04-4044-9735-17b74573c989 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Action: 'create', calling method: .version_select at 0x7fc6c2c64280>, body: {"keypair": {"name": "tempest-keypair-842305839", "type": "ssh", "user_id": "34ce709f3b71445dbcdbbc0d52acd2b8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkSt2flnsslsMzCCsABBL5V3ZJbT+11ZQEylRgfBzAPTiQ+khUr8gpAgriD5SrWR2lM/XCT0W/9t6ey4/WpAEZMFEny6/eW+rq/YGeZ4Kz1vqURnMAt5ZZFNACgthRvrA=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:50.852424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-330662b8-5f04-4044-9735-17b74573c989 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:50.866246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-330662b8-5f04-4044-9735-17b74573c989 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for user 6a1f6ab8c2724d2f997bd3c2a081d653 and project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:50.935455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-330662b8-5f04-4044-9735-17b74573c989 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.337471 Aug 25 12:33:50.937551 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 345/687] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:33:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:33:50.958941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:50.961220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:50.982166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:50.989493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:50.990062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:50.991121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:50.991408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:50.991847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.451664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:51.462554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:33:51.464265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:33:51.464265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:33:51.464265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:33:51.464742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:33:51.468213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-10589de6-b740-4e0b-b83f-949075f3e5c1 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.527398 Aug 25 12:33:51.469172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 346/688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:50 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:51.478886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:51.479822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:51.484931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.488753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.489578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.490698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.490865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.491228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.491703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.492655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.493753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.493930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.494837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.495456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.547218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:51.553029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:51.621379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:33:51.636580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:33:51.769613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:51.785811 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-466f5367-3886-47d7-b5d9-24995cad8aa9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 0.315282 Aug 25 12:33:51.787757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 347/689] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:51 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:51.796781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e7d4da2-0a90-46e9-98ea-5c4dcf87e16d tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Action: 'create', calling method: .version_select at 0x7fc6c2d24dc0>, body: {"keypair": {"name": "tempest-keypair-1540972794", "type": "ssh", "user_id": "34ce709f3b71445dbcdbbc0d52acd2b8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgkWftRVbY4EVWhhZ7wh6+ok+taYNP24Jp0W4hUZpUNhYgAkVChpI18flofbCvA2QkshNQ5+ZdijmtCTsjZUjFrAI4UvPhwBnzdav7SatRzM14mjualAjzHZo0Uny37dQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:51.849255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-0e7d4da2-0a90-46e9-98ea-5c4dcf87e16d tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:51.859767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-0e7d4da2-0a90-46e9-98ea-5c4dcf87e16d tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for user 6a1f6ab8c2724d2f997bd3c2a081d653 and project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:51.892843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02771d4f-d9df-4050-9702-8d1afa4f137c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.266783 Aug 25 12:33:51.909243 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 343/690] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:33:51.915553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:51.916203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:51.961236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.962206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.965181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.966764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:51.967585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:51.968468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:51.990507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e7d4da2-0a90-46e9-98ea-5c4dcf87e16d tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.201277 Aug 25 12:33:51.991184 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 348/691] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:33:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:33:52.012587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-501858a1-0b58-454f-94bb-cd035ede5327 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:52.013621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-501858a1-0b58-454f-94bb-cd035ede5327 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:52.314238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-501858a1-0b58-454f-94bb-cd035ede5327 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:52.333332 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-501858a1-0b58-454f-94bb-cd035ede5327 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1214 microversion: 2.1 time: 0.327443 Aug 25 12:33:52.334488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 349/692] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:51 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:52.353722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40242643-203f-4e2d-9e0c-99535ca108be tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Calling method '.version_select at 0x7fc6c2c02c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:52.402098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40242643-203f-4e2d-9e0c-99535ca108be tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-842305839?user_id=34ce709f3b71445dbcdbbc0d52acd2b8" status: 200 len: 511 microversion: 2.10 time: 0.062054 Aug 25 12:33:52.403178 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 350/693] 10.222.0.60 () {60 vars in 1337 bytes} [Thu Aug 25 12:33:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-842305839?user_id=34ce709f3b71445dbcdbbc0d52acd2b8 => generated 511 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:33:52.445371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8426ad4e-ad48-40ae-a497-2af06c423201 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Action: 'create', calling method: .version_select at 0x7fc6c2d67790>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1331479688", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFix8AhB7jKJLLltiYycDP6dl1Oyk6imkBikBea0lW0FYCj/Q+r6nHFGGhWh1nROJ5b5+Gk+OQLU/DFqDayN0s3VW6RECmlv37C9t8DFv91hzNV2lYa8I9fU0WFYRpvwmw=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:52.480085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8426ad4e-ad48-40ae-a497-2af06c423201 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:52.491566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8426ad4e-ad48-40ae-a497-2af06c423201 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Getting quotas for user 6a1f6ab8c2724d2f997bd3c2a081d653 and project 4a967047b45a47bb90de8e73746b7601. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:52.548573 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8426ad4e-ad48-40ae-a497-2af06c423201 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.120477 Aug 25 12:33:52.566717 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 351/694] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:33:52 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:33:52.586389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:52.593621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:52.634623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:52.636611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:52.639685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:52.644420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:52.651680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:52.656080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:52.951646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:52.991982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:52.996990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:53.000996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74523c81-41be-4c17-8735-305d9e553612 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1558 microversion: 2.25 time: 1.089542 Aug 25 12:33:53.004355 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 344/695] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:51 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1558 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:53.027959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b1fc3a5-ad8d-4887-abfa-960a818dbe96 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Calling method '.version_select at 0x7fc6c2c73820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.076859 n-d-850468-18 devstack@n-api.service[122700]: WARNING oslo_db.sqlalchemy.utils [None req-5b1fc3a5-ad8d-4887-abfa-960a818dbe96 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:33:53.114754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b1fc3a5-ad8d-4887-abfa-960a818dbe96 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "GET /compute/v2.1/os-keypairs?user_id=34ce709f3b71445dbcdbbc0d52acd2b8" status: 200 len: 725 microversion: 2.10 time: 0.103730 Aug 25 12:33:53.121062 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 345/696] 10.222.0.60 () {60 vars in 1259 bytes} [Thu Aug 25 12:33:53 2022] GET /compute/v2.1/os-keypairs?user_id=34ce709f3b71445dbcdbbc0d52acd2b8 => generated 725 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:33:53.157378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.158809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:53.197790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.203155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.203798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.205504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.206913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.207649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.480739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:53.536215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38205c1d-c8a1-4586-868d-89d9afa28f1a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.965729 Aug 25 12:33:53.545828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 352/697] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:52 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:53.602978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4e6c529-b7ea-4252-8034-3a607a7e1892 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '.version_select at 0x7fc6c2d24c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.619712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e6c529-b7ea-4252-8034-3a607a7e1892 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.622197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e6c529-b7ea-4252-8034-3a607a7e1892 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.625167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e6c529-b7ea-4252-8034-3a607a7e1892 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.703406 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4e6c529-b7ea-4252-8034-3a607a7e1892 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.133154 Aug 25 12:33:53.729632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 353/698] 10.222.0.60 () {60 vars in 1184 bytes} [Thu Aug 25 12:33:53 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:33:53.745376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46e3351e-6fdf-4d28-bcf1-c8c197dcd7d1 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Calling method '.version_select at 0x7fc6c2eed790>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.760641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:53.785642 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da25486c-4a9f-4440-abc6-4cee90208754 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 0.659723 Aug 25 12:33:53.796210 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 346/699] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:53 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:53.818136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46e3351e-6fdf-4d28-bcf1-c8c197dcd7d1 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1331479688" status: 204 len: 0 microversion: 2.10 time: 0.085611 Aug 25 12:33:53.819059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 354/700] 10.222.0.60 () {60 vars in 1325 bytes} [Thu Aug 25 12:33:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1331479688 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:33:53.826976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.827866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:53.832914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:53.834128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:53.849435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.850444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.851095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.851878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.852416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.852701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.854315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.854787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:53.855820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.856582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:53.856707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:53.857206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:54.039277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:54.057134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd477af5-41be-4a04-add2-c482c786811e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1210 microversion: 2.1 time: 0.255255 Aug 25 12:33:54.058083 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 347/701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:53 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:54.062879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fcde0fca-a152-4dc5-874d-c2265df4c111 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Calling method '.version_select at 0x7fc6c2c2de50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:54.106988 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fcde0fca-a152-4dc5-874d-c2265df4c111 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540972794?user_id=34ce709f3b71445dbcdbbc0d52acd2b8" status: 204 len: 0 microversion: 2.10 time: 0.047751 Aug 25 12:33:54.107690 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 348/702] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540972794?user_id=34ce709f3b71445dbcdbbc0d52acd2b8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:33:54.121930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3662d97-cfb8-419b-a4bd-3d1f5dfc5504 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] Calling method '.version_select at 0x7fc6c2c4d8b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:54.154620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3662d97-cfb8-419b-a4bd-3d1f5dfc5504 tempest-KeyPairsV210TestJSON-1887687935 tempest-KeyPairsV210TestJSON-1887687935-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842305839?user_id=34ce709f3b71445dbcdbbc0d52acd2b8" status: 204 len: 0 microversion: 2.10 time: 0.038301 Aug 25 12:33:54.155890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 349/703] 10.222.0.60 () {60 vars in 1340 bytes} [Thu Aug 25 12:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842305839?user_id=34ce709f3b71445dbcdbbc0d52acd2b8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 12:33:54.248551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:33:54.281975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e4f3c84-bb60-4e46-8ba9-c7ebd895202d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 2052 microversion: 2.25 time: 0.460220 Aug 25 12:33:54.282913 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 355/704] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:53 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 2052 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:54.532305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1045970105", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "88522008-cbe6-46f9-95cf-76e2176a4cab"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:33:54.614085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:54.615280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:54.658635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:54.677925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:54.679522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:54.684471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:54.689823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:54.700382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:54.818392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] validate_networks() for [('88522008-cbe6-46f9-95cf-76e2176a4cab', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:33:55.550809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:55.574334 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dffc1e08-ff8a-40b4-b8e2-ce5b0cd89632 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.982946 Aug 25 12:33:55.588878 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 356/705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:54 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:55.611308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:55.614247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:55.626322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:55.628915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:55.629974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:55.631592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:55.632710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:55.633738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.218275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:56.238410 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-023de7ad-3b15-4794-8730-8ece7cf1e99a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 0.646287 Aug 25 12:33:56.239656 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 357/706] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:55 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:56.247127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:56.250436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:56.277529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.278295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.280229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.281315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.281993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.282627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.442363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:56.461928 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d20ae35-173e-486c-9e98-4e69a5ec1352 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1272 microversion: 2.1 time: 0.220487 Aug 25 12:33:56.463296 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 358/707] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:56 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:56.627860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:33:56.630636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:33:56.633332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:33:56.640523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:33:56.641529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:33:56.646944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:56.649169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:56.685217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.689863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.693784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.695153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.696597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.700788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.702418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.705863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.709213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.715049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:56.717603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:56.722406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:56.808335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:33:56.816832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for user 3f41f5c8cf9e4d78b4fb62eac79b093e and project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:33:56.841132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:33:56.845641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:33:56.930663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20cd1bca-e2ba-4a50-862e-3600876afc57 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.407843 Aug 25 12:33:56.932305 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 350/708] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:33:56.956320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:56.961257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:57.126415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:57.137343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:57.138875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:57.140219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d03a452c-9fd0-411d-a7ad-91c0681a15fb tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1262 microversion: 2.25 time: 0.191638 Aug 25 12:33:57.148791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 351/709] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:56 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1262 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:57.279246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:57.280244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:57.302149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:57.302792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:57.303478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:57.306493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:57.307744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:57.310531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:57.433200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:57.451864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d7c68727-d589-4cb1-93d6-e32cbd7acadd tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 0.835903 Aug 25 12:33:57.453443 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 359/710] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:56 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:57.499981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:57.500829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:57.514604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:57.521116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:57.523870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:57.526250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:57.529363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:57.530502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:57.913521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:57.949408 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d098be2f-ab2b-4b33-983b-1defa1f2eccc tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 0.676570 Aug 25 12:33:57.951364 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 352/711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:57 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:58.167102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:58.192453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:58.200257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:58.231253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eae36090-47e7-429b-a68e-9462e82268d1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 0.731097 Aug 25 12:33:58.232577 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 360/712] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:57 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:33:58.495081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:58.506186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:58.547414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:58.549518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:58.553248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:58.559627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:58.564749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:58.566285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:58.678164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:58.740429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:58.756346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:33:58.762846 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-adaf6760-ec62-4cac-8adc-dbc9754ee0ca tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1262 microversion: 2.25 time: 0.578582 Aug 25 12:33:58.771029 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 353/713] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:33:58 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1262 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:33:58.998327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:33:59.003002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:33:59.052629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:59.053530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:59.054299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:33:59.074255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:33:59.075014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:33:59.075804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:00.917999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:00.924391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:00.948530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-074cb9f2-dbc6-49cf-b5fb-57eefa5cb195 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.957778 Aug 25 12:34:00.949552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 354/714] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:58 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:00.965390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:00.987318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:01.005144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-268abbe1-6483-4a21-bfd7-7f6aa726e18a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 2.518011 Aug 25 12:34:01.020162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:01.020504 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 361/715] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:33:58 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:34:01.040944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:01.041811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:01.042613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:01.043958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:01.044642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:01.046254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:01.056077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:01.069128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:01.079051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:01.079051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:01.079051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:01.080807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:01.081257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:01.082067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:01.736314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:01.761797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:01.782337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:01.785380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4cae98fb-ee34-4aac-b1f3-fb9102f9347b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1320 microversion: 2.25 time: 0.773328 Aug 25 12:34:01.804953 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 362/716] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:01 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:01.956001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6b6e57-a376-4a96-8320-528d7d73e598", "tag": "8784e245-6dcf-4fe4-ab89-cd12aaa1705b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:01.977142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:02.030944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:02.031953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:02.032774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:02.096598 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] Creating event network-changed:8784e245-6dcf-4fe4-ab89-cd12aaa1705b for instance 8c6b6e57-a376-4a96-8320-528d7d73e598 on n-h1-850468-18 Aug 25 12:34:02.113863 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-75d2ca1c-314b-40e1-a546-f2eb7c25bd72 req-5f635247-8989-45a1-b7ab-cb5eca236785 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162674 Aug 25 12:34:02.114805 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 363/717] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:34:02.121399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:02.122119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:02.134838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:02.135335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:02.136081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:02.137019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:02.137674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:02.138799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:02.511464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:02.563278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:02.605233 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a712c412-320d-4bf2-8893-cf181241ba4d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 1.631251 Aug 25 12:34:02.618136 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 355/718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:00 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:02.670194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:02.698383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:02.728230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:02.729390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:02.730050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:02.734422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:02.753499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:02.756084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:03.676213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:03.712536 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99ede031-63cf-49f2-95aa-620561361785 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.577617 Aug 25 12:34:03.714923 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 364/719] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:02 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:04.291713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2007376916", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:04.445027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] validate_networks() for [('c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:04.782761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:04.796947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9ef5193-1f7b-4978-aa79-444955201fa3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 2.171685 Aug 25 12:34:04.815394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 356/720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:02 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:04.827425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:04.829514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:04.850514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:04.853040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:04.857390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:04.859224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:04.863623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:04.866357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:06.385369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:06.421950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:06.427450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:06.433851 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1795b0b9-e12d-4b4f-9d32-bf69fc24191d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 1.616593 Aug 25 12:34:06.444623 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 357/721] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:04 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:06.759644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:06.942828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fff2c635-984c-488c-bcd9-e03d0a6b3e44 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Action: 'create', calling method: .version_select at 0x7fc6c2f01550>, body: {"keypair": {"name": "tempest-keypair-1837291591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItrjaWESGtQDHa6fkBEFhFGJkF70b8K3zn86iwtaMhLEnOAEfCGZJxXLEqJuH8igs5Nux7GR9933CqdCEVWYxqPOyr8Yk/xGRd8Ib0iRPdG3LuRxz1UMtSuefhu0bkTYg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:07.019363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-fff2c635-984c-488c-bcd9-e03d0a6b3e44 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:07.027946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-fff2c635-984c-488c-bcd9-e03d0a6b3e44 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for user 3c97779db8554723a2c447c5d0ed22d5 and project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:07.080782 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fff2c635-984c-488c-bcd9-e03d0a6b3e44 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.633469 Aug 25 12:34:07.092918 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 358/722] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:34:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:07.106875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:07.109570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:07.129586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.130684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.131543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.132927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.133917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.134987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.135410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:07.136201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:07.136964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:07.137678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:07.138402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:07.178393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.179222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.180900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.182342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.183194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.183968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.253082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:07.268574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for user 6121e19dc50b45ca979df57e9e0b48ea and project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:07.314252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:07.320292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:07.458546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32becdea-04fa-46bc-bda2-213728454f28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.739783 Aug 25 12:34:07.471226 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 365/723] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:34:07.490360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519b617d-0180-4dfe-aa10-db9209b73838", "name": "network-vif-plugged", "status": "completed", "tag": "df39056c-cfa7-4020-a7db-693239148f08"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:07.543400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.568532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.569902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.621636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] Creating event network-vif-plugged:df39056c-cfa7-4020-a7db-693239148f08 for instance 519b617d-0180-4dfe-aa10-db9209b73838 on n-h2-850468-18 Aug 25 12:34:07.644428 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6b36dbaa-d165-47f9-be57-e3f1d771b276 req-cb70c53b-b979-4395-aabe-60f2c5b43230 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166161 Aug 25 12:34:07.646374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 366/724] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:07.685990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:07.688048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:07.706547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.708018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.709218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:07.710944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:07.712193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:07.713613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:08.170026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:08.194435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0b8a2e8-d1e5-4644-9ed8-0a7db7810dea tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 1.098617 Aug 25 12:34:08.200477 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 359/725] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:07 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:08.210358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:08.214366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:08.241943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:08.242824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:08.243607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:08.253036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:08.254442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:08.255219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:08.594186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:08.663066 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc48f3d7-44f3-4763-92a8-07bc905206ed tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1387 microversion: 2.1 time: 1.014263 Aug 25 12:34:08.671785 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 367/726] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:07 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1387 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:08.695588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:08.697166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:08.711801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:08.713640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:08.714638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:08.716100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:08.717183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:08.718280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:08.786246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:09.983148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:10.006855 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aae0e2c5-40c9-413d-a581-f4a0895a0e01 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 1.804894 Aug 25 12:34:10.016642 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 360/727] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:08 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:10.051219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:10.051972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:10.079270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:10.084820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:10.119618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:10.123332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:10.124078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:10.125547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:10.394614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:10.415686 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29a092a7-d3b1-4276-91cd-b35633eadf94 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1260 microversion: 2.1 time: 0.396912 Aug 25 12:34:10.424712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 361/728] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:10 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1260 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:10.472598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:10.496496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:10.498469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:10.506050 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e299aea-5684-445d-aed5-b8b9a3df5256 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 1.827195 Aug 25 12:34:10.516090 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 368/729] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:08 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:10.543234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:10.547845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:10.562239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:10.562719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-716616920", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "3717ae61-80a1-4058-8a2c-1416a7cabe97"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:10.565537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:10.567862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:10.569074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:10.575906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:10.576757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:10.694542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] validate_networks() for [('3717ae61-80a1-4058-8a2c-1416a7cabe97', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:11.852972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:11.866824 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4cbaad71-5429-4e03-bf4c-2bd6726c548d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 1.347744 Aug 25 12:34:11.871505 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 369/730] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:10 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:11.882000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:11.885915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:11.897450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:11.902298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:11.902696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:11.903713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:11.904199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:11.904696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:13.760351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:13.775937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9393d77-6786-40d3-8864-a6c13fc4581a tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1585 microversion: 2.1 time: 1.902752 Aug 25 12:34:13.788874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 370/731] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:11 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1585 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:13.800962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61c5bb-e595-4272-a2db-69cd3886a0c4", "name": "network-vif-plugged", "status": "completed", "tag": "c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:13.818907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:13.820302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:13.823517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:13.854531 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] Creating event network-vif-plugged:c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327 for instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 on n-h1-850468-18 Aug 25 12:34:13.863706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6be2e57e-3269-4c21-b51f-01a0e7b0e31b req-fee75c4c-e813-4aca-9ec1-fcee4362da40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073070 Aug 25 12:34:13.866532 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 371/732] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:13.874776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:13.877198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:13.888938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:13.890924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:13.895384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:13.896805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:13.897997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:13.899795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:14.340899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:14.341674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:14.342833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:14.346445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:14.347617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:14.382330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:14.386465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:14.388028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:14.389874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:14.391058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:14.392226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:14.448685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Getting quotas for project 3e9466a4a4154bfeb4755f53ca566af5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:14.466619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Getting quotas for user 0b7729727225458aa40314510167ef94 and project 3e9466a4a4154bfeb4755f53ca566af5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:14.509402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:14.514312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:14.609788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:14.660865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37f0cc36-415a-4956-b4c5-fbf5fc1acf6c tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.234418 Aug 25 12:34:14.662038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 362/733] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:34:14.672277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:14.673941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:14.686585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:14.687713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:14.689974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:14.691422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:14.692356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:14.693317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:16.088087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:16.108477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:16.121005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6715d0e-c132-468f-a5f6-dbf835f60842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1266 microversion: 2.1 time: 1.456940 Aug 25 12:34:16.122074 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 363/734] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:14 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1266 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:16.135622 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8ec78ea-273d-4fcb-8567-8cebc99d19fc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1317 microversion: 2.1 time: 2.266819 Aug 25 12:34:16.138035 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 372/735] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:13 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1317 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:16.197419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2e7d65-45b4-4a82-8d30-a015e2af5447", "tag": "b291c31b-93f0-4216-ad65-33712305c4b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:16.217899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:16.218919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:16.246400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:16.247934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:16.249037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:16.279791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:16.289139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:16.290101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:16.291516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:16.295823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:16.302612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:16.310561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] Creating event network-changed:b291c31b-93f0-4216-ad65-33712305c4b9 for instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 on n-h2-850468-18 Aug 25 12:34:16.356646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-aa5ab94d-dc07-4da1-91f3-82611fb2fae9 req-09dcdbc2-2b57-429a-b931-a887843745a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215048 Aug 25 12:34:16.358497 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 373/736] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:16.384684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:16.387160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:16.398427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:16.399590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:16.400867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:16.402212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:16.403007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:16.403690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:17.221471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:17.309519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:17.312054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:17.332898 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4b4ade0-4903-4c9a-9c42-68e41695fe13 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 0.967390 Aug 25 12:34:17.334815 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 374/737] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:16 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:17.349236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:17.349966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:17.361237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:17.368688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:17.373287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:17.375729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:17.380573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:17.381528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:17.382208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:17.402044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:17.417893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:17.426280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de217031-d78e-43da-b58d-31f8feee59e8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 1.258906 Aug 25 12:34:17.430735 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 364/738] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:16 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:17.475072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:17.499537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:17.546589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:17.551594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:17.552944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:17.553880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:17.554372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:17.568783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:18.173605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:18.211756 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81d73565-6878-4c94-8cbc-141d4df1b537 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1227 microversion: 2.1 time: 0.765838 Aug 25 12:34:18.212657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 365/739] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:17 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1227 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:18.250748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:18.272630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:18.326593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:18.330649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:18.339515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:18.340381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:18.341076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:18.341541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:18.346333 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-085a14cb-7948-4faa-928d-429793b17735 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.009779 Aug 25 12:34:18.349404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 375/740] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:34:17 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838/os-interface => generated 284 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:18.376096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:18.380255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:18.406942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:18.409334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:18.410750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:18.413273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:18.414889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:18.418364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:19.662637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:19.679208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de5884f2-b199-4e70-ac3d-ad3faa48b9cc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 1.435629 Aug 25 12:34:19.679815 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 366/741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:18 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:19.685354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6b6e57-a376-4a96-8320-528d7d73e598", "name": "network-vif-plugged", "status": "completed", "tag": "8784e245-6dcf-4fe4-ab89-cd12aaa1705b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:19.714527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:19.715413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:19.716197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:19.734491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:19.745086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-76b4dabc-b201-406e-9d1f-8d2e77ca2444 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1467 microversion: 2.1 time: 1.393255 Aug 25 12:34:19.752761 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 376/742] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:18 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1467 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:19.753328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] Creating event network-vif-plugged:8784e245-6dcf-4fe4-ab89-cd12aaa1705b for instance 8c6b6e57-a376-4a96-8320-528d7d73e598 on n-h1-850468-18 Aug 25 12:34:19.759204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:19.765820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:19.786154 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-55bdba17-eb89-44fb-9ad7-3ae5b73fdecb req-c34cddb7-a5e2-4d38-97ba-213f3fa0ea84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098921 Aug 25 12:34:19.787244 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 367/743] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:19.790168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:19.790913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:19.791655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:19.792751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:19.793237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:19.793681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:19.807829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:19.809126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:19.858087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:19.869111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:19.870897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:19.879915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:19.881498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:19.882683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:21.443895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:21.487517 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1269b83a-3e26-4036-aed0-cfa1db983264 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1314 microversion: 2.1 time: 1.730002 Aug 25 12:34:21.495315 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 377/744] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:19 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1314 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:21.538794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:21.540253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:21.554961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:21.556452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:21.557561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:21.559136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:21.560636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:21.561805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:21.699374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:21.734610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:21.750135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:21.755199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6143e442-59ae-43dc-9e3a-02592baf8795 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 1.965694 Aug 25 12:34:21.769367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 368/745] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:19 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:21.793256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1306183633", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c466f89d-b626-4741-a445-83dbda6c02ea"}], "security_groups": [{"name": "tempest-securitygroup--1100996031"}], "key_name": "tempest-keypair-1837291591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:22.468742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] validate_networks() for [('c466f89d-b626-4741-a445-83dbda6c02ea', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:22.763078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:22.776836 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-589d8b86-63e4-4660-8605-af1e63a48332 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 1.259087 Aug 25 12:34:22.777764 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 378/746] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:21 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:23.459668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:23.460473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:23.477599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:23.478203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:23.478833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:23.484190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:23.488201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:23.488809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:24.425069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:24.481737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:24.597471 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57eb9e33-e820-4d4e-aea8-818b9fb187a2 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1620 microversion: 2.1 time: 1.806765 Aug 25 12:34:24.603469 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 379/747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:22 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1620 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:24.618176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:24.621797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:24.635822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:24.639471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:24.640679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:24.645457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:24.647003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:24.647718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:25.764583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:25.765734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:25.766402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:25.767736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:25.769468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:25.783398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:25.784848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:25.785750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:25.786742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:25.787382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:25.788279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:25.815552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:25.822182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for user 3c97779db8554723a2c447c5d0ed22d5 and project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:25.839466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:25.842606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:25.922762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-183d7b67-50ff-46ae-8755-1a6b05ceffb3 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.136531 Aug 25 12:34:25.931979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 369/748] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 4162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:34:25.937864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:25.938773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:25.949451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:25.950456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:25.951432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:25.952845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:25.953502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:25.954093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:26.000325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:26.015185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f672e38-995e-46b8-ae73-d2de99f6bea9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 1.409509 Aug 25 12:34:26.016604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 380/749] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:24 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:26.042370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519b617d-0180-4dfe-aa10-db9209b73838", "tag": "df39056c-cfa7-4020-a7db-693239148f08"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:26.090734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:26.092029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:26.093352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:26.151343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] Creating event network-changed:df39056c-cfa7-4020-a7db-693239148f08 for instance 519b617d-0180-4dfe-aa10-db9209b73838 on n-h2-850468-18 Aug 25 12:34:26.167626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1bb12897-ec06-4a64-9dd6-ef825ade1193 req-e9de60cc-0bd5-4684-a8f2-b0cd9d60396d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131220 Aug 25 12:34:26.172729 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 381/750] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:26.206619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:26.208551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:26.236724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:26.238148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:26.239355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:26.248710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:26.249646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:26.250591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:27.380320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:27.407390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7185bf1e-4aa3-4bd0-919e-ce46ca12afcf tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1585 microversion: 2.1 time: 1.473382 Aug 25 12:34:27.415339 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 370/751] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:25 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1585 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:27.437266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:27.439006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:27.462702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:27.464145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:27.466324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:27.468337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:27.469547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:27.471826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:27.659167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:27.689531 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a487319f-e98f-4620-9c82-d81c10db1aa8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1502 microversion: 2.1 time: 1.510254 Aug 25 12:34:27.695364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 382/752] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:26 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1502 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:27.717500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5359d43-a53b-4c4b-9de0-5e522e23afc1", "tag": "8b88fb02-b435-47c5-9e40-271604906d50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:27.739218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:27.746871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:27.747884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:27.901729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:27.946154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:27.964807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:27.970817 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b514cfa3-0469-42ec-8f76-53fc14e9cb4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 0.551843 Aug 25 12:34:27.976798 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 371/753] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:27 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:28.006624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:28.008653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:28.050871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:28.052331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:28.080372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:28.085251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:28.086652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:28.087969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:28.155547 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] Creating event network-changed:8b88fb02-b435-47c5-9e40-271604906d50 for instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 on n-h1-850468-18 Aug 25 12:34:28.172526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a076381d-a9bf-429e-9d82-ba7c24666bb7 req-2108b875-e311-4706-be27-02a9b1e65eea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474108 Aug 25 12:34:28.184458 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 383/754] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:28.213142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: .version_select at 0x7fc6c2d0bd30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-3431964", "policies": ["affinity"]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:28.269448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:28.285523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:28.393671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:28.405948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:28.430412 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-497b8f17-c748-4e1a-ab73-b1804b1070c3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.251588 Aug 25 12:34:28.447161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 384/755] 10.222.0.60 () {60 vars in 1174 bytes} [Thu Aug 25 12:34:28 2022] POST /compute/v2.1/os-server-groups => generated 185 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:28.465166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2e7d65-45b4-4a82-8d30-a015e2af5447", "name": "network-vif-plugged", "status": "completed", "tag": "b291c31b-93f0-4216-ad65-33712305c4b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:28.517483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:28.529502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:28.530537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:28.591839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] Creating event network-vif-plugged:b291c31b-93f0-4216-ad65-33712305c4b9 for instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 on n-h2-850468-18 Aug 25 12:34:28.613537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c069d7db-a194-4f6d-8890-c736e9e34ae2 req-254758cc-3d9c-47ac-8109-2ec072634bc0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163721 Aug 25 12:34:28.615620 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 385/756] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:28.635260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:28.648340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:28.669691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:28.672013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:28.673164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:28.675827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:28.682153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:28.683429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.031884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:29.041513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cab05d62-2112-4457-82aa-218df5c54969 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1300 microversion: 2.1 time: 0.415340 Aug 25 12:34:29.052590 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 386/757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:28 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1300 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:29.066838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:29.068020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:29.091277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.092012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.092670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.096769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.097594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.098373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.261819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:29.331413 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b13c0ff-053e-4b90-b2e5-38dcec970644 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 1.352151 Aug 25 12:34:29.346824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 372/758] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:27 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:29.358923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:29.360366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:29.383267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.384765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.386082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.388017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.389153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.390259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.473063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:34:29.551044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:29.602437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:29.623638 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8fc6450f-c910-4ea1-b378-5fea62219900 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 0.569473 Aug 25 12:34:29.632245 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 387/759] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:29 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:29.639329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-159755902", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5a7e4f2d-3250-4112-ab92-19ce64b81514"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:29.724548 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b594593-abdb-4c51-aa73-316ee3cabec3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 204 len: 0 microversion: 2.1 time: 0.373306 Aug 25 12:34:29.725807 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 373/760] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:34:29 2022] DELETE /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:34:29.734896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:29.739103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:29.749774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.750644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.752091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.753156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:29.753807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:29.754855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:29.809005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:30.724373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:30.760917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:30.767553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:30.776347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-966d7531-9367-426e-a291-581082bb101b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1362 microversion: 2.25 time: 1.041862 Aug 25 12:34:30.777997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 374/761] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:29 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1362 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:30.793225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:30.794351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:30.822128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:30.823003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:30.823788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:30.825075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:30.833172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:30.833966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:32.553043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:32.553940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:32.554837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:32.555595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:32.561822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:32.581847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:32.716583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:32.717802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:32.718800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:32.722386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:32.723716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:32.725682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:32.764519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:32.774550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:32.805503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 2 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:32.818611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:32.958360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122701) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 25 12:34:33.022318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:33.055796 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-935b74f5-2596-4ec6-b459-62922f711b8e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1508 microversion: 2.1 time: 2.275841 Aug 25 12:34:33.060986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 375/762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:30 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1508 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:33.090051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:33.096905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:33.100455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:33.102631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:33.128394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:33.129840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:33.135894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:33.137682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:33.139285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:33.140340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:33.222893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:33.233242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:33.284560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=9dc6ea59-df58-470e-97d1-a3d900ef2111,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:33.419021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:33.435359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:33.605924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:33.623155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:33.780313 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8be476df-4c5a-460e-af29-46cf3a550732 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.141089 Aug 25 12:34:33.787868 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 388/763] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 4155 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:34:33.814188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:33.844510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:33.846475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:33.847640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:33.915791 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] Creating event network-changed:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:34:33.926447 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0ac151ef-74f2-4534-8c13-46c7d010a8ca req-beca1f71-31c7-498c-8108-d8a3fb6369ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135819 Aug 25 12:34:33.927994 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 389/764] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:33.947889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:33.950060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:33.977307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:33.982617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:33.983859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:33.988189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:33.992846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:33.994078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.117517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:34.144338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-297013a6-914a-4954-bb2d-afe3e7c062f0 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 1.075567 Aug 25 12:34:34.146552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 376/765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:33 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:34.159744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:34.170629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:34.197964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.198947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.199745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.202579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.203302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.206303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.797620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:34.811316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:34.821970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:34.835374 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d0a6e72-3199-4f78-b84c-a35456b90eb2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 0.903234 Aug 25 12:34:34.838164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 390/766] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:33 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:34.842003 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bda796df-0bab-47a0-9668-6fdac6807727 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 0.685176 Aug 25 12:34:34.847879 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 377/767] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:34 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:34.863360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:34.866011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:34.877220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:34.900679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:34.901903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.903792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.904450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Searching by: {'deleted': False, 'project_id': '9887ac4ba161489dbc983267f299f400'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:34:34.905294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.908313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.911052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.911712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.952732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.954739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.957901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:34.959079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:34.961775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:34.962588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.140838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:34:35.273333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:35.304146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:35.308976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:35.318152 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23feb767-d5e3-45dc-9f27-2f8a5bc8e85d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1558 microversion: 2.25 time: 0.471200 Aug 25 12:34:35.334830 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 391/768] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:34 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1558 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:35.342046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:35.347656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:35.378154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.383726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.384730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.390087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.391552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.393223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.439234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5608a0b2-491c-4807-916b-0ba404467384 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.586077 Aug 25 12:34:35.447808 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 378/769] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:34:34 2022] GET /compute/v2.1/servers => generated 1002 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:35.450165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:35.452408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:35.464510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.466071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.466905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.468008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.468627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.469220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.833540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:35.897986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:35.899027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:35.912680 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c80f1b24-255d-4ce0-8edb-34d72c3d4839 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.469820 Aug 25 12:34:35.921609 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 379/770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:35 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:35.927760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:35.928476 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc2f8546-d4a9-49ea-ab66-57cd36393a07 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1508 microversion: 2.1 time: 0.602589 Aug 25 12:34:35.929405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:35.935407 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 392/771] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:35 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1508 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:35.953544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.954211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.959739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:35.971611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:35.971946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:35.973161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:35.974032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:35.974875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.000045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.000955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.003344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.011251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.012989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.014379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.210519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:36.242510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e46727a-d464-43d8-bd1e-a00eb7064f4d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1222 microversion: 2.1 time: 0.297594 Aug 25 12:34:36.245314 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 393/772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:35 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1222 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:36.261188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5359d43-a53b-4c4b-9de0-5e522e23afc1", "name": "network-vif-plugged", "status": "completed", "tag": "8b88fb02-b435-47c5-9e40-271604906d50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:36.291754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.295949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.296321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:36.297836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.317977 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-413788cd-bfc7-457e-b33d-284be3331663 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 2053 microversion: 2.25 time: 0.394840 Aug 25 12:34:36.319407 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 380/773] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:35 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 2053 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:36.325934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] Creating event network-vif-plugged:8b88fb02-b435-47c5-9e40-271604906d50 for instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 on n-h1-850468-18 Aug 25 12:34:36.326831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:36.327640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:36.337555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.338513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.339135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.340197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.340714 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7f59f086-cdbf-4d65-9cda-45481486c6c9 req-415f9acc-f6ff-451f-a1d2-8c6c046ebd4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092185 Aug 25 12:34:36.341157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.342196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.343199 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 394/774] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:36.353927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:36.358196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:36.379811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.380634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.414570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.417226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.418188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.418188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.747583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:36.777648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-877a5b1f-d02d-464b-a404-ece6ccf5b452 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 0.454235 Aug 25 12:34:36.794314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 381/775] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:36 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:36.816727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:36.818418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:36.822680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:36.827548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.828144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.828593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.829393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.830016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.830295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.844038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-426c0c02-0718-4e35-92b0-7cf1b9203a2d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 0.497321 Aug 25 12:34:36.846913 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 395/776] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:36 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:36.852677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6b6e57-a376-4a96-8320-528d7d73e598", "name": "network-vif-deleted", "tag": "8784e245-6dcf-4fe4-ab89-cd12aaa1705b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:36.867162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.867675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.868533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.884966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] Creating event network-vif-deleted:8784e245-6dcf-4fe4-ab89-cd12aaa1705b for instance 8c6b6e57-a376-4a96-8320-528d7d73e598 on n-h1-850468-18 Aug 25 12:34:36.895064 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a19222f2-0e48-45fe-a9da-059989920625 req-6821427e-8114-49c6-9bfd-24e0743dca12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046271 Aug 25 12:34:36.896566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 396/777] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:36.939605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:36.942084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:36.951895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.952815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.953524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:36.954482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:36.955504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:36.956193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.165422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:37.198717 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b5d40d7-dd92-4693-a3fe-3ab286c2e9c7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 2053 microversion: 2.25 time: 0.400677 Aug 25 12:34:37.202021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 382/778] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:36 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 2053 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:37.213377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:37.214344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:37.222963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.223555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.223999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.225134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.225603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.226871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.336815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.337669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.339554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.341054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lazy-loading 'fault' on Instance uuid 8c6b6e57-a376-4a96-8320-528d7d73e598 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:37.430462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:37.451421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:37.463778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-293eb355-496e-422b-99e2-bd96f779cb57 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.530131 Aug 25 12:34:37.465788 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 397/779] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:36 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:34:37.473790 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98494545-8b9e-4ae0-80fb-875ec0278a1b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1304 microversion: 2.1 time: 0.265425 Aug 25 12:34:37.475955 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 383/780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:37 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:37.483748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:37.489592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:37.493683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.493963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:37.495888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.497213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.501083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.502947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.505413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.519361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.522367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.524525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.526624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.530917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.531884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.601926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f2fa59d1-c296-4331-92c9-dfe72b1a9435 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.132173 Aug 25 12:34:37.602652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 398/781] 10.222.0.60 () {60 vars in 1217 bytes} [Thu Aug 25 12:34:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:34:37.623041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:37.625115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:37.652293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.654161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.660927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.662840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.663820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.664982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.694493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:37.713392 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93ff5e9e-bb01-498c-a24a-6a21c56a4992 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1270 microversion: 2.1 time: 0.234779 Aug 25 12:34:37.714663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 384/782] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:37 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:37.805028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:37.806224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:37.819414 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-813ffcb2-8f82-4dab-bfff-db6ffb98d3ff tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447/action" status: 202 len: 0 microversion: 2.25 time: 0.206510 Aug 25 12:34:37.820065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.820978 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 399/783] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:34:37 2022] POST /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:34:37.826299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.827253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.828655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.830386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.831228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.851222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:37.852891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:37.864137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.865458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.865918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:37.866696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:37.867157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:37.867599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.158921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:38.175202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0313caa5-c382-4a9f-9476-5cdc1a895e28 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 0.375190 Aug 25 12:34:38.175941 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 385/784] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:37 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:38.198011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:38.199135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:38.225125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.225997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.226921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.228394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.229240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.230017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.338129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:38.357077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e035612-6ed6-4b6c-abc7-74c8e250a31e tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 2058 microversion: 2.25 time: 0.514446 Aug 25 12:34:38.372859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 400/785] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:37 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 2058 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:38.506518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:38.507259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:38.521072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.534947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.534947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.535451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.538089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.538726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.613376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.613376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.614040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.614452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lazy-loading 'fault' on Instance uuid 8c6b6e57-a376-4a96-8320-528d7d73e598 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:38.665423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:38.679073 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aecf4136-f6eb-4542-8a63-cb22a4271310 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 0.494049 Aug 25 12:34:38.680085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 386/786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:38 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:38.688636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:38.689974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:38.701591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.702857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.703342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.705859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.707660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.708229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.710762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:38.731800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d564dd03-5e0c-421b-92f7-c4fe50f14a73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 200 len: 1304 microversion: 2.1 time: 0.231915 Aug 25 12:34:38.734159 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 401/787] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:38 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:34:38.753342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "name": "network-vif-plugged", "status": "completed", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:38.777989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:38.787370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.787953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.788899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.818102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] Creating event network-vif-plugged:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:34:38.827717 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5d72277d-508e-4bc5-bf8a-d9a7d7bdff9f req-93ed044b-50a5-4a6a-9c24-bee71d6d59fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090986 Aug 25 12:34:38.829538 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 402/788] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:38.840027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:38.841526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:38.856267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.856959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.857782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.859230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:38.860096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:38.862282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:38.991258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:39.004597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4349bec2-4901-4f15-92d6-d011aa85ad54 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.323164 Aug 25 12:34:39.024222 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 387/789] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:38 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:39.029587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39376edc-4364-4b3a-978a-a842f801a619", "tag": "cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:39.078242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.079395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.080504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.103130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:39.105479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:39.130685 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56130449-f640-44c7-b577-8ae2fea39b91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1276 microversion: 2.1 time: 0.298899 Aug 25 12:34:39.132731 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] Creating event network-changed:cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3 for instance 39376edc-4364-4b3a-978a-a842f801a619 on n-h2-850468-18 Aug 25 12:34:39.141085 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 403/790] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:38 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:39.159922 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-23c1f120-a27d-42b5-92ff-68c496a07582 req-affca3d3-50d3-46a2-b0a4-5630b19896f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133482 Aug 25 12:34:39.168244 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 388/791] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:39.203049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:39.209775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:39.230545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.231845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.238376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.239943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.240743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.241520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.422139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:39.424586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:39.437314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.439608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.441558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.443450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.444677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.445825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.662786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:39.679603 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-599ce321-3214-4dcc-9f6a-6bec1ce106f1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1308 microversion: 2.1 time: 0.483705 Aug 25 12:34:39.680698 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 404/792] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:39 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:39.724666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:39.730489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:39.746173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.746682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.747583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.751054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.752774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.753463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.840383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:39.907034 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e06def90-b8d6-4075-9bdc-c7687693de17 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 2038 microversion: 2.25 time: 0.493952 Aug 25 12:34:39.909741 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 389/793] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:39 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 2038 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:34:39.928046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:39.928978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:39.936914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.938138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.939221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.941155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:39.942418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:39.943954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:39.991738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 HTTP/1.1 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:34:39.995468 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:34:39.998732 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8c6b6e57-a376-4a96-8320-528d7d73e598'} Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:34:40.000100 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:34:40.002867 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:40.011113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:34:40.013506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dd2b4886-7b3e-43f5-aaa3-8a225b05b396 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 404 len: 111 microversion: 2.1 time: 0.101298 Aug 25 12:34:40.025470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 390/794] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:39 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:34:40.025684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": "auto"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:40.033673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:40.044887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.045773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.046571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:40.048177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.049592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.050815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:40.122291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'flavor' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:34:40.162315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Going to try to live migrate instance to n-h1-850468-18 {{(pid=122700) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:34:40.256987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:40.317136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee19528b-b9b8-4b9f-8660-504204f64325 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1323 microversion: 2.1 time: 0.597249 Aug 25 12:34:40.332152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 405/795] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:39 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:40.362600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:40.381419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:40.437214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.440001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.448670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:40.451864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.454005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.460931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:40.818491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:40.834157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e21170dd-e929-4775-9a95-b14f009de373 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.485410 Aug 25 12:34:40.835607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 406/796] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:40 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:40.845710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:40.847797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:40.860169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.862221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.863469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:40.866513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:40.867398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:40.868598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:41.027547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:41.038011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-223a3802-a9ea-4dc2-900a-5bffb6aaccd7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1276 microversion: 2.1 time: 0.200430 Aug 25 12:34:41.039329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 407/797] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:40 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:41.044756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1980014849", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:41.154177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:43.166172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:43.167643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:43.169078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:43.169535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:43.169962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:43.192541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:43.193482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:43.194111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:43.195065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:43.195722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:43.196347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:43.237763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:43.253730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:43.284523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:43.287507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:43.356563 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac47116b-5aba-4895-a0af-2f20b298dc79 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.315819 Aug 25 12:34:43.357883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 408/798] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:34:43.366803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:43.367801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:43.402739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:43.405988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:43.406852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:43.409352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:43.412821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:43.413563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:43.457503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:43.990726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:44.006537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-029e6d8b-daa8-4a5b-bfaa-82a0205a3082 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1488 microversion: 2.1 time: 0.646801 Aug 25 12:34:44.008089 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 409/799] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:43 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1488 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:44.033083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:44.035533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:44.047836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:44.049965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:44.051153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:44.052807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:44.055017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:44.056385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:44.595767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:44.629555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcca3e04-842e-40aa-984f-13308cfef6aa tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1520 microversion: 2.1 time: 0.619344 Aug 25 12:34:44.640711 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 410/800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:44 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1520 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:44.661661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:44.663654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:44.692338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:44.693849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:44.694970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:44.701172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:44.702110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:44.702902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.055288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:45.091929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da621a1f-34f9-4223-9040-7cbeaef9283a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447/action" status: 202 len: 0 microversion: 2.25 time: 5.075925 Aug 25 12:34:45.092857 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 391/801] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:34:40 2022] POST /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447/action => generated 0 bytes in 5078 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:34:45.100079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:45.101133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:45.107936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:45.109969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.111853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.113003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.114104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.114769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.115689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.129908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:45.144160 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd9b2a3d-e8c6-4d36-8b19-c4600dc8e7d8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.500394 Aug 25 12:34:45.151372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 411/802] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:44 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:45.167830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:45.168784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:45.186143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.186742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.187241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.188063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.189142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.189588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.359906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:45.387916 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-456ab86a-4a85-4e69-961a-b012d8e43c62 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1267 microversion: 2.1 time: 0.234403 Aug 25 12:34:45.390513 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 412/803] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:45 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:45.398382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:45.399436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:45.441900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.446566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.450118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.452065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.458273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.461287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.700827 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d9c2cd9-bf5a-4d9d-8a47-12af9fbe14e1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1/action" status: 202 len: 0 microversion: 2.1 time: 0.308563 Aug 25 12:34:45.707614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 413/804] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:34:45 2022] POST /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:34:45.714743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39753e43-9e1b-4721-81e9-7c2749f70d56 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'create', calling method: .version_select at 0x7fc6c2eedaf0>, body: {"pool": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:45.776745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:45.808658 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-75e752f8-db22-4a3c-b9ce-e6ce49d5f15e tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.713850 Aug 25 12:34:45.821696 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 392/805] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:45 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:45.830158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc6ea59-df58-470e-97d1-a3d900ef2111", "tag": "d1687c1a-4e75-42f3-a095-253e683d34a9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:45.870728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:45.872055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:45.873999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:45.934440 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] Creating event network-changed:d1687c1a-4e75-42f3-a095-253e683d34a9 for instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 on n-h1-850468-18 Aug 25 12:34:45.956495 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-74a97295-0035-4b40-b977-2f018de526e8 req-087d9303-1fe4-4937-aaf7-529c0a2bcb40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131253 Aug 25 12:34:45.977272 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 393/806] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:46.007541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:46.009523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:46.053612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:46.061311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:46.062183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:46.064392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:46.065506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:46.066414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.002300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:47.018983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:47.022028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:47.023905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b4a5c4c-1841-4f61-824c-5e442291f411 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 1.031388 Aug 25 12:34:47.025409 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 394/807] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:45 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:47.035133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7", "tag": "c72a276f-0950-48e1-ad55-cd55e887ea34"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:47.054426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.055858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.057330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.081211 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] Creating event network-changed:c72a276f-0950-48e1-ad55-cd55e887ea34 for instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 on n-h1-850468-18 Aug 25 12:34:47.090532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-661a1301-765e-4393-bf01-ffe6f973044b req-cc35606a-9e9c-4a4c-87ca-4deb7a391f9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062551 Aug 25 12:34:47.091816 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 395/808] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:47.104102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:47.105747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:47.120352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.121535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.123003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.124357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.125412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.126749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.494411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:47.509040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd060aee-7966-4e3d-a521-0d20e2d6e4c3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 200 len: 1473 microversion: 2.1 time: 0.414493 Aug 25 12:34:47.510633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 396/809] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:47 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:47.530312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39376edc-4364-4b3a-978a-a842f801a619", "name": "network-vif-plugged", "status": "completed", "tag": "cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:47.544278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.544902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.545292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.561009 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] Creating event network-vif-plugged:cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3 for instance 39376edc-4364-4b3a-978a-a842f801a619 on n-h2-850468-18 Aug 25 12:34:47.569365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8b921c6f-23bc-4032-b8f3-86d0ba569e0a req-a935bc7f-6003-4b23-a563-bf0f4299f54c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054769 Aug 25 12:34:47.573894 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 397/810] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:47.590206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:47.591069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:47.604240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.604994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.612935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.617253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:47.619821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:47.620598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:47.986484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:48.008366 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d72e8ab0-0aac-4220-823d-994ac48bde65 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1368 microversion: 2.1 time: 0.432129 Aug 25 12:34:48.028578 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 398/811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:47 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:48.059027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:48.072548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:48.092089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:48.093338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:48.093662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:48.098980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:48.099751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:48.100561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:48.257931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:48.278319 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9cc7806-fc70-487d-81bf-a4c965740f97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1273 microversion: 2.1 time: 0.243276 Aug 25 12:34:48.285418 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 399/812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:48 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:48.304317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:48.307401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:48.327612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:48.328911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:48.330696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:48.332374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:48.333463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:48.334438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.097896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:49.114005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1aa0034d-abe2-4b88-9205-18771029741f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.832723 Aug 25 12:34:49.115164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 400/813] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:48 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:49.127842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1836264754"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:49.131764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:49.147356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.148442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.149299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.151128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.151997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.152797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.570167 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1030b68-0e5e-4bbd-bfe7-a2106007bdbd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1/action" status: 202 len: 0 microversion: 2.1 time: 0.452878 Aug 25 12:34:49.581969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 401/814] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:34:49 2022] POST /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:34:49.581969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:49.582743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:49.592518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.592518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.593244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.593998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.595719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.595719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.741169 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39753e43-9e1b-4721-81e9-7c2749f70d56 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.030070 Aug 25 12:34:49.744643 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 414/815] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:34:45 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:49.753185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:49.755288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:49.782005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.784237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.785076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.786814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.797076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.797619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.889023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:49.912062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:49.915653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:49.918673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53a902d1-5e9d-43f9-8fb9-0949663d2020 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.344644 Aug 25 12:34:49.919768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 402/816] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:49 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:49.930203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:49.931615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:49.944579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.945889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.946907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:49.949092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:49.950255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:49.951320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:50.386250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:50.411232 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24fec582-019f-4740-93bd-c62b060abcdd tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1559 microversion: 2.1 time: 0.664563 Aug 25 12:34:50.412554 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 415/817] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:49 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1559 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:50.426842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:50.428475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:50.443231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:50.446562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:50.447758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:50.449699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:50.450337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:50.451134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:50.512463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:34:50.516390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:50.539577 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29cd0b70-f95c-4c91-97c5-4e2f731b8221 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.617354 Aug 25 12:34:50.543660 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 403/818] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:49 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:50.556906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8b42f6c-9988-4113-b43a-a8e51f31f8e7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2e4e4c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:50.653527 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8b42f6c-9988-4113-b43a-a8e51f31f8e7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.106743 Aug 25 12:34:50.654863 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 404/819] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:34:50 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:50.666578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-843364526", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "3717ae61-80a1-4058-8a2c-1416a7cabe97"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:50.770634 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-540fdfed-0b85-4427-8a6d-f25b68901ede tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 204 len: 0 microversion: 2.1 time: 0.355204 Aug 25 12:34:50.771785 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 416/820] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:34:50 2022] DELETE /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:34:50.791060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:50.793256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:50.807428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:50.808859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:50.810060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:50.811818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:50.813093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:50.815116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:50.817757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] validate_networks() for [('3717ae61-80a1-4058-8a2c-1416a7cabe97', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:34:51.231286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:51.284395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08e26237-d5a8-4eb3-83e9-df836c6d0024 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.504141 Aug 25 12:34:51.304676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 417/821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:50 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:51.321354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:51.322200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:51.338444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:51.339728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:51.341561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:51.343229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:51.344342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:51.346778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:51.572345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4704810e-3ea8-4dbe-86a2-28c29d80144c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265141 Aug 25 12:34:51.574261 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 418/822] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:34:51 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:51.593861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:51.596405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:51.612919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:51.614487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:51.615342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:51.619147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:51.621043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:51.622274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.132950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:34:52.133758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:34:52.134310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:34:52.136417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:34:52.137326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:34:52.155345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.156666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.157426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.159673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.160882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.161827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.203363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Getting quotas for project 3e9466a4a4154bfeb4755f53ca566af5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:34:52.213820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Getting quotas for user 0b7729727225458aa40314510167ef94 and project 3e9466a4a4154bfeb4755f53ca566af5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:34:52.234902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:34:52.239692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:34:52.257884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:52.272237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-234b5ecf-48c8-43c0-af40-e0c3754e5d86 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1709 microversion: 2.1 time: 0.695609 Aug 25 12:34:52.277370 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 419/823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:51 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1709 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:52.293539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:52.295457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:52.307632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.308615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.309702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.311534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.312557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.314249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.326152 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c702ad8d-a16a-49a6-b474-21d2cba36bbc tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669193 Aug 25 12:34:52.335015 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 405/824] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:34:52.341862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:52.343215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:52.352421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.353358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.354370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.355982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:52.356907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:52.357897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:52.363709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:52.915974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:52.939652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:52.941206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:52.942483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8aa6e54-0fa8-4fa4-b955-7e6a2cd47960 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.660874 Aug 25 12:34:52.956914 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 420/825] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:52 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:52.972154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0761041c-a953-4dc5-9e95-1a85674963d2 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2e879d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:52.972457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:52.984037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e65580e4-d61d-4ddb-9c72-4064dbe4b364 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.647472 Aug 25 12:34:52.997856 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 406/826] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:52 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:53.008726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:53.009351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:53.031362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:53.037669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:53.038455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:53.039768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:53.040634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:53.041371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:53.078602 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0761041c-a953-4dc5-9e95-1a85674963d2 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.119222 Aug 25 12:34:53.081403 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 421/827] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:34:52 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:53.093026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0788b3ed-f356-4e23-91ef-16638a65e1ec tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:53.094789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0788b3ed-f356-4e23-91ef-16638a65e1ec tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:53.216965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:53.239446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0788b3ed-f356-4e23-91ef-16638a65e1ec tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:53.256003 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0788b3ed-f356-4e23-91ef-16638a65e1ec tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1223 microversion: 2.1 time: 0.171843 Aug 25 12:34:53.258970 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 422/828] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:53 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:53.283237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e72649d3-a6c6-4f73-9888-c0474abfedff", "tag": "22e0fa73-c453-4684-a2e9-9dbd3d39471f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:53.309953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:53.310675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:53.311357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:53.326125 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] Creating event network-changed:22e0fa73-c453-4684-a2e9-9dbd3d39471f for instance e72649d3-a6c6-4f73-9888-c0474abfedff on n-h1-850468-18 Aug 25 12:34:53.332780 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f5e5b2a5-a28b-4282-a539-f4a9eebf0322 req-70c4d6b0-e7fd-473c-979d-76fc39547a18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070373 Aug 25 12:34:53.333956 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 423/829] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:53.339931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:53.341100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:53.348894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:53.349575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:53.349993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:53.350735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:53.351363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:53.351893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:54.122556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:54.146657 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13e6c348-cc30-4fca-b064-05bd6e903520 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 1.147510 Aug 25 12:34:54.147887 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 407/830] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:52 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:54.155478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:54.159820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:54.188324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:54.190540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:54.191383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:54.192303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:54.193019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:54.194290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:54.283803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:54.318697 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-668482fa-befd-42bc-a1b5-509fb2240e72 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1709 microversion: 2.1 time: 0.982073 Aug 25 12:34:54.325332 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 424/831] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:53 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1709 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:54.332992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:54.342446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:54.362862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:54.363944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:54.364768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:54.374707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:54.375650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:54.376906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:55.458818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:55.481346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:55.483940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:55.487839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-361e103d-db6b-4784-86c0-051e10478f6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 1.336266 Aug 25 12:34:55.489381 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 408/832] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:54 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:55.496065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-23612eab-567e-4e63-8346-b81ac25b3b20 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2d689d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:55.498286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:55.515670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31a9d42d-65e7-42cf-94e2-b6fe5e95bd7e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 1.188090 Aug 25 12:34:55.537055 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 425/833] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:54 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:55.548885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:55.550948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:55.613064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:55.618321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:55.619579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:55.624628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:55.625238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:55.626454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:55.629978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-23612eab-567e-4e63-8346-b81ac25b3b20 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.138595 Aug 25 12:34:55.632191 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 409/834] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:34:55 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:55.651031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc6ea59-df58-470e-97d1-a3d900ef2111", "name": "network-vif-plugged", "status": "completed", "tag": "d1687c1a-4e75-42f3-a095-253e683d34a9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:55.682304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:55.683572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:55.686451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:55.714143 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] Creating event network-vif-plugged:d1687c1a-4e75-42f3-a095-253e683d34a9 for instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 on n-h1-850468-18 Aug 25 12:34:55.736152 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8d204a96-c88b-4e78-ac66-f6e6bd4b3ebe req-c2bd561e-59b0-400d-a438-38e1e8d52253 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097858 Aug 25 12:34:55.740853 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 410/835] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:55.753234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:55.754955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:55.778946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:55.780162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:55.787274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:55.794478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:55.796305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:55.801860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:56.140793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:56.154974 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a31849b-b85b-4983-9cd4-382d1cc095e5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1281 microversion: 2.1 time: 0.615540 Aug 25 12:34:56.168151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 426/836] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:55 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1281 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:56.168151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:56.169660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:56.207430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:56.208272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:56.208893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:56.209954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:56.211140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:56.213351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:56.224001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:34:56.570231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa2df29675141de952756ad23f15926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c932bd810047c7915941697021fdb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:56.601562 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-77df194e-8a02-44cc-ad32-520691721ab0 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 200 len: 1641 microversion: 2.1 time: 0.442140 Aug 25 12:34:56.603072 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 427/837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:56 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 1641 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:56.625600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:56.628028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:56.648739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:56.653567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:56.654664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:56.661053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:56.662363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:56.663153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:57.700529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:57.709579 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc218b14-ee02-4e6a-b2f8-1096b4d14151 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 1.966547 Aug 25 12:34:57.724789 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 411/838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:55 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:57.730521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:57.731501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:57.740801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:57.742255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:57.743130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:57.744064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:57.744775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:57.745375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:58.733922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:58.756664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:58.758933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:58.760792 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-422d9dbe-7ce2-485a-b920-cb1d595a4c0c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 2.152902 Aug 25 12:34:58.773290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 428/839] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:56 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:34:58.794103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d49b8489-c80b-4043-b9ea-840bf06ba0a5 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c9f790>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:58.830658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:58.873356 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84a7d781-2be4-4dc2-8ce7-f982288bc864 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 1.146794 Aug 25 12:34:58.874295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 412/840] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:57 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:58.888095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d49b8489-c80b-4043-b9ea-840bf06ba0a5 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.113050 Aug 25 12:34:58.900496 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 429/841] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:34:58 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:58.905271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519b617d-0180-4dfe-aa10-db9209b73838", "name": "network-vif-deleted", "tag": "df39056c-cfa7-4020-a7db-693239148f08"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:58.921634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:58.928006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:58.942900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:58.945401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:58.948498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:58.952312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:58.953621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:58.954600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:58.960793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:58.962182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:58.963162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:58.995680 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] Creating event network-vif-deleted:df39056c-cfa7-4020-a7db-693239148f08 for instance 519b617d-0180-4dfe-aa10-db9209b73838 on n-h2-850468-18 Aug 25 12:34:59.028979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c1c032fa-f324-46f1-b7d7-5efed7d13f79 req-c51035d9-6a34-4b9c-b189-5e44edc1b9e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150196 Aug 25 12:34:59.030298 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 413/842] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:59.053132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:59.054861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:59.067036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.068331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.069356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.070748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.071729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.072742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.122611 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 HTTP/1.1 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:34:59.127546 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:34:59.130578 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '519b617d-0180-4dfe-aa10-db9209b73838'} Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:34:59.133592 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:34:59.138464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.144653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:34:59.147961 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e428e9a0-6d1b-4e26-bf28-672645f6dbaa tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 404 len: 111 microversion: 2.1 time: 0.111194 Aug 25 12:34:59.150409 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 414/843] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:59 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:34:59.163907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39376edc-4364-4b3a-978a-a842f801a619", "tag": "cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:34:59.189513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.190906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.192200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.218004 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] Creating event network-changed:cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3 for instance 39376edc-4364-4b3a-978a-a842f801a619 on n-h2-850468-18 Aug 25 12:34:59.229949 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-88d5d78b-a677-403e-a68f-32e5fcbf458a req-506b9c2b-fe82-4aba-8970-2ee1cf0922a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076762 Aug 25 12:34:59.231541 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 415/844] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:34:59.247674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:59.248766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:59.281014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.281802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.282518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.283720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.284543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.285232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.744362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:34:59.783042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cccbbf79-2e2b-490d-a83b-4d83348bb576 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1281 microversion: 2.1 time: 0.877022 Aug 25 12:34:59.788324 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 430/845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:58 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1281 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:34:59.828509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:34:59.830798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:34:59.865557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.869901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.877030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.880260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:34:59.883942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:34:59.885140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:34:59.926577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 HTTP/1.1 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:34:59.957534 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:34:59.959893 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ef194ae5-b778-4be7-9180-c09d1588cf69'} Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:34:59.961293 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:34:59.963809 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:34:59.972372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:34:59.972904 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-736c9b57-82ee-4250-846c-0c6e7a3f397f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 404 len: 111 microversion: 2.1 time: 0.166841 Aug 25 12:34:59.976929 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 431/846] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:34:59 2022] DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:00.004823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:00.006005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:00.039965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:00.041300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:00.042545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:00.046687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:00.049066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:00.050354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:00.840356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:00.868882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61d24ab9-5fa9-492a-9800-94f286d8a76d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 1.634091 Aug 25 12:35:00.888914 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 416/847] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:34:59 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:00.896853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb26c150-2038-43d2-9278-21abd3f570b3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2ea23a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:00.983651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb26c150-2038-43d2-9278-21abd3f570b3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.092849 Aug 25 12:35:00.985027 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 417/848] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:00 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:00.992609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:00.993687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:01.004324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.005223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.005932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:01.006913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.007757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.008653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:01.296831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:01.320259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:01.326752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:01.332467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de24646d-c9fa-493f-905f-7a321aa46392 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 1.352912 Aug 25 12:35:01.348444 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 432/849] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:34:59 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:01.351503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:01.374154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:01.393540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.395001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.395820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:01.397319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.398133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.398879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:01.429578 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 HTTP/1.1 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:35:01.433011 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:01.434651 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ef194ae5-b778-4be7-9180-c09d1588cf69'} Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:01.435569 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:01.437098 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:01.438572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:01.438572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e8b428f-a76e-4c13-b24a-5c2cf89edd8e tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 404 len: 111 microversion: 2.1 time: 0.095209 Aug 25 12:35:01.439695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 433/850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:01 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:01.450570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:01.451889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:01.468105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.469394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.472581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:01.478490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:01.479728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:01.480635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:02.181034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:02.227416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:02.449994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:02.489712 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-628e5a69-c657-4f0f-9cc3-317c23ca277b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 1.501099 Aug 25 12:35:02.492954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 418/851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:00 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:02.509467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7", "name": "network-vif-plugged", "status": "completed", "tag": "c72a276f-0950-48e1-ad55-cd55e887ea34"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:02.591716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:02.593984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:02.602381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:02.660268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:02.678097 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] Creating event network-vif-plugged:c72a276f-0950-48e1-ad55-cd55e887ea34 for instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 on n-h1-850468-18 Aug 25 12:35:02.733694 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-196231c8-56b8-462e-8604-782815971092 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 1.291517 Aug 25 12:35:02.738303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-81abd0d3-a6c8-4915-a6a8-3d0bb186a2a7 req-26c496aa-b381-40b6-997c-daabf64270c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236392 Aug 25 12:35:02.739933 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 419/852] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:02.749465 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 434/853] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:01 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:02.780591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ff5bcdd-9f62-46b6-a267-7d3f04ded4d9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '.version_select at 0x7fc6c2c73ee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:02.785364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2e7d65-45b4-4a82-8d30-a015e2af5447", "name": "network-vif-unplugged", "status": "completed", "tag": "b291c31b-93f0-4216-ad65-33712305c4b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:02.815149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:02.817801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:02.819550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:02.855955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ff5bcdd-9f62-46b6-a267-7d3f04ded4d9 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417181888" status: 202 len: 0 microversion: 2.1 time: 0.111862 Aug 25 12:35:02.861473 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 420/854] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417181888 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:35:02.862601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] Creating event network-vif-unplugged:b291c31b-93f0-4216-ad65-33712305c4b9 for instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 on n-h2-850468-18 Aug 25 12:35:02.871729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a1425ccd-a253-4638-99c7-9d7bd34f5811 req-4b704f15-5d8d-4c94-a644-59df307281f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119967 Aug 25 12:35:02.872305 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 435/855] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:02.880922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b00edd7b-4175-4ecc-8d50-6a1246f37f11 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2f371f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:02.882806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:02.884140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:02.913851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:02.917411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:02.918690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:02.920344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:02.921349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:02.922145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:02.966280 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b00edd7b-4175-4ecc-8d50-6a1246f37f11 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.092314 Aug 25 12:35:02.971122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 436/856] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:02 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:02.987279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:02.992510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:03.014745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.015622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.016497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:03.019360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.020774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.021774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:03.247389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=38 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:03.459836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:03.492105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1c03fb1b-95db-4075-8ca3-604d5daec0fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.627897 Aug 25 12:35:03.494295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 421/857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:02 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:03.579948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:03.587957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:03.589745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:03.625394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.631061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.632158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:03.633907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.636978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.639948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:03.640191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:03.643597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:03.669642 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ddc67f9-7c8a-48f7-82b8-526b7ba74007 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.695421 Aug 25 12:35:03.684157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 437/858] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:02 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:03.785590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:03.791972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:03.825820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.826767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.827604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:03.829599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:03.830889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:03.831955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:04.899661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:04.928880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7e0347b-d46d-4529-ba57-0dfdf54da757 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 1.385594 Aug 25 12:35:04.933445 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 422/859] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:03 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:04.952867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9171975-8a0d-40e9-8ea5-adffa3c37e7d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30d75e0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.054599 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9171975-8a0d-40e9-8ea5-adffa3c37e7d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.110527 Aug 25 12:35:05.063540 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 423/860] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:04 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:05.078000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.089569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:05.094200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:05.111827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.121253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.122547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.124365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.125551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.127267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.130789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-558fff40-5a96-4f90-8657-374dfbbd08ce tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 1.346753 Aug 25 12:35:05.131566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 438/861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:03 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:05.148256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.150538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:05.172431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.175186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.176732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.177552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.177970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.178394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.501942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:05.553296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:05.559174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:05.561807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22ba4c04-4523-4f41-b432-b8a2e2a860df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.427544 Aug 25 12:35:05.563177 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 439/862] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:05 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:05.577464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5359d43-a53b-4c4b-9de0-5e522e23afc1", "name": "network-vif-plugged", "status": "completed", "tag": "8b88fb02-b435-47c5-9e40-271604906d50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:05.613028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:05.615143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.616048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.616854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.631344 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5f5543f-152f-4eaa-ade8-b0452815ab99 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.565678 Aug 25 12:35:05.632108 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 424/863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:05 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:05.639669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-851bf4a5-dade-4f80-bc08-3bea177af923 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.660470 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] Creating event network-vif-plugged:8b88fb02-b435-47c5-9e40-271604906d50 for instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 on n-h1-850468-18 Aug 25 12:35:05.681158 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-be522e2d-eab6-40fc-8886-15264c2c1ab2 req-f9a7e4a5-33e5-44a8-9a97-c120e5498884 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113990 Aug 25 12:35:05.691355 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 440/864] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:05.694023 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-851bf4a5-dade-4f80-bc08-3bea177af923 tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/28805348" status: 202 len: 0 microversion: 2.1 time: 0.060553 Aug 25 12:35:05.695254 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 425/865] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 12:35:05 2022] DELETE /compute/v2.1/flavors/28805348 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:35:05.711104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2e7d65-45b4-4a82-8d30-a015e2af5447", "tag": "b291c31b-93f0-4216-ad65-33712305c4b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:05.711398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1cde1b3-2f92-4dc2-b670-115d280d70aa tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.760793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:05.762904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:05.767353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:05.770905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1cde1b3-2f92-4dc2-b670-115d280d70aa tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.069385 Aug 25 12:35:05.788758 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 426/866] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:35:05 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:05.813219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1aa6d92-8461-44e3-9980-2dbb5b50692a tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.858855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] Creating event network-changed:b291c31b-93f0-4216-ad65-33712305c4b9 for instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 on n-h2-850468-18 Aug 25 12:35:05.870182 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1aa6d92-8461-44e3-9980-2dbb5b50692a tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/253568095" status: 202 len: 0 microversion: 2.1 time: 0.063854 Aug 25 12:35:05.872360 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 427/867] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:35:05 2022] DELETE /compute/v2.1/flavors/253568095 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:35:05.887750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-313ffd1b-655f-42c4-bb8b-e5459f5b7c1f req-c0cac649-2166-409c-883d-68701d9cddae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193390 Aug 25 12:35:05.888050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0108f5c3-c9d1-4ae3-839c-f01d1158831e tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.889876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 441/868] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:05.948389 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0108f5c3-c9d1-4ae3-839c-f01d1158831e tempest-ServersWithSpecificFlavorTestJSON-364782796 tempest-ServersWithSpecificFlavorTestJSON-364782796-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064533 Aug 25 12:35:05.961973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 428/869] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:35:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:35:05.993392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:05.993392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.011766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.019606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.021883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.022675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.023486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.024638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.025503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.026181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.041452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.041452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.041452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.041452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.042498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.042498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.070205 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 HTTP/1.1 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:35:06.073546 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.076747 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '519b617d-0180-4dfe-aa10-db9209b73838'} Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:06.085594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.089576 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.096365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:06.096365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20eee10a-a414-4cc1-90f8-8b7b0c2909f6 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 404 len: 111 microversion: 2.1 time: 0.078907 Aug 25 12:35:06.096365 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 429/870] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:35:05 2022] DELETE /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:06.096365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-449a451e-9ed9-4001-bc13-b973b4f00a49 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c19670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.187564 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-449a451e-9ed9-4001-bc13-b973b4f00a49 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.099911 Aug 25 12:35:06.195261 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 430/871] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:06 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:06.210056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.215749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: 519b617d-0180-4dfe-aa10-db9209b73838] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.238518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.246225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.255626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.257971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.269316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.270714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.340725 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 HTTP/1.1 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:35:06.344343 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.347462 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '519b617d-0180-4dfe-aa10-db9209b73838'} Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:06.348850 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. Aug 25 12:35:06.353224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.361208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance 519b617d-0180-4dfe-aa10-db9209b73838 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:06.361208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac3f62a7-54a9-494d-a01a-46ccad605d7f tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838" status: 404 len: 111 microversion: 2.1 time: 0.162725 Aug 25 12:35:06.363038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 431/872] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:06 2022] GET /compute/v2.1/servers/519b617d-0180-4dfe-aa10-db9209b73838 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:06.374345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.376746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.389591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.390096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.390544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.391275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.391793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.392319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.628725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:06.665326 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0be1c7d-5175-468c-a9e5-7a041e6e7cb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.693674 Aug 25 12:35:06.669045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 442/873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:05 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:06.687038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.689196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.736347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.740729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.742530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.750118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.758923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.759873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.831687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:06.842048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-067168f2-bde8-4a85-810c-4beaf021c97a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 0.477001 Aug 25 12:35:06.843321 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 432/874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:06 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:06.849570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.850490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.858157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.859042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.859695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.861494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.862541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.863345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.869690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 HTTP/1.1 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:35:06.879936 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:06.881480 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ef194ae5-b778-4be7-9180-c09d1588cf69'} Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:06.882341 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:06.883678 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:06.885887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:06.886956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ecbcdef9-2c1d-4c18-a529-033ac5303293 tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 404 len: 111 microversion: 2.1 time: 0.215440 Aug 25 12:35:06.887807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 443/875] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:35:06 2022] DELETE /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:06.896714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:06.897938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:06.905567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.906492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.907998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:06.909189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:06.909971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:06.910584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.206742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:07.220495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a17b50e6-bf63-400d-aca3-c8af4c21d44a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.330742 Aug 25 12:35:07.225522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 444/876] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:06 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:07.240803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:07.244793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] [instance: ef194ae5-b778-4be7-9180-c09d1588cf69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:07.271544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:07.285230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:07.288334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.290261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.291217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.294329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.298562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.300998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.302614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:07.305519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:07.308459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40ffd56a-e93d-4261-9371-5b89373b0724 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.463589 Aug 25 12:35:07.309340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 433/877] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:06 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:07.315753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d61ae6d-47ad-4b2f-b21d-712dcbcb484c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2e4e670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:07.347042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] HTTP exception thrown: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Request method failure captured: Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 HTTP/1.1 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2tpNwcnWdWn78kAndaW51wx3VReiWd7crRbSzWf7Y_gPFPn7m2QvUlWe1G5NMcVmSDQt_784UilIO1dVp5yAmT8rdruV-HBNyybgyTNGBsYDBNTTROQ3q1p4up3tfAUSK9ppOcnkGHUJO1nmJL7Zp3Qof3CbOpe2WaIx7ykRcpzq8Q Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:35:07.352705 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_89c932bd810047c7915941697021fdb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/89c932bd810047c7915941697021fdb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/89c932bd810047c7915941697021fdb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 89c932bd810047c7915941697021fdb3 Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421 Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1aa2df29675141de952756ad23f15926 Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-242956421-project Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:07.354336 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ef194ae5-b778-4be7-9180-c09d1588cf69'} Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:07.355085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. Aug 25 12:35:07.356428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:07.359972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] Returning 404 to user: Instance ef194ae5-b778-4be7-9180-c09d1588cf69 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:07.361486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5556f2af-4130-41cb-841c-f810665d8a5c tempest-ServersWithSpecificFlavorTestJSON-242956421 tempest-ServersWithSpecificFlavorTestJSON-242956421-project] 10.222.0.60 "GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69" status: 404 len: 111 microversion: 2.1 time: 0.134563 Aug 25 12:35:07.362078 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 445/878] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:07 2022] GET /compute/v2.1/servers/ef194ae5-b778-4be7-9180-c09d1588cf69 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:07.409180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d61ae6d-47ad-4b2f-b21d-712dcbcb484c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.098068 Aug 25 12:35:07.410151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 434/879] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:07 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:07.695671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:07.702047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:07.734979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.737420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.739165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.740155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.740836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.741443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.887993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:07.889793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:07.902564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:07.917497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.921368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.924784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:07.937727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:07.939468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:07.940262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:08.092614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:08.122607 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54fa4395-106b-47ba-a9a8-a62fd666eb8a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.434814 Aug 25 12:35:08.128965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 446/880] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:07 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:08.148938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:08.183673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:08.188189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:08.191433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:08.245210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] Creating event network-changed:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:35:08.277052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-583e347f-d55c-41a7-a098-1ff983cb0fc2 req-163b7a6b-80da-4e97-9240-9e1ef5a8cfa4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144578 Aug 25 12:35:08.278229 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 447/881] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:08.305461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:08.310867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:08.343887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:08.345927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:08.356228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:08.363052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:08.367320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:08.369071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:08.658637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:08.673435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6bc04e97-002f-4a5f-9bfa-2a3ba152096b tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 0.794584 Aug 25 12:35:08.674934 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 435/882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:07 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:35:08.699221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:08.700731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:08.709336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:08.710253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:08.710881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:08.711832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:08.712506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:08.713284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:09.237586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:09.256366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9105f380-e8d0-48fb-a873-3c64ae983b05 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1318 microversion: 2.1 time: 0.967763 Aug 25 12:35:09.288190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 448/883] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:08 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:09.304237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-17777953-efc9-4cea-9272-166172fa466f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30e49d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:09.440090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-17777953-efc9-4cea-9272-166172fa466f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.149699 Aug 25 12:35:09.441834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 449/884] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:09 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:09.659269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:09.708764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:09.712524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:09.722989 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29f570bf-31ec-4eb9-8131-e96501407e95 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 1.045484 Aug 25 12:35:09.724472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 436/885] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:08 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:09.775082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:09.776270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:09.788275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cdd228a5-0cac-42b5-8b94-fbf39d7c18d5 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] Calling method '.version_select at 0x7fc6c2c9f430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:09.801193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:09.802045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:09.802832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:09.813998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:09.815182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:09.815994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:09.878303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:09.897211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cdd228a5-0cac-42b5-8b94-fbf39d7c18d5 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.452945 Aug 25 12:35:09.910895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 450/886] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:35:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:09.939691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:09.942090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:09.971781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:09.973233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:09.976053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:09.977665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:09.979174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:09.984378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:11.164538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:11.204877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d4e5313-cbcf-4d77-aa44-903b81f84fcf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 1.460816 Aug 25 12:35:11.220892 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 437/887] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:09 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:11.232629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a36fe497-e661-4ca3-b945-a5d6efe504fa tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2e5eaf0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:11.692405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:11.711623 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11d4581b-fe42-4ade-90a0-99355ae90586 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 1.792722 Aug 25 12:35:11.730504 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 451/888] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:09 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:11.739871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:11.742109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:11.776500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:11.777478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:11.778186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:11.780709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:11.783765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:11.784509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:12.026797 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a36fe497-e661-4ca3-b945-a5d6efe504fa tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.801050 Aug 25 12:35:12.028271 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 438/889] 10.222.0.60 () {60 vars in 1206 bytes} [Thu Aug 25 12:35:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:12.036329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f67fe4d1-e450-4660-9b4d-761011f7003d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c08700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:12.159608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f67fe4d1-e450-4660-9b4d-761011f7003d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.129180 Aug 25 12:35:12.170268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 439/890] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:12 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:12.188973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:12.191822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:12.215921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:12.216389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:12.218189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:12.239629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:12.245404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:12.246127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:12.632131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:12.660979 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2acf9c1f-2bad-4593-afe6-17b2bc2e5f5f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1468 microversion: 2.1 time: 0.928827 Aug 25 12:35:12.686528 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 452/891] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:11 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1468 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:12.692429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72649d3-a6c6-4f73-9888-c0474abfedff", "name": "network-vif-plugged", "status": "completed", "tag": "22e0fa73-c453-4684-a2e9-9dbd3d39471f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:12.742142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:12.742885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:12.743547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:12.748685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:12.759364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] Creating event network-vif-plugged:22e0fa73-c453-4684-a2e9-9dbd3d39471f for instance e72649d3-a6c6-4f73-9888-c0474abfedff on n-h1-850468-18 Aug 25 12:35:12.765395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4f6301b9-da5d-4c82-a17b-cbec5cb89ac6 req-0cbf25ff-082d-419c-ad1d-70ad421d4fd4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077033 Aug 25 12:35:12.770604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 453/892] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:12.777513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-517b78f5-76c7-430c-ad93-87511edafe38 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] Calling method '.version_select at 0x7fc6c2d738b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:12.796939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-517b78f5-76c7-430c-ad93-87511edafe38 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023890 Aug 25 12:35:12.798428 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 454/893] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 12:35:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:12.804399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:12.805519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:12.813654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:12.815432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:12.816486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:12.817601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:12.818256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:12.818850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:13.100509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:13.143928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:13.147822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:13.150444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a11a188-7bd4-4b13-96ed-f727f75ea481 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.976724 Aug 25 12:35:13.164160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 440/894] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:12 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:13.164160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:13.202082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:13.231544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:13.232443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:13.237675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:13.239014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:13.239884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:13.247068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:13.474236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:13.495732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fd47071-af3f-49f6-8bbe-e6944cd3e0e6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.695221 Aug 25 12:35:13.499122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 455/895] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:12 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:13.539811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:13.541696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:13.555495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:13.556584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:13.558070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:13.559446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:13.560463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:13.561569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:13.722862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:13.737554 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1180f09c-11ee-478d-af25-07a524a80cb8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111" status: 200 len: 1468 microversion: 2.1 time: 0.583307 Aug 25 12:35:13.740960 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 441/896] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:13 2022] GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:13.776009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae96166c-9652-4bd3-85a9-8994c51eecf2 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2c730d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:14.016377 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae96166c-9652-4bd3-85a9-8994c51eecf2 tempest-QuotaClassesAdminTestJSON-1576971371 tempest-QuotaClassesAdminTestJSON-1576971371-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.270892 Aug 25 12:35:14.022985 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 442/897] 10.222.0.60 () {60 vars in 1206 bytes} [Thu Aug 25 12:35:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:14.040394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d79229e-a5d3-47f6-bb5e-a2097019d49f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2e4ea60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:14.183351 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d79229e-a5d3-47f6-bb5e-a2097019d49f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.152447 Aug 25 12:35:14.184856 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 443/898] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:14 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:14.200486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:14.235351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:14.237146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Searching by: {'reservation_id': 'r-bsg5e973', 'deleted': False, 'project_id': '9887ac4ba161489dbc983267f299f400'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:35:14.258169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:14.258945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:14.259753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:14.261147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:14.261972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:14.262759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:14.281782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:14.330347 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-77e17c27-a9dc-4ffb-a96f-9f9f39b43e2a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 0.807279 Aug 25 12:35:14.331712 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 456/899] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:13 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:14.359445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:14.360655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:14.389608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:14.390487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:14.391156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:14.393264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:14.394259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:14.394923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:14.726861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:35:14.934612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:14.953471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:14.957131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:14.964328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:14.970511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.209135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:15.226821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:15.236756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:15.238210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1b07eca-a083-4c2f-91b7-baf3167ea49e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 0.905158 Aug 25 12:35:15.239189 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 457/900] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:14 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:15.247119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:15.248080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:15.268685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.270758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.271691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.273614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.276832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.278054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.416317 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-48a0bae1-e01a-4fb7-aee1-b0f64bc4c2d7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-bsg5e973" status: 200 len: 2929 microversion: 2.1 time: 1.229567 Aug 25 12:35:15.417195 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 444/901] 10.222.0.60 () {58 vars in 1197 bytes} [Thu Aug 25 12:35:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bsg5e973 => generated 2929 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:15.425277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "name": "network-vif-plugged", "status": "completed", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:15.478035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.481532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.486057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.531948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] Creating event network-vif-plugged:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:35:15.549768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9ff2d719-975a-4933-9113-7cbdb2727faf req-172cab66-03ae-4c80-9896-4b7fc93e8a41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130544 Aug 25 12:35:15.551940 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 445/902] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:15.580989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b0e02df-71a0-4f66-82de-31b1f8279808 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c3400040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:15.757303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b0e02df-71a0-4f66-82de-31b1f8279808 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.190034 Aug 25 12:35:15.758565 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 446/903] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:15 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:15.767332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:15.768286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:15.810408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.811361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.812061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.813016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:15.813966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.815580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.816392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:15.834667 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe2b49a0-aa30-4dee-8e24-f242ddfb15f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1315 microversion: 2.1 time: 0.583566 Aug 25 12:35:15.835787 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 458/904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:15 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:15.865080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:15.927763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.server_groups [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Querying cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) for 2 instances {{(pid=122701) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 12:35:15.929399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:15.930552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:15.932294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:16.043084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1957215-7ce5-4a81-b762-16f390ed7107 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/5a7e4f2d-3250-4112-ab92-19ce64b81514" status: 200 len: 263 microversion: 2.1 time: 0.205026 Aug 25 12:35:16.045430 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 459/905] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:35:15 2022] GET /compute/v2.1/os-server-groups/5a7e4f2d-3250-4112-ab92-19ce64b81514 => generated 263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:16.070509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:16.073464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:16.098982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:16.100849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:16.102283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:16.104095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:16.105304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:16.106415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:16.716443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:16.734702 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2519217c-a0dc-4f21-848f-5a011cba5449 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1323 microversion: 2.1 time: 0.974571 Aug 25 12:35:16.736835 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 447/906] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:15 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1323 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:16.787531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:16.788874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:16.815378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:16.816197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:16.817407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:16.827728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:16.829737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:16.831032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:16.910196 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6877e6d1-e8bd-4347-b81e-eeb56072a7a9 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1621 microversion: 2.1 time: 0.854948 Aug 25 12:35:16.916676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 460/907] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:16 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1621 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:16.947351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb0d8b58-e569-4712-b299-c57603cf6da5 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30b5ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:17.083084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb0d8b58-e569-4712-b299-c57603cf6da5 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.163857 Aug 25 12:35:17.128276 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 461/908] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:16 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:17.141910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:17.146663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:17.177377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:17.179239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:17.180922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:17.190349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:17.192780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:17.195862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:17.739465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:17.764276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:17.768478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:17.775205 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dea09af3-01c2-432a-be4e-4681a94e3224 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1568 microversion: 2.25 time: 1.016488 Aug 25 12:35:17.778868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 448/909] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:16 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1568 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:17.787569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:17.789031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:17.821594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:17.826264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:17.827526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:17.828560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:17.831414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:17.832091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:18.206161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:18.234110 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ed152b33-87f8-4fe9-91ea-6a9355c45d7f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1502 microversion: 2.1 time: 1.103119 Aug 25 12:35:18.236208 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 462/910] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:17 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1502 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:18.246584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:18.247824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:18.290266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:18.297316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:18.299364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:18.300582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:18.301782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:18.302797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:18.687715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1e60660-ef63-4399-aca7-c373f52f9e6c tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111" status: 200 len: 1621 microversion: 2.1 time: 0.905893 Aug 25 12:35:18.700605 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 449/911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:17 2022] GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111 => generated 1621 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:18.713214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-107c1054-ba56-429f-9cbb-4bb05ef919b6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a18670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:18.832266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-107c1054-ba56-429f-9cbb-4bb05ef919b6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.130243 Aug 25 12:35:18.841259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:18.846720 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 450/912] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:18 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:18.854718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: .version_select at 0x7fc6c2a211f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1989505247", "policies": ["anti-affinity"]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:18.857429 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35718a61-c8ad-48b8-b0bf-37cbe6e0552a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 200 len: 1519 microversion: 2.1 time: 0.618823 Aug 25 12:35:18.861038 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 463/913] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:18 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 1519 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:18.876357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:18.882539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:18.900384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:18.905009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:18.909080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:18.914872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:18.916374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:18.920403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:18.950544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:18.972541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:19.165692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:19.184562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:19.217824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c133983-7c7b-4614-8a70-be6edcfeb049 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.367147 Aug 25 12:35:19.221560 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 451/914] 10.222.0.60 () {60 vars in 1174 bytes} [Thu Aug 25 12:35:18 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:19.228211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: .version_select at 0x7fc6c4652b80>, body: {"addFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:19.231950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:19.275102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:19.275991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:19.276732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:19.281740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:19.283206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:19.287144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:19.308363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:19.328077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:19.333486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:19.336267 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fb2eec5-7098-49c3-8de2-85aaf384ce77 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1543 microversion: 2.25 time: 0.473747 Aug 25 12:35:19.337676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 464/915] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:18 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1543 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:19.370550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82030af2-18ee-47c1-80ab-da357ce53438 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '.version_select at 0x7fc6c3053b80>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:19.390787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82030af2-18ee-47c1-80ab-da357ce53438 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:19.391936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82030af2-18ee-47c1-80ab-da357ce53438 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:19.394564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82030af2-18ee-47c1-80ab-da357ce53438 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:19.451925 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82030af2-18ee-47c1-80ab-da357ce53438 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.079835 Aug 25 12:35:19.451925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 465/916] 10.222.0.60 () {60 vars in 1184 bytes} [Thu Aug 25 12:35:19 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:35:19.493124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:19.498796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:19.558893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:19.567539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:19.570476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:19.576470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:19.582309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:19.590536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:19.594253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:35:19.595409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquired lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:35:21.437161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid ae2e7d65-45b4-4a82-8d30-a015e2af5447 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:35:21.466799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83b40090-b77c-49dc-83e1-f67457a2eba7 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 2038 microversion: 2.25 time: 1.988400 Aug 25 12:35:21.489124 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 466/917] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:19 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 2038 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:21.535195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-367657839", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fb35254f-c289-4684-9033-e85f26786b8b"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:21.651262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:35:22.429867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:35:22.432430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:35:22.433215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:35:22.434625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:35:22.435262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:35:22.508984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:22.512438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:22.515878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:22.521976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:22.525000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:22.535901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:22.642717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:22.654388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:22.699926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 2 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:35:22.706088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:35:22.813194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:22.821941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:22.922189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:22.932221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:22.957851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=7e9b4d7e-8201-4974-8df0-8a1d9d7327ce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:35:23.042542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:23.053222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:23.107717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:23.128651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:23.141945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'server_group_members'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:23.225006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2a8d71d-8608-4037-9eec-a3d1142e5651 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.733304 Aug 25 12:35:23.230096 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 467/918] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:35:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1740 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:35:23.249470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d1fd433-4a61-4449-bc1a-740e2e22e45c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c319cc10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:23.506581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d1fd433-4a61-4449-bc1a-740e2e22e45c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.270616 Aug 25 12:35:23.507592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 468/919] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:23 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:23.525822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3a21bbf-6603-4809-ae10-9e27ae785776 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: .version_select at 0x7fc6c31070d0>, body: {"keypair": {"name": "tempest-keypair-1457490615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDzhOCP2z2LBJrcR4BGa8rFIYyT/XL4x2EPeh4/+uHMyL9OFVCE9cXnDTXahJuZkDE3Aj87a6NY1hCE4bPN9o+VWxih0e71e2VEImjiEaHElG4wWpGROPIFZj5945ZBng=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:23.598290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e3a21bbf-6603-4809-ae10-9e27ae785776 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:23.620395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e3a21bbf-6603-4809-ae10-9e27ae785776 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for user 3f41f5c8cf9e4d78b4fb62eac79b093e and project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:23.724545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3a21bbf-6603-4809-ae10-9e27ae785776 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.215235 Aug 25 12:35:23.736604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 469/920] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:35:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:35:23.912697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:35:24.060970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:24.080137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:24.092675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:24.093405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:24.095424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:24.096280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:24.097060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:24.270382 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-03dfc20e-ffca-4cf0-86e1-ed1e94bd8d82 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.531513 Aug 25 12:35:24.271666 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 470/921] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:35:23 2022] GET /compute/v2.1/os-services => generated 949 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:24.292386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:24.302043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:24.303319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Searching by: {'deleted': False, 'project_id': '9887ac4ba161489dbc983267f299f400'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:35:24.368298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:24.368802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:24.369418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:24.381422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:24.382195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:24.382962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:24.431956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:24.728283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:35:25.142277 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4774b201-7e89-4b5b-b3a1-1821eb67ffd2 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.855178 Aug 25 12:35:25.146347 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 471/922] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:35:24 2022] GET /compute/v2.1/servers => generated 1662 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:25.167799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5309f94b-4b1e-4a52-bb57-fb9f7b969880"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:25.183305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:25.255042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:25.259160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:25.259968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:25.267542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:25.278825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:25.279252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.139506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Updating instance_info_cache with network_info: [{"id": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b", "address": "fa:16:3e:bf:b7:40", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b8d8031-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:35:26.171577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Releasing lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:35:26.173839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58f37b52-c289-4507-b4a7-7a0ad613c8f5 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action" status: 202 len: 0 microversion: 2.1 time: 6.949139 Aug 25 12:35:26.174978 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 452/923] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:35:19 2022] POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action => generated 0 bytes in 6952 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:35:26.193558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:26.239356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.241807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.242489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.272881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] Creating event network-changed:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:35:26.314604 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-58dfb51a-736f-47f2-8069-5473541420bd req-33e4bb55-d6e3-4b48-932c-92d7fa56670d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137869 Aug 25 12:35:26.323914 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 453/924] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:26.346359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:26.355483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.355984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.356459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.357357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.357825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.359459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.465663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10ff5ceb-b005-4ba5-9f52-7f266315b604 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.138628 Aug 25 12:35:26.470038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 454/925] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 12:35:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:26.485212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bdc4330e-e1b6-4944-b015-05e4ce426243 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c08e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:26.583376 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a532e640-665a-4418-bf72-6fec4f72c1fb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.433674 Aug 25 12:35:26.588599 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bdc4330e-e1b6-4944-b015-05e4ce426243 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.117277 Aug 25 12:35:26.589198 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 455/926] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:26 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:26.590876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 472/927] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:35:25 2022] POST /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff/os-volume_attachments => generated 194 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:26.618672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:26.634237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:26.638104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:26.664549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:26.676670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.682112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.682682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.683478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.683972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.684586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.710570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.711504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.712361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.731697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:26.732875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:26.745066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:26.798661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:35:26.802989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquired lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:35:27.405448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:27.431116 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e309d69d-fb4a-4df1-8f1f-9c22315a5447 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1270 microversion: 2.1 time: 0.833481 Aug 25 12:35:27.437965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 473/928] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:26 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1270 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:27.465536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:27.503002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:27.503889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:27.508197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:27.520783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:27.525706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:27.535142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:27.666526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3bb3404-8645-4e37-9135-123ddc73baba tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.221970 Aug 25 12:35:27.671358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 474/929] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:35:27 2022] GET /compute/v2.1/os-services => generated 949 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:27.687784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5354cbe1-ae91-4257-ad65-66d6b968f856 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2ae5e50>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:27.903291 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5354cbe1-ae91-4257-ad65-66d6b968f856 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.228595 Aug 25 12:35:27.912193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 475/930] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:27 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:27.953559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:27.976621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:27.977614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:27.978529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:27.987135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:27.988489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:27.989344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:28.128786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f69d56ee-44c6-4e66-b626-f614c46c6636 tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=n-d-850468-18&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.213705 Aug 25 12:35:28.135791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 476/931] 10.222.0.60 () {58 vars in 1196 bytes} [Thu Aug 25 12:35:27 2022] GET /compute/v2.1/os-services?host=n-d-850468-18&binary=xxx => generated 16 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:28.176274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:28.212012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:28.218853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:28.221834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:28.229123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:28.231010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:28.235928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:28.351340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:28.464404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6095c885-38bb-401d-a7db-5699d5783bff tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.312456 Aug 25 12:35:28.478364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 477/932] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:35:28 2022] GET /compute/v2.1/os-services => generated 949 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:28.507308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:28.525501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:28.567267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:28.568477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:28.569268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:28.570651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:28.589627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:28.597138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:29.216311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:29.894113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:29.910019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ae93bac-fb61-4d5a-883d-09b2ceda3c35 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1288 microversion: 2.1 time: 1.426103 Aug 25 12:35:29.912915 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 478/933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:28 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1288 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:29.921558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:29.931385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:29.939356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:29.940169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:29.941251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:29.942506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:29.947559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:30.008691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-03ff75a4-10a0-4a8a-bbf6-8d1cdbb3fb5e tempest-ServicesAdminNegativeTestJSON-1121369348 tempest-ServicesAdminNegativeTestJSON-1121369348-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091079 Aug 25 12:35:30.009649 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 479/934] 10.222.0.60 () {58 vars in 1198 bytes} [Thu Aug 25 12:35:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:30.026955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09bb8eb1-65b9-4ea4-91cb-708fe1e4f4fd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a9f550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:30.156365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09bb8eb1-65b9-4ea4-91cb-708fe1e4f4fd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.133476 Aug 25 12:35:30.178017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 480/935] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:30 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:30.653083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c2cf6fe-4c06-40e2-ba83-1616ae84e678 tempest-ServicesAdminNegativeTestJSON-903264460 tempest-ServicesAdminNegativeTestJSON-903264460-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:30.662104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c2cf6fe-4c06-40e2-ba83-1616ae84e678 tempest-ServicesAdminNegativeTestJSON-903264460 tempest-ServicesAdminNegativeTestJSON-903264460-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5bb933e638f7449990c776f027e32661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f93dac37de498caec777fbf5837fce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c2cf6fe-4c06-40e2-ba83-1616ae84e678 tempest-ServicesAdminNegativeTestJSON-903264460 tempest-ServicesAdminNegativeTestJSON-903264460-project] Request method failure captured: Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2yJ0Rh_KEX5yC-JZ9TWuUFzZL9LPkw8asntKHLHnsOK1_3MG5g3p_Uj5mZ-MYnTSHLcRb_h66Er4W81l9YnvH-VQWiocTlBupWL4ya1wjR2l9lZgA8OXiAcBMKld43Rvug1lr3S_EQ3wUzbUFKGC5ME6tyArCdzwWLvHeGQLubpyq0 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a8f93dac37de498caec777fbf5837fce Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-903264460 Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:35:30.666488 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a8f93dac37de498caec777fbf5837fce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a8f93dac37de498caec777fbf5837fce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a8f93dac37de498caec777fbf5837fce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a8f93dac37de498caec777fbf5837fce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-903264460 Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a8f93dac37de498caec777fbf5837fce Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-903264460 Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServicesAdminNegativeTestJSON-903264460-project Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5bb933e638f7449990c776f027e32661 Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-903264460-project Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:35:30.669538 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:35:30.672079 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 25 12:35:30.680156 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:30.692068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c2cf6fe-4c06-40e2-ba83-1616ae84e678 tempest-ServicesAdminNegativeTestJSON-903264460 tempest-ServicesAdminNegativeTestJSON-903264460-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:30.694792 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c2cf6fe-4c06-40e2-ba83-1616ae84e678 tempest-ServicesAdminNegativeTestJSON-903264460 tempest-ServicesAdminNegativeTestJSON-903264460-project] 10.222.0.60 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.514945 Aug 25 12:35:30.706306 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 481/936] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:35:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 527 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:35:30.937090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:30.945327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:30.991751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:31.000797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:31.008952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:31.010344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:31.011248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:31.012067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:31.218250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:31.231126 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ec51422-722d-4404-9f66-a9ec07126152 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1276 microversion: 2.1 time: 0.299521 Aug 25 12:35:31.252863 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 482/937] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:30 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:31.289544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-908111a6-6a2f-4741-81f8-01b7e5ed4444 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a771f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:31.490766 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-908111a6-6a2f-4741-81f8-01b7e5ed4444 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.234714 Aug 25 12:35:31.506367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 483/938] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:31 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:32.264205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:32.266234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:32.298531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:32.299418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:32.316328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:32.317918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:32.318801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:32.319551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:33.253568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:33.270589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b5dd53e-6771-488c-bc12-d356a0527fa7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1276 microversion: 2.1 time: 1.014069 Aug 25 12:35:33.281051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 484/939] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:32 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1276 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:33.304438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02e3382f-af6c-4916-bd44-a299cd5644c9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a88f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:33.400439 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02e3382f-af6c-4916-bd44-a299cd5644c9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1412 microversion: 2.1 time: 0.114613 Aug 25 12:35:33.414522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 485/940] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:33 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:34.293535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:34.309142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:34.312451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:34.351096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:34.352751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:34.353578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:34.355599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:34.356682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:34.357447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:36.319158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:36.335596 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e53f5eb-44fd-4fb8-8403-3eb7b276ab91 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 2.043871 Aug 25 12:35:36.336226 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 486/941] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:34 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:35:36.345552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0ddca48-07ab-43e4-972d-2eaa781436e3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a69ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:36.390503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:36.438429 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0ddca48-07ab-43e4-972d-2eaa781436e3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1421 microversion: 2.1 time: 0.100243 Aug 25 12:35:36.449258 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 487/942] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:36 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:36.454977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-965ac849-6bd5-4578-8d6d-44a80fc146df tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30bfaf0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:36.533644 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-965ac849-6bd5-4578-8d6d-44a80fc146df tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 200 len: 1421 microversion: 2.1 time: 0.082855 Aug 25 12:35:36.534392 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 488/943] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:35:36 2022] GET /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:36.548617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21acfb66-a049-48de-b578-e85e264d1449"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:36.556515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:36.579318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:36.584915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:36.586153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:36.589310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:36.591748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:36.593705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:36.660306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:36.775294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=61,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:37.226760 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f4b888a-aaac-4e88-bddb-c56feb519339 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "POST /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688703 Aug 25 12:35:37.231375 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 489/944] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:35:36 2022] POST /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:37.261820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a7f1b71-6a71-45e0-b299-d570ed56080d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2a7ac10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:38.782610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a7f1b71-6a71-45e0-b299-d570ed56080d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 204 len: 0 microversion: 2.1 time: 1.545377 Aug 25 12:35:38.790775 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 490/945] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:37 2022] DELETE /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 0 bytes in 1558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:35:39.481653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9da688b7-be49-4104-bac1-f931674a7bf8 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-121868379", "ram": 512, "vcpus": 1, "disk": 10, "id": 2089152513, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:39.539488 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9da688b7-be49-4104-bac1-f931674a7bf8 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.738969 Aug 25 12:35:39.544179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 491/946] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:35:38 2022] POST /compute/v2.1/flavors => generated 415 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:39.562961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:39.571997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:39.600741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:39.606190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:39.607351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:39.608715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:39.609586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:39.610431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:39.964766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:40.447499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:40.475329 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ac29cd8-62bc-4851-be98-888a5dde43c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 0.926252 Aug 25 12:35:40.488571 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 492/947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:39 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:40.511362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1288777251", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "88522008-cbe6-46f9-95cf-76e2176a4cab"}], "security_groups": [{"name": "tempest-securitygroup--1683155680"}], "key_name": "tempest-keypair-1457490615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:41.487615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] validate_networks() for [('88522008-cbe6-46f9-95cf-76e2176a4cab', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:35:43.274312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:35:43.274990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:35:43.277611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:35:43.278116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:35:43.278550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:35:43.302118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:43.302556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:43.305891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:43.307047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:43.307555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:43.311017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:43.360167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:43.373584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for user 3f41f5c8cf9e4d78b4fb62eac79b093e and project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:43.431297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:35:43.440071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:35:43.604031 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-545e645b-4dc4-440c-9664-9dda559ff595 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.113443 Aug 25 12:35:43.611243 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 493/948] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:35:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 3121 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:35:43.638425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:43.639992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:43.670312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:43.670820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:43.675075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:43.676327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:43.683555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:43.684350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:43.774829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:35:43.989494 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ea8f23d-89c7-4744-92c5-3a3008fa848f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 204 len: 0 microversion: 2.1 time: 0.363924 Aug 25 12:35:43.990296 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 494/949] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:35:43 2022] DELETE /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:35:44.008444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e56c2119-22f3-4897-a3c1-ac4abfc0b95e tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:44.129315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:44.184486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e56c2119-22f3-4897-a3c1-ac4abfc0b95e tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.187897 Aug 25 12:35:44.186272 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 495/950] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:35:43 2022] POST /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:44.211168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5359d43-a53b-4c4b-9de0-5e522e23afc1", "name": "network-vif-unplugged", "status": "completed", "tag": "8b88fb02-b435-47c5-9e40-271604906d50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:44.264061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:44.271439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:44.272450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:44.305797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] Creating event network-vif-unplugged:8b88fb02-b435-47c5-9e40-271604906d50 for instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 on n-h1-850468-18 Aug 25 12:35:44.321980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-41519679-d133-4251-994b-f120bdad4204 req-d5900519-73e5-43bb-a586-d5f968e31982 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129440 Aug 25 12:35:44.324198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 496/951] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:44.353192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:44.354499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:44.403413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:44.403912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:44.404518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:44.405268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:44.405723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:44.406158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:45.559608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:45.587963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cafab48c-8cb9-44b1-b6fe-34a37c79b027 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 1.261766 Aug 25 12:35:45.593452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 497/952] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:44 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:45.614648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f719f4-eb6d-477b-acdb-328a338401cd", "tag": "949ed8cc-161f-4726-9fc6-1f293bac975f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:45.648392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:45.653418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:45.656195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:45.730307 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] Creating event network-changed:949ed8cc-161f-4726-9fc6-1f293bac975f for instance 51f719f4-eb6d-477b-acdb-328a338401cd on n-h1-850468-18 Aug 25 12:35:45.748559 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ecb53b29-e2a6-4de2-a397-5a7cffbcd684 req-6fd53ed9-8e82-4b65-b386-d08412cc4212 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152151 Aug 25 12:35:45.753975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 498/953] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:45.780429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:45.785681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:45.827102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:45.837787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:45.840329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:45.841820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:45.843850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:45.848368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:46.182344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:46.194817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:46.196502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:46.197702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cbb6ce17-6012-4b7b-a50e-88fad9067f62 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1282 microversion: 2.25 time: 0.438825 Aug 25 12:35:46.244380 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 499/954] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:45 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1282 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:46.900871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41f2eff8-5d02-4735-9496-255f1d6d4e72 tempest-FlavorsExtraSpecsTestJSON-889315789 tempest-FlavorsExtraSpecsTestJSON-889315789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:46.948325 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41f2eff8-5d02-4735-9496-255f1d6d4e72 tempest-FlavorsExtraSpecsTestJSON-889315789 tempest-FlavorsExtraSpecsTestJSON-889315789-project] 10.222.0.60 "GET /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.710876 Aug 25 12:35:46.954907 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 500/955] 10.222.0.60 () {58 vars in 1203 bytes} [Thu Aug 25 12:35:46 2022] GET /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:46.979861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1719631017", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:47.136820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] validate_networks() for [('c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:35:47.838284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.neutron [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] re-assign floating IP 172.25.6.6 from instance 5ff543ba-5197-4589-89c2-3908aea81a09 Aug 25 12:35:47.923537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:35:49.524661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:35:49.525496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:35:49.528772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:35:49.529616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:35:49.530904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:35:49.550218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:49.551025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:49.551551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:49.559397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:49.559895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:49.560640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:49.652002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:49.678476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for user 6121e19dc50b45ca979df57e9e0b48ea and project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:49.758496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:35:49.768649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:35:49.987763 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ba64604-32fb-46e2-a318-10cfa945e783 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.027303 Aug 25 12:35:49.996985 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 501/956] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:35:50.043572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:50.044753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:50.080440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:50.081701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:50.082367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:50.083575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:50.084356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:50.085139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:50.745027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:50.783561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2900ee77-af41-4db1-8e98-3c059bc008c5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 0.755654 Aug 25 12:35:50.801764 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 502/957] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:49 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:50.812027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-593142d9-82ea-4b5d-8a1f-9a19cb89e992 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:50.917931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Updating instance_info_cache with network_info: [{"id": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b", "address": "fa:16:3e:bf:b7:40", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b8d8031-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:35:50.918933 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-593142d9-82ea-4b5d-8a1f-9a19cb89e992 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.114432 Aug 25 12:35:50.921101 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 503/958] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:35:50 2022] POST /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:50.936381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:50.939017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:50.961470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:50.961749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:35:50.963734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:50.965628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:50.967575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:50.972362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:50.973981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:51.208085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:51.222216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:51.224749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:51.226305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a0337473-d94a-444c-b81a-8ee0e48db7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1344 microversion: 2.25 time: 0.301132 Aug 25 12:35:51.243945 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 504/959] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:50 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1344 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:51.255865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9b4d7e-8201-4974-8df0-8a1d9d7327ce", "tag": "c259d601-52e0-4856-9414-399762b37fea"}, {"name": "network-changed", "server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}, {"name": "network-changed", "server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:51.284700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:51.285653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:51.286546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:51.336016 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Creating event network-changed:c259d601-52e0-4856-9414-399762b37fea for instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce on n-h2-850468-18 Aug 25 12:35:51.336918 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Creating event network-changed:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:35:51.337930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] Creating event network-changed:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:35:51.356027 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-854ab149-837d-4602-8064-d311c0ab230c req-3db54038-295a-4dcc-aced-89d1c5c7202a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.108533 Aug 25 12:35:51.357456 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 505/960] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:51.466219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1488356784", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c21f680c-12a7-4064-9b66-8c43a8f22f33"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:51.543021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] validate_networks() for [('c21f680c-12a7-4064-9b66-8c43a8f22f33', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:35:54.418345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:35:54.419337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:35:54.423235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:35:54.431336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:35:54.434169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:35:54.445034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Updating instance_info_cache with network_info: [{"id": "f71f0fc6-30e0-4339-acef-61dbe18594b8", "address": "fa:16:3e:c4:c6:1a", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf71f0fc6-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:35:54.477040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.477787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.486610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.486974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Releasing lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:35:54.489227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.492841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.493541 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cdfc9450-3883-4ffe-9a5e-04b6a3de4468 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9/action" status: 202 len: 0 microversion: 2.1 time: 27.895282 Aug 25 12:35:54.496218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.496583 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 456/961] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:35:26 2022] POST /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9/action => generated 0 bytes in 27903 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:35:54.512715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:54.513544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:54.526101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.526882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.527663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.529287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.530636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.531038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.549477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Getting quotas for project 5af80caa01e4486cb093ae485e5bcaaa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:35:54.563005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Getting quotas for user 0184f259fa3e42a2996b750fdd8c80c6 and project 5af80caa01e4486cb093ae485e5bcaaa. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:35:54.591945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:35:54.597875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:35:54.600676 n-d-850468-18 devstack@n-api.service[122701]: WARNING nova.utils [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1488356784 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-148835678 Aug 25 12:35:54.601919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:35:54.674627 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-443c2212-20bc-4fb1-98e6-5a945cef89ba tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.315327 Aug 25 12:35:54.675593 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 506/962] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:35:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:35:54.688935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:54.691083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:54.701448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.702420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.704240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.705336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.705991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.706595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.741173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:35:54.818456 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bbd9de69-b2a9-4c2b-8681-42b5aaa605a3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 204 len: 0 microversion: 2.1 time: 0.314970 Aug 25 12:35:54.822003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 457/963] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:35:54 2022] DELETE /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:35:54.842157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-11cfe8a5-3b95-48dc-bbea-2e52af9d13f7 tempest-FlavorsExtraSpecsTestJSON-889315789 tempest-FlavorsExtraSpecsTestJSON-889315789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:54.867646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-11cfe8a5-3b95-48dc-bbea-2e52af9d13f7 tempest-FlavorsExtraSpecsTestJSON-889315789 tempest-FlavorsExtraSpecsTestJSON-889315789-project] 10.222.0.60 "GET /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.041944 Aug 25 12:35:54.869848 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 458/964] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 12:35:54 2022] GET /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes => generated 22 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:54.881016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:54.883052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:54.904597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.905727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.907501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.909717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:54.911431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:54.913263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:54.955775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:54.972945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb7c9927-4c5b-497e-ae6f-910de95ddb19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1266 microversion: 2.1 time: 0.288246 Aug 25 12:35:54.974771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 507/965] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:54 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:54.986383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:54.988176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:55.008871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.009486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.010556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.011326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.012629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.012629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.393550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:55.415606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:55.425888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebabbf56-a12e-4dd4-96c1-5e7e4146d37b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 0.553802 Aug 25 12:35:55.427632 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 459/966] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:54 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:55.442527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9b4d7e-8201-4974-8df0-8a1d9d7327ce", "name": "network-vif-plugged", "status": "completed", "tag": "c259d601-52e0-4856-9414-399762b37fea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:55.445970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:55.461510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:55.466868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b9b6022-e405-4130-b85a-64c9ed77f5dd tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.488925 Aug 25 12:35:55.470457 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 508/967] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:54 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:55.480455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5359d43-a53b-4c4b-9de0-5e522e23afc1", "name": "network-vif-deleted", "tag": "8b88fb02-b435-47c5-9e40-271604906d50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:55.496541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.497506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.498253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.504621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.506596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.510183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.537365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] Creating event network-vif-plugged:c259d601-52e0-4856-9414-399762b37fea for instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce on n-h2-850468-18 Aug 25 12:35:55.550410 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-94d48d03-c2e6-4770-86cf-a7b1f7621328 req-4c999318-ea26-41f1-8abd-1c0174638f84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114089 Aug 25 12:35:55.550711 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] Creating event network-vif-deleted:8b88fb02-b435-47c5-9e40-271604906d50 for instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 on n-h1-850468-18 Aug 25 12:35:55.558832 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 460/968] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:55.570616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f15bdedf-3f4a-47ee-9fe0-b1e41b91babe req-40c562ce-cc51-4b9f-b661-98ce4548acf9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096927 Aug 25 12:35:55.572412 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 509/969] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:55.574798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: .version_select at 0x7fc6c4607310>, body: {"removeFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:55.592880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:55.595088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:55.610544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.612379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.613544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.615238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.616471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.617464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.740834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:55.760153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72cb3c90-6c27-4154-91f2-a9d9b02f7bc5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1236 microversion: 2.1 time: 0.181122 Aug 25 12:35:55.761197 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 510/970] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:55 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1236 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:55.772341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:55.773893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:55.791253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.792460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.793112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.794683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.797691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.799889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.827555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:55.858363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.864469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.864943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:55.865714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:55.866200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:55.866885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:56.955552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:56.977134 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5030fc8f-6ccd-458e-b693-f224fea7547c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1554 microversion: 2.1 time: 1.214188 Aug 25 12:35:56.978573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 511/971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:55 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1554 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:56.982782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70ef1dc2-8d78-4e6e-8aba-ea1093201fbd tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:57.014667 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70ef1dc2-8d78-4e6e-8aba-ea1093201fbd tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035688 Aug 25 12:35:57.015312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 512/972] 10.222.0.60 () {60 vars in 1224 bytes} [Thu Aug 25 12:35:56 2022] POST /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:57.021995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:57.022686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:57.029815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.030306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.030745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:57.032154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.032840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.033429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:57.278788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:57.283382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] HTTP exception thrown: Floating IP 172.25.6.6 is not associated with instance 5ff543ba-5197-4589-89c2-3908aea81a09. Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Request method failure captured: Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action HTTP/1.1 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 47 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2xAyLpX9YidmRr_iYryBoBEdazL9it9PRb0oXaYqlffG3AhQo5pTNphu7WOvaqOIxL3aU2OZnl58c4gyB60zUz1AO3m81wHWSTR1OwsDznI17Q9CxEtvp_dzZtpWXXi9QE0k-0oy3KGgIBi7azZeWKknnbNLsDJSehJltikk10_t14 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:35:57.287467 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0b7729727225458aa40314510167ef94 Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: {"removeFloatingIp": {"address": "172.25.6.6"}} Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:35:57.290781 n-d-850468-18 devstack@n-api.service[122700]: exception: Floating IP 172.25.6.6 is not associated with instance 5ff543ba-5197-4589-89c2-3908aea81a09. Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5ff543ba-5197-4589-89c2-3908aea81a09', 'body': {'removeFloatingIp': {'address': '172.25.6.6'}}} Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.6 is not associated with instance 5ff543ba-5197-4589-89c2-3908aea81a09. Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:57.292626 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.6 is not associated with instance 5ff543ba-5197-4589-89c2-3908aea81a09. Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Returning 409 to user: Floating IP 172.25.6.6 is not associated with instance 5ff543ba-5197-4589-89c2-3908aea81a09. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c3d4b62-aac8-41e7-ac9f-e9c3437977cf tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action" status: 409 len: 144 microversion: 2.1 time: 1.729804 Aug 25 12:35:57.303379 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 461/973] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:35:55 2022] POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action => generated 144 bytes in 1737 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:35:57.306954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:57.306954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:57.307414 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25638429-dbef-4b0b-a155-34635985b1c1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1266 microversion: 2.1 time: 0.289820 Aug 25 12:35:57.307790 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 513/974] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:57 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:57.320804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:57.323351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:57.330767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.331567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.336474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.337418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.337757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:57.338152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:57.339414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.339568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:57.340269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.340682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:57.341009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:57.341684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:58.150333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:58.173334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:58.195690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:58.200517 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f398c622-7723-49c0-ba43-28c644eed8fe tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.890792 Aug 25 12:35:58.201871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 514/975] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:35:57 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:35:58.219096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:58.220556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:58.233362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:58.235519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:58.236474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:58.238007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:58.239049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:58.240046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:58.279138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:58.291809 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2a9fb8ba-1e97-45a2-b2bb-6079762de760 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 0.992511 Aug 25 12:35:58.304741 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 462/976] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:57 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:58.319010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6c5efd7-81f6-455e-b289-e53901f7c07d tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:58.331089 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6c5efd7-81f6-455e-b289-e53901f7c07d tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024277 Aug 25 12:35:58.331781 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 463/977] 10.222.0.60 () {58 vars in 1203 bytes} [Thu Aug 25 12:35:58 2022] GET /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:35:58.337745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:58.535746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:35:58.558884 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-482173ed-5a11-430b-bb5a-f056650be133 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1290 microversion: 2.1 time: 0.354354 Aug 25 12:35:58.559504 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 515/978] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:58 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1290 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:35:58.574643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f719f4-eb6d-477b-acdb-328a338401cd", "name": "network-vif-plugged", "status": "completed", "tag": "949ed8cc-161f-4726-9fc6-1f293bac975f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:58.602764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:58.607388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:58.613057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:58.643961 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] Creating event network-vif-plugged:949ed8cc-161f-4726-9fc6-1f293bac975f for instance 51f719f4-eb6d-477b-acdb-328a338401cd on n-h1-850468-18 Aug 25 12:35:58.659540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d3e9a164-5629-45db-937e-2e36609166bf req-cbcc572e-1c47-4353-9593-9df375c441cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092512 Aug 25 12:35:58.661129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 516/979] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:58.819063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:58.845968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:58.847867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:58.862757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:58.895649 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] Creating event network-changed:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h2-850468-18 Aug 25 12:35:58.904917 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-73816ab2-0ad0-4524-99cd-140543815d8d req-4bf0156b-fd26-42c7-a12b-efc17094cb3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241214 Aug 25 12:35:58.907160 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 517/980] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:35:59.244273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5e07d390-fad3-4aeb-9e1b-2823f4e547d6"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:35:59.251429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:59.265380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.267762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.269281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:59.271132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.272594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.273695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:59.633489 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] HTTP exception thrown: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Request method failure captured: Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments/21acfb66-a049-48de-b578-e85e264d1449 HTTP/1.1 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 74 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w7H9Aqnar0XFuIKqI4e6rsNnfFCY5pDJsxsgau9zo4mJV8pIXOSMUCBI4yw3qu88X6UT7EHYf2h1YEpArzMiQI0hNsFXsG9HNyh2iOSiV8ZsyerPzEDICSrRHF0a_GqONO8fXUohbbKx78brhsiISNiydh5UmU2g1XuVxtl2Lk3qM Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a6e0dc04e5a4406d91ee7fa6b38969e0 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:35:59.637944 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a6e0dc04e5a4406d91ee7fa6b38969e0 Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesAdminNegativeTest-1925383040-project-admin Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1a65c81128624edd8f773ffaa0c1d684 Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesAdminNegativeTest-1925383040-project-admin Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: {"volumeAttachment": {"volumeId": "5e07d390-fad3-4aeb-9e1b-2823f4e547d6"}} Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:35:59.639713 n-d-850468-18 devstack@n-api.service[122701]: exception: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': '39376edc-4364-4b3a-978a-a842f801a619', 'id': '21acfb66-a049-48de-b578-e85e264d1449', 'body': {'volumeAttachment': {'volumeId': '5e07d390-fad3-4aeb-9e1b-2823f4e547d6'}}} Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:35:59.641506 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. (HTTP 404) (Request-ID: req-2b7c5ad7-82ed-4f39-b0df-64f0616110ab) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:35:59.644594 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:35:59.647066 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. Aug 25 12:35:59.648680 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:35:59.653117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Returning 400 to user: Volume 5e07d390-fad3-4aeb-9e1b-2823f4e547d6 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:35:59.653117 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0cad17a2-d923-4dac-8638-6cdfaf42d492 tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments/21acfb66-a049-48de-b578-e85e264d1449" status: 400 len: 107 microversion: 2.1 time: 0.743323 Aug 25 12:35:59.655065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 518/981] 10.222.0.60 () {60 vars in 1433 bytes} [Thu Aug 25 12:35:58 2022] PUT /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments/21acfb66-a049-48de-b578-e85e264d1449 => generated 107 bytes in 747 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:35:59.678103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:35:59.681604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:59.702610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.704440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.707160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:59.714991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.722941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.725688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:59.778444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:35:59.873275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.873727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.877032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:35:59.883824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:35:59.886198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:35:59.893331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:00.525511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:00.547098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3283e1c5-a94a-439c-abc9-a2bfea2c1c00 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1512 microversion: 2.1 time: 0.889576 Aug 25 12:36:00.550844 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 519/982] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:35:59 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1512 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:00.562742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:00.565635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:00.580422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:00.585920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:00.587562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:00.589491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:00.590894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:00.592267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:00.850888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:00.862397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9932f5d8-0c1f-420b-9c53-8c184d97fe0a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1266 microversion: 2.1 time: 0.308159 Aug 25 12:36:00.863537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 520/983] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:00 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:00.869791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2bd8867-c9f0-483a-b7bc-83fe2334c587 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:00.898838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=5,nova_api:RELEASE=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:00.941222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2bd8867-c9f0-483a-b7bc-83fe2334c587 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "PUT /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.075676 Aug 25 12:36:00.948449 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 521/984] 10.222.0.60 () {60 vars in 1265 bytes} [Thu Aug 25 12:36:00 2022] PUT /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:36:00.958117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:00.958997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:00.983353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:00.985579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:00.986441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:00.987944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:00.989003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:00.990127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:01.275595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:01.276607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquired lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:01.389479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:01.407555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:01.409515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:01.410992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-be9b9b14-cdd2-476a-a427-367db795c92d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.464759 Aug 25 12:36:01.425336 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 522/985] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:36:00 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:01.435942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:01.437113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:01.446565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:01.447441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:01.448499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:01.449322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:01.449929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:01.450376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:01.803316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:01.815691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-714c88c6-42d4-4cbe-884a-16562ded53a4 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1318 microversion: 2.1 time: 0.388511 Aug 25 12:36:01.816329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 523/986] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:01 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:01.822313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:01.823087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:01.835416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:01.836341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:01.836993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:01.837944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:01.838598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:01.840933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:02.552791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:02.590612 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8d0184d-66d7-4034-8518-adcb2f2a0884 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1332 microversion: 2.1 time: 0.772583 Aug 25 12:36:02.606535 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 524/987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:01 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1332 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:02.606535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:02.606535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:02.618554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:02.619402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:02.620294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:02.621471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:02.622251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:02.622918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:02.976073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lazy-loading 'services' on Instance uuid 39376edc-4364-4b3a-978a-a842f801a619 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:36:03.204987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-141f1ed4-30be-456b-9a22-e2483ee30115 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments/21acfb66-a049-48de-b578-e85e264d1449" status: 202 len: 0 microversion: 2.1 time: 0.610024 Aug 25 12:36:03.209709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 525/988] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 12:36:02 2022] DELETE /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments/21acfb66-a049-48de-b578-e85e264d1449 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:36:03.216438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b57dd74-8a45-429f-b66d-7d773cb4779f", "tag": "8f2a98b4-168f-4e68-8baf-41322e9d1477"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:03.233888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.235827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.236965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.254864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] Creating event network-changed:8f2a98b4-168f-4e68-8baf-41322e9d1477 for instance 0b57dd74-8a45-429f-b66d-7d773cb4779f on n-h2-850468-18 Aug 25 12:36:03.261625 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-56c59281-f8b7-49e6-816b-67f67934147c req-207c3620-7ddc-4c12-9202-dfaf44da80bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049757 Aug 25 12:36:03.262969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 526/989] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:03.272348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7110d8f2-7432-4a97-877b-d85b8ce98245 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:03.284766 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7110d8f2-7432-4a97-877b-d85b8ce98245 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019568 Aug 25 12:36:03.286072 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 527/990] 10.222.0.60 () {58 vars in 1203 bytes} [Thu Aug 25 12:36:03 2022] GET /compute/v2.1/flavors/2089152513/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:36:03.293403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e72649d3-a6c6-4f73-9888-c0474abfedff", "name": "network-vif-deleted", "tag": "22e0fa73-c453-4684-a2e9-9dbd3d39471f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:03.308667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.310012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.310636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.349821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] Creating event network-vif-deleted:22e0fa73-c453-4684-a2e9-9dbd3d39471f for instance e72649d3-a6c6-4f73-9888-c0474abfedff on n-h1-850468-18 Aug 25 12:36:03.356148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a9c13127-feea-4f35-ad86-601eb92c35f0 req-b22787ba-7913-4cda-afa3-21be4a4ed8c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068431 Aug 25 12:36:03.357661 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 528/991] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:03.364864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:03.365955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:03.376504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.378512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.379376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.380934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.382012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.383212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.590553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:03.597770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:03.605339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04fd2a6b-1ec9-4d29-b2ce-c8883562b4d4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1346 microversion: 2.1 time: 0.245656 Aug 25 12:36:03.618367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 529/992] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:03 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1346 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:03.618367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:03.618367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:03.624070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.624384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.625892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.627106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:03.628208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:03.628208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:03.670252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:36:04.512653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:04.590991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:04.959718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:04.985630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8c8c3ca-3e0a-4f16-b595-09b09d2de9d8 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 1.377304 Aug 25 12:36:04.989394 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 530/993] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:03 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:05.004832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:05.009926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:05.025595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:05.027125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:05.029953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:05.032270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:05.033676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:05.034971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:05.866765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:05.886822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:05.890501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:05.904411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-decc19e3-a3df-49d1-9ef3-ce55715f52aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.902691 Aug 25 12:36:05.905702 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 531/994] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:36:04 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:05.923897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:05.927288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:05.940428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:05.941461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:05.942321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:05.943904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:05.944760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:05.946420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.453051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:06.476574 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c6624fb-536a-45da-9221-511a8579e711 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1468 microversion: 2.1 time: 0.566245 Aug 25 12:36:06.478243 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 532/995] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:05 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1468 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:06.518918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:06.522140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:06.532907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.533415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.533909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.534955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.535387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.535827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.591409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7b9fd3d-417e-4073-b4d8-078e83e8b219 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095417 Aug 25 12:36:06.592498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 533/996] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:06 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:06.600532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3b17b926-a798-4c40-a160-ad3ac662ab73 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:06.649833 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3b17b926-a798-4c40-a160-ad3ac662ab73 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.055333 Aug 25 12:36:06.650822 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 534/997] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:36:06 2022] DELETE /compute/v2.1/flavors/2089152513/os-extra_specs/hw:numa_nodes => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:36:06.653698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Updating instance_info_cache with network_info: [{"id": "f71f0fc6-30e0-4339-acef-61dbe18594b8", "address": "fa:16:3e:c4:c6:1a", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf71f0fc6-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:36:06.657888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:06.658601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:06.666589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.667091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.667810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.668624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.669139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.669909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.685096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Releasing lock "refresh_cache-5877fa9e-9a96-4b49-919c-8919787535a9" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:06.687329 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8fc9625-7403-47a0-a451-31308e424a79 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9/action" status: 202 len: 0 microversion: 2.1 time: 8.353861 Aug 25 12:36:06.688799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 464/998] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:35:58 2022] POST /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9/action => generated 0 bytes in 8356 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:36:06.698123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:06.699824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:06.718292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.721068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.722446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.725945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.727761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.729198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.906038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:06.938650 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6cd5796a-aaae-413b-bc21-3662b10ec588 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1346 microversion: 2.1 time: 0.247037 Aug 25 12:36:06.939917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 465/999] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:06 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1346 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:06.949129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57dd74-8a45-429f-b66d-7d773cb4779f", "name": "network-vif-plugged", "status": "completed", "tag": "8f2a98b4-168f-4e68-8baf-41322e9d1477"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:06.967657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:06.969693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:06.971340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:06.994052 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] Creating event network-vif-plugged:8f2a98b4-168f-4e68-8baf-41322e9d1477 for instance 0b57dd74-8a45-429f-b66d-7d773cb4779f on n-h2-850468-18 Aug 25 12:36:07.004598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e23e7a55-59ad-4a48-bff1-ebd7cfa42f19 req-f0dbd7bf-a478-47c3-a249-bde5a942d375 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062052 Aug 25 12:36:07.006296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 466/1000] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:07.019275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:07.044469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.045670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.046470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.075572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:07.095480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] Creating event network-changed:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:36:07.098524 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ea72538-c3b6-4c7e-849c-0c68b842b432 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1332 microversion: 2.1 time: 0.445894 Aug 25 12:36:07.100260 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 535/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:06 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1332 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:07.115401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.116713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:07.121239 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c37ced7e-a08c-40ed-9b86-6b74dedf65b4 req-c4cdc9a3-4225-4b7b-99bc-df771034ceaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111647 Aug 25 12:36:07.122455 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 467/1002] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:07.146664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.147910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:07.155071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.156418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.157636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.159170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.160259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.161316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.162166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.163356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.165974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.167997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.169054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.170095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.636137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:07.650237 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e5cdb60-488c-47ca-aad6-df2640514aa5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce" status: 200 len: 1466 microversion: 2.1 time: 0.518902 Aug 25 12:36:07.650857 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 468/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:07 2022] GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce => generated 1466 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:07.654286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:07.658035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79e7e0a7-ed1d-4a4a-9dd6-c64b1d10b198 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.687392 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f253ebc9-d982-41d9-9cac-08ba3a798bc6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 0.585589 Aug 25 12:36:07.694516 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 536/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:07 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:07.697102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79e7e0a7-ed1d-4a4a-9dd6-c64b1d10b198 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2089152513/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.042074 Aug 25 12:36:07.697989 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 469/1005] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:36:07 2022] DELETE /compute/v2.1/flavors/2089152513/os-extra_specs/hw:cpu_policy => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 12:36:07.702413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.703772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:07.708975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.709918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:07.713435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.713932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.714524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.715379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.715840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.716324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.718017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.718787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.719500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.720532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.721163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.721772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.755702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:36:07.869126 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de6aa7f0-facc-4977-b67c-c2f9c4719dd4 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 204 len: 0 microversion: 2.1 time: 0.171616 Aug 25 12:36:07.872238 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 537/1006] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:36:07 2022] DELETE /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:36:07.883256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.886467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:07.896589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.896842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.897394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.898505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.899057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.899659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.962446 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe4628cc-3c46-4637-ad26-9896430b186d tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087118 Aug 25 12:36:07.964904 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 538/1007] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:07 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:07.972320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:07.978496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:07.979862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Searching by: {'reservation_id': 'r-iiiryp9s', 'deleted': False, 'project_id': '9887ac4ba161489dbc983267f299f400'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:36:07.987544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.988014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.988769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:07.989878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:07.990637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:07.991364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:08.112661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:08.123922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:08.125742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:36:08.126917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:08.128452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d9fbedf-7d68-4e4a-86a5-43c6685bfec5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.424986 Aug 25 12:36:08.129080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 470/1008] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:36:07 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:08.148145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b651a423-f5c1-4e6e-ac0f-823731cfbe1c tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:08.158929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b651a423-f5c1-4e6e-ac0f-823731cfbe1c tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/2089152513/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028389 Aug 25 12:36:08.159518 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 471/1009] 10.222.0.60 () {58 vars in 1203 bytes} [Thu Aug 25 12:36:08 2022] GET /compute/v2.1/flavors/2089152513/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:36:08.165443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:08.168896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:08.185150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:08.185686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:08.186128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:08.186871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:08.187353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:08.188800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:08.221726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:08.222129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquired lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:08.294637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:08.304657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:08.305603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:08.306057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.079427 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-214ad9c7-df1a-43dc-af80-66b3a14d645b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?reservation_id=r-iiiryp9s" status: 200 len: 2927 microversion: 2.1 time: 1.112829 Aug 25 12:36:09.080508 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 539/1010] 10.222.0.60 () {58 vars in 1197 bytes} [Thu Aug 25 12:36:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-iiiryp9s => generated 2927 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:09.091062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:09.093264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:09.110751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.113376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.114664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.116340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.116985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.117622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.215500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:09.227311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8211869a-d5bb-48c4-ac52-9fee026b829e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 200 len: 1346 microversion: 2.1 time: 0.144069 Aug 25 12:36:09.228087 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 540/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:09 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:09.233384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:09.235231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:09.245692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.246562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.247215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.248284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.249151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.250761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.595145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:09.605170 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-143d8e1b-ed02-4983-b5fe-abb59877275f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1332 microversion: 2.1 time: 0.375672 Aug 25 12:36:09.606155 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 541/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:09 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1332 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:09.619477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e69ee89-038e-48b8-a6f9-70e827c95d15 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:09.644630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e69ee89-038e-48b8-a6f9-70e827c95d15 tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/2089152513" status: 202 len: 0 microversion: 2.1 time: 0.035114 Aug 25 12:36:09.649411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 542/1013] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:36:09 2022] DELETE /compute/v2.1/flavors/2089152513 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:36:09.651860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:09.652911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:09.661323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.661917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.662437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.664636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.664636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.664636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.924821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:09.937967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c2c628c-3163-44b7-b79d-4ada99db3107 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 0.291100 Aug 25 12:36:09.939511 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 543/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:09 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:09.947438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:09.950246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:09.958095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.958653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.959232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:09.960472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:09.961127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:09.961563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.037084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a1d8fbce-acf9-4193-b840-4450291d54d1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095812 Aug 25 12:36:10.037652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 544/1015] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:09 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:10.050454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "name": "network-vif-plugged", "status": "completed", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:10.065339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.065835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.066313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.082082 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] Creating event network-vif-plugged:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h2-850468-18 Aug 25 12:36:10.088712 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9f458d95-726c-49c0-b237-0da8ba18e4f6 req-861b3e30-c059-4012-a1d1-322cdb279b12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049642 Aug 25 12:36:10.089684 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 545/1016] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:10.097094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:10.121342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.server_groups [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Querying cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) for 2 instances {{(pid=122701) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 12:36:10.122214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.122819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.123259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.148745 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01150eb8-4733-4732-b633-870a633962ea tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/fb35254f-c289-4684-9033-e85f26786b8b" status: 200 len: 271 microversion: 2.1 time: 0.057681 Aug 25 12:36:10.149345 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 546/1017] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:36:10 2022] GET /compute/v2.1/os-server-groups/fb35254f-c289-4684-9033-e85f26786b8b => generated 271 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:10.164435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:10.165309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:10.174120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.174619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.175307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.176159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.184425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.184425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.184425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:10.675200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:10.702630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:10.709236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:10.711927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7c736c1d-7ff8-4373-867f-4784d9188433 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1412 microversion: 2.25 time: 0.561386 Aug 25 12:36:10.713993 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 547/1018] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:36:10 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1412 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:10.724466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be789428-d425-4afe-bdca-ebcc51da83db", "tag": "14a4cd41-32a2-43f1-9e93-978a3976f975"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:10.740472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.741897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.742900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.779105 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] Creating event network-changed:14a4cd41-32a2-43f1-9e93-978a3976f975 for instance be789428-d425-4afe-bdca-ebcc51da83db on n-h1-850468-18 Aug 25 12:36:10.788212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-31b40972-ab2a-4a35-b0a8-f0d4d72c676e req-5d14d8e9-46d8-4736-9761-376099eb7ce8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072138 Aug 25 12:36:10.789513 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 548/1019] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:10.797428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6ecfb64-6776-42ec-a30c-235cf7efcf8b tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:10.835563 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6ecfb64-6776-42ec-a30c-235cf7efcf8b tempest-FlavorsExtraSpecsTestJSON-1694416310 tempest-FlavorsExtraSpecsTestJSON-1694416310-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044086 Aug 25 12:36:10.848965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 549/1020] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:36:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:10.848965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:10.848965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:10.873420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.874634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.876319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:10.877963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:10.879268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:10.880209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:11.582486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56cbc4f8-c86c-4d23-90e4-ea708b21feb0 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1621 microversion: 2.1 time: 0.743927 Aug 25 12:36:11.596153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 550/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:10 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1621 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:11.612163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:11.612163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:11.623418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:11.626442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:11.627404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:11.628779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:11.631864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:11.639164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:11.682403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff HTTP/1.1 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:36:11.684156 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:11.686728 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e72649d3-a6c6-4f73-9888-c0474abfedff'} Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:11.688325 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:11.690863 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:11.694987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:11.694987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9f56d6e-4fa5-41f4-ac7c-14fa758468c0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 404 len: 111 microversion: 2.1 time: 0.106262 Aug 25 12:36:11.698510 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 551/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:11 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:11.711713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:11.712829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:11.726200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:11.726709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:11.727241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:11.728059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:11.733024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:11.733511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:12.126229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:36:13.092856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:13.130908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0204d6e6-6d76-4cb0-a481-f55581d69ffb tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1535 microversion: 2.1 time: 1.431055 Aug 25 12:36:13.132807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 552/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:11 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1535 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:13.139848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:13.140823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:13.151353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:13.151838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:13.152329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:13.153993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:13.154681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:13.156015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:13.979540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:13.993031 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-479423c9-1938-4c37-87e4-ca2f41aba4a7 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 0.858681 Aug 25 12:36:13.993659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 553/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:13 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:14.004982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:14.007469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:14.031170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.031778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.032651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.034878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.038888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.049418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.112880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d94bbd52-13b7-45e2-bae8-028afcc00cfc tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115785 Aug 25 12:36:14.120665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 554/1025] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:13 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:14.133327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:14.134080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:14.167941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.168464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.168906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.178053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.178865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.179468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.735993 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e164a71-be81-493b-9b28-f4f13b49cb43 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce" status: 200 len: 1619 microversion: 2.1 time: 0.612153 Aug 25 12:36:14.738761 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 555/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:14 2022] GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce => generated 1619 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:14.801567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:14.803854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:14.850644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.853937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.855495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:14.861094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:14.863140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:14.865653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.085431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Updating instance_info_cache with network_info: [{"id": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b", "address": "fa:16:3e:bf:b7:40", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b8d8031-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:36:15.128960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Releasing lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:15.131238 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2c02113-8034-43e0-b217-2e88e55d0d1d tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action" status: 202 len: 0 microversion: 2.1 time: 6.969982 Aug 25 12:36:15.133533 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 472/1027] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:08 2022] POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action => generated 0 bytes in 6973 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:36:15.166360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:15.175742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:15.205355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.206576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.207976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.212213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.213735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.215673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.254166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff/os-volume_attachments HTTP/1.1 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:36:15.260441 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:15.263132 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'e72649d3-a6c6-4f73-9888-c0474abfedff'} Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:15.264549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:36:15.267481 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:15.276662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:15.301429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7efd57f1-feb4-4150-a91c-259a9cd9f534 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.163385 Aug 25 12:36:15.308511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 473/1028] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:15 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff/os-volume_attachments => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:15.313818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:15.337412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "name": "network-vif-unplugged", "status": "completed", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:15.348915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:15.351125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:15.353345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d8fb720-d7c8-4402-9163-65ffa132ade5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1608 microversion: 2.25 time: 0.612369 Aug 25 12:36:15.369154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 556/1029] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:36:14 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1608 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:36:15.387474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:15.389126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.389996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.391334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.397530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:RELEASE=3,nova_api:SAVEPOINT=2,nova_api:UPDATE=2,nova_api:SELECT=89,nova_api:DELETE=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:15.409565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.410409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.411205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.435914 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] Creating event network-changed:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:36:15.446861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-01b9c842-8631-44fe-8678-ae8bc3c28954 req-ead6cf3b-a8c9-40ea-909c-fd83dc04de28 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074949 Aug 25 12:36:15.448427 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 557/1030] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:15.459253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2c76b2a-44c7-48a0-806b-89704c2d8669 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'create', calling method: .version_select at 0x7fc6c292e040>, body: {"pool": "67ab369b-7bc4-4554-ad49-c1ad8f1d8495"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:15.464033 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] Creating event network-vif-unplugged:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:36:15.494336 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-18aef544-c22e-4c01-9bbb-4ee7ec68ec61 req-bfaef836-aebc-4c51-ad54-4a0510c7a462 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180538 Aug 25 12:36:15.496830 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 474/1031] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:15.516308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:15.517549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:15.535429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.536830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.538454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.540270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:15.541441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:15.542511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:15.581729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:16.060802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:16.081346 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33a2b3cb-8803-4236-bb35-734a4e4b162c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 0.581759 Aug 25 12:36:16.083049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 475/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:15 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:16.092227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1785678345", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "5a61c5bb-e595-4272-a2db-69cd3886a0c4"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:16.196612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:36:17.328861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:36:17.333276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:36:17.336636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:36:17.337499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:36:17.338293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:36:17.342789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:17.368430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:17.369391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:17.370100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:17.371192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:17.371754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:17.372228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:17.402428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:36:17.414858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:36:17.440842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:36:17.445348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:36:17.526341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa8ebe5c-1a05-40a4-9b92-c8b162566e6a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439361 Aug 25 12:36:17.541448 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 476/1033] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:36:17.543541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:17.549542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:17.561260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:17.562038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:17.562769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:17.564981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:17.565960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:17.566648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:17.621045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51d8fc5d-9134-49c1-aff1-bd8ef9f62db8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081745 Aug 25 12:36:17.628619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 477/1034] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:36:17 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:36:17.634371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b955110c-c6c3-46dc-9ecf-b62c1f94666a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '.version_select at 0x7fc6c2929430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:18.027546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:18.293401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:18.320048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b955110c-c6c3-46dc-9ecf-b62c1f94666a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/36101343-46c1-4953-b96c-c64b0152f022" status: 200 len: 183 microversion: 2.1 time: 0.689705 Aug 25 12:36:18.321546 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 478/1035] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:36:17 2022] GET /compute/v2.1/os-floating-ips/36101343-46c1-4953-b96c-c64b0152f022 => generated 183 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:18.338480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:18.341380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:18.358027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:18.359421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:18.360389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:18.362160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:18.363332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:18.364579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:18.586129 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a377903-2130-49f2-8115-27ba6262b531 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.262275 Aug 25 12:36:18.587231 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 479/1036] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 12:36:18 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:36:18.599258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-666089531", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:18.740067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:36:20.856167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2c76b2a-44c7-48a0-806b-89704c2d8669 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.405577 Aug 25 12:36:20.857199 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 558/1037] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:36:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:20.867746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:20.869267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:20.881647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:20.882468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:20.883499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:20.885198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:20.886564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:20.887751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:20.986831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:36:20.987715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:36:20.988425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:36:20.989439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:36:20.990257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:36:21.003120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.004761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.005366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.006323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.006917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.007463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.043260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:36:21.055511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:36:21.079186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:36:21.083350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:36:21.171382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-90038ea7-f590-43f2-a99d-9d60955aa908 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.579302 Aug 25 12:36:21.173695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 480/1038] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:36:21.542285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:21.554993 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-223f21a3-6375-4e21-b9f3-c3ef4294fef9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1308 microversion: 2.1 time: 0.696441 Aug 25 12:36:21.560233 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 559/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:20 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1308 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:21.566250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:21.577426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:21.598011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be789428-d425-4afe-bdca-ebcc51da83db", "name": "network-vif-plugged", "status": "completed", "tag": "14a4cd41-32a2-43f1-9e93-978a3976f975"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:21.601651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.603996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.606041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.608072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.611186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.614898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.626497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.627491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.628232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.674872 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] Creating event network-vif-plugged:14a4cd41-32a2-43f1-9e93-978a3976f975 for instance be789428-d425-4afe-bdca-ebcc51da83db on n-h1-850468-18 Aug 25 12:36:21.693296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ce8fb58a-b173-49b5-9aea-81bf75d61492 req-63f923b1-0df2-4000-907f-c86e7980c803 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.516507 Aug 25 12:36:21.695178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 481/1040] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:21.715289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5877fa9e-9a96-4b49-919c-8919787535a9", "name": "network-vif-deleted", "tag": "f71f0fc6-30e0-4339-acef-61dbe18594b8"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:21.761702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:21.763326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:21.764522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:21.799957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:21.813354 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56f4331f-3b20-4ddc-9385-a93353776407 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1275 microversion: 2.1 time: 0.251442 Aug 25 12:36:21.818869 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] Creating event network-vif-deleted:f71f0fc6-30e0-4339-acef-61dbe18594b8 for instance 5877fa9e-9a96-4b49-919c-8919787535a9 on n-h2-850468-18 Aug 25 12:36:21.821134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 560/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:21 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:21.847150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1813377021", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c466f89d-b626-4741-a445-83dbda6c02ea"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:21.857365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-caeb8fb6-b0f1-466f-87e9-59dae61064a9 req-d74e4327-355b-4f6d-940e-f41b3b9aac45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157844 Aug 25 12:36:21.858905 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 482/1042] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:21.913080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:22.011235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] validate_networks() for [('c466f89d-b626-4741-a445-83dbda6c02ea', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:36:22.760658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:22.769101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:22.769709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:22.770256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:22.771527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:22.772373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:22.773075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:23.723070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:23.723890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquired lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:24.814934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:36:24.815816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:36:24.816047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:36:24.816504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:36:24.817212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:36:24.838378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:24.848567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:24.849649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:24.851477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:24.860160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:24.861151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:24.963246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:36:24.985921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Getting quotas for user 3c97779db8554723a2c447c5d0ed22d5 and project 9e653d2a13844d2d98c5d7cff5bf1ad2. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:36:25.033744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:36:25.042152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:36:25.145762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7cf71a5-7367-481b-b709-466dba7ac735 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.316630 Aug 25 12:36:25.159489 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 561/1043] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:36:25.168552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: .version_select at 0x7fc6c464eb80>, body: {"addFloatingIp": {"address": "172.25.6.189"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:25.178919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:25.203297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:25.207070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:25.207800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:25.211605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:25.212459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:25.216023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:25.481579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:25.482599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquired lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:28.995676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:36:31.018824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:31.068749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:32.768879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:33.616939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Building network info cache for instance {{(pid=122701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:36:34.216529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Updating instance_info_cache with network_info: [{"id": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b", "address": "fa:16:3e:bf:b7:40", "network": {"id": "3717ae61-80a1-4058-8a2c-1416a7cabe97", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1996856550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3e9466a4a4154bfeb4755f53ca566af5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6b8d8031-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:36:34.270978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Releasing lock "refresh_cache-5ff543ba-5197-4589-89c2-3908aea81a09" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:34.275262 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ab4aea1-6681-4bdb-804b-11c7684977b2 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action" status: 202 len: 0 microversion: 2.1 time: 12.413160 Aug 25 12:36:34.280710 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 483/1044] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:21 2022] POST /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09/action => generated 0 bytes in 12418 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:36:34.325610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:34.326793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:34.358206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:34.359448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:34.362726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:34.373374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:34.378281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:34.386375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:34.917467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:34.940633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:34.961948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e844fa2-b205-4ff3-8995-1588f755ae6c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.682575 Aug 25 12:36:34.964339 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 484/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:34 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:34.976316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:34.979755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:34.997978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:35.001371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:35.004609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:35.007726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:35.008654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:35.009208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:35.021249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:35.202043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:36.554488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:36.579592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db2eea58-9d47-45e4-8861-ce67d126604b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1489 microversion: 2.1 time: 1.609398 Aug 25 12:36:36.583639 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 485/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:34 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1489 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:36.610278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:36.611309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:36.641424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:36.642123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:36.653285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:36.653285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:36.653285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:36.653694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:37.935386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:37.953135 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3068aa07-48a9-461f-9e6b-7bb0504024ac tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1317 microversion: 2.1 time: 1.364894 Aug 25 12:36:37.955322 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 486/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:36 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1317 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:37.961602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:37.997778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:37.998638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:37.999294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.019233 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] Creating event network-changed:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h2-850468-18 Aug 25 12:36:38.033517 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-aabcefeb-762f-4c21-8647-3df2e808b964 req-9c91c0e8-ce2d-49d0-a065-6b1722f60a4b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075564 Aug 25 12:36:38.034668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 487/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:38.041167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:38.044158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:38.052700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.053419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.054356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.054740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Updating instance_info_cache with network_info: [{"id": "8f2a98b4-168f-4e68-8baf-41322e9d1477", "address": "fa:16:3e:f1:e3:4c", "network": {"id": "c21f680c-12a7-4064-9b66-8c43a8f22f33", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-136094112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5af80caa01e4486cb093ae485e5bcaaa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f2a98b4-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:36:38.055658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.056200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.056641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.122633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Releasing lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:38.127035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2650f8ab-b91f-448a-b9a7-5d1bee5ce733 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 202 len: 0 microversion: 2.1 time: 12.965281 Aug 25 12:36:38.128477 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 562/1049] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:25 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 0 bytes in 12968 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:36:38.155104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:38.158077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:38.169825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.172817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.174019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.175819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.176729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.177424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.205064 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] HTTP exception thrown: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Request method failure captured: Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 HTTP/1.1 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2xAyLpX9YidmRr_iYryBoBEdazL9it9PRb0oXaYqlffG3AhQo5pTNphu7WOvaqOIxL3aU2OZnl58c4gyB60zUz1AO3m81wHWSTR1OwsDznI17Q9CxEtvp_dzZtpWXXi9QE0k-0oy3KGgIBi7azZeWKknnbNLsDJSehJltikk10_t14 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:36:38.211132 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0b7729727225458aa40314510167ef94 Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:38.214006 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5877fa9e-9a96-4b49-919c-8919787535a9'} Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:38.215823 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:38.220101 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:38.223337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Returning 404 to user: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:38.223337 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e4b0d64-a592-4536-b69f-dda166e5a8a6 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 404 len: 111 microversion: 2.1 time: 0.091855 Aug 25 12:36:38.223337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 563/1050] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:36:38 2022] DELETE /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:38.227882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:38.228444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:38.236034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.236609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.237096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.237874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.238564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.239354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.276871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:36:38.389118 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b044e13b-9b1c-4ed3-aa1a-03a0205b5a44 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 204 len: 0 microversion: 2.1 time: 0.164795 Aug 25 12:36:38.391290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 564/1051] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:36:38 2022] DELETE /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:36:38.398209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:38.407814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:38.408672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:38.409127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:38.543373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 12:36:38.681006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:38.722841 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9032ec18-fe26-42df-bed7-068d4baf7a81 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db/action" status: 202 len: 0 microversion: 2.1 time: 0.324903 Aug 25 12:36:38.726831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 565/1052] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:38 2022] POST /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:36:38.755687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67fe1bfe-b000-43a8-bab1-124895b5b5a5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'create', calling method: .version_select at 0x7fc6c27c2f70>, body: {"pool": "67ab369b-7bc4-4554-ad49-c1ad8f1d8495"} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:38.920573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:38.951434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9061c1d4-be4b-40d3-b319-02a9125a4052 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1318 microversion: 2.1 time: 0.914788 Aug 25 12:36:38.975695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 488/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:38 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:39.275290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1086972700", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1b190f40-d315-44fa-af57-e579f81ef520"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:39.380840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] validate_networks() for [('1b190f40-d315-44fa-af57-e579f81ef520', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:36:41.087300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:36:41.088336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:36:41.088336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:36:41.088830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:36:41.089145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:36:41.115464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.115957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.116633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.117789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.118284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.118794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.208071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:36:41.225665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for user c6be50aac19c400cb9883fcf881ad13c and project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:36:41.247326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:36:41.250035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:36:41.331289 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4bb2b0f2-1a08-46e3-8da8-64bbe014a7b3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.353644 Aug 25 12:36:41.332722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 489/1054] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:36:41.338571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:41.339742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5877fa9e-9a96-4b49-919c-8919787535a9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:41.347482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.347982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.348474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.349184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.349664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.350085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.367390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] HTTP exception thrown: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Request method failure captured: Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 HTTP/1.1 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2xAyLpX9YidmRr_iYryBoBEdazL9it9PRb0oXaYqlffG3AhQo5pTNphu7WOvaqOIxL3aU2OZnl58c4gyB60zUz1AO3m81wHWSTR1OwsDznI17Q9CxEtvp_dzZtpWXXi9QE0k-0oy3KGgIBi7azZeWKknnbNLsDJSehJltikk10_t14 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:36:41.369111 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0b7729727225458aa40314510167ef94 Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:41.370713 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5877fa9e-9a96-4b49-919c-8919787535a9'} Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:41.372367 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. Aug 25 12:36:41.373906 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:41.380368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Returning 404 to user: Instance 5877fa9e-9a96-4b49-919c-8919787535a9 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:41.380368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa5a9ef5-ffae-4d1f-ac15-e0ffe348f9db tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9" status: 404 len: 111 microversion: 2.1 time: 0.044593 Aug 25 12:36:41.380368 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 490/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:41 2022] GET /compute/v2.1/servers/5877fa9e-9a96-4b49-919c-8919787535a9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:41.385412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:41.386285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:41.424164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.424952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.425622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.426558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.427282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.427939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.685875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:41.705187 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96b93c30-52b0-472e-931d-e13355b5aa03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.324017 Aug 25 12:36:41.706892 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 491/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:41 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:41.715301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:41.716101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:41.725414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.725998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.726503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:41.727293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:41.727817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:41.728586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.074696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:42.089524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6a827fe-232f-48b2-be34-ef95e6820087 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1499 microversion: 2.1 time: 0.379887 Aug 25 12:36:42.090794 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 492/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:41 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1499 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:42.111896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:42.113368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:42.125889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.127028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.128038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.129014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.129650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.130220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.331551 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67fe1bfe-b000-43a8-bab1-124895b5b5a5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.598915 Aug 25 12:36:42.345758 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 566/1058] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:36:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:42.345758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:42.345758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:42.357097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.357961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.358546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.359432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.360030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.360650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.364323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:42.385180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a82919da-6032-4ad3-8768-f9e295f3e5fe tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1317 microversion: 2.1 time: 0.292729 Aug 25 12:36:42.386249 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 493/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:42 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:42.396198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}, {"name": "network-changed", "server_uuid": "ebf36314-9748-4704-b79d-f308fa1ac10d", "tag": "9825c8d5-5ae7-4413-83e2-e1cc71c2ef28"}, {"name": "network-changed", "server_uuid": "0b57dd74-8a45-429f-b66d-7d773cb4779f", "tag": "8f2a98b4-168f-4e68-8baf-41322e9d1477"}, {"name": "network-changed", "server_uuid": "f768c272-274f-41ca-a85e-52f4cba3560d", "tag": "05bb4f0e-5f16-41db-b3a9-649d3e563cff"}, {"name": "network-changed", "server_uuid": "e4f3caea-4329-40a3-be65-39fc5b7af77e", "tag": "7151dec8-c3c6-459c-83f3-2ac23acaadca"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:42.422152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.423055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.424163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.459729 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Creating event network-changed:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:36:42.461047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Creating event network-changed:9825c8d5-5ae7-4413-83e2-e1cc71c2ef28 for instance ebf36314-9748-4704-b79d-f308fa1ac10d on n-h2-850468-18 Aug 25 12:36:42.462099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Creating event network-changed:8f2a98b4-168f-4e68-8baf-41322e9d1477 for instance 0b57dd74-8a45-429f-b66d-7d773cb4779f on n-h2-850468-18 Aug 25 12:36:42.463131 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Creating event network-changed:05bb4f0e-5f16-41db-b3a9-649d3e563cff for instance f768c272-274f-41ca-a85e-52f4cba3560d on n-h1-850468-18 Aug 25 12:36:42.464241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] Creating event network-changed:7151dec8-c3c6-459c-83f3-2ac23acaadca for instance e4f3caea-4329-40a3-be65-39fc5b7af77e on n-h2-850468-18 Aug 25 12:36:42.489264 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-51ba061e-0042-424d-94a1-b1551f285cac req-0a9d14e7-2ac0-4172-a817-1bb9be283296 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 847 microversion: 2.1 time: 0.100786 Aug 25 12:36:42.490614 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 494/1060] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 847 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:42.501490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf36314-9748-4704-b79d-f308fa1ac10d", "name": "network-vif-plugged", "status": "completed", "tag": "9825c8d5-5ae7-4413-83e2-e1cc71c2ef28"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:42.535454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.536440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.537270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.569585 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] Creating event network-vif-plugged:9825c8d5-5ae7-4413-83e2-e1cc71c2ef28 for instance ebf36314-9748-4704-b79d-f308fa1ac10d on n-h2-850468-18 Aug 25 12:36:42.581529 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-25853713-eba1-4a00-bc50-bf1aabf498af req-2b2be490-2d56-4121-9aa1-0dd9070079fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087868 Aug 25 12:36:42.583449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 495/1061] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:42.595809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:42.597365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:42.609801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.610861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.611778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.613414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:42.614539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:42.615632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:42.913279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:42.933434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:42.955400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ba44caa-80b8-4b15-976f-8ae542138d29 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1318 microversion: 2.1 time: 0.619701 Aug 25 12:36:42.957996 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 567/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:42 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:42.970715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a99386b-595b-4d1e-8d51-84d8a85cc942 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1215 microversion: 2.1 time: 0.382883 Aug 25 12:36:42.984627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 496/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:42 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:42.985527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97f9be66-c2de-4901-9ef2-0a6cc95f5374 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '.version_select at 0x7fc6c2993f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:42.991702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.210"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:43.000567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:43.024033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:43.026460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:43.028322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:43.030669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:43.033136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:43.034344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:43.113691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:43.114934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquired lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:45.174915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495.", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:36:45.176059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Releasing lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:45.178609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.178609 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Request method failure captured: Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action HTTP/1.1 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 46 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2yklbOw1qHVIiIH62nwlEyrAqP8kgRU261d479yDPrKFEMzByCbyBxmXvBaeAC31J9fhwbVvcSIY3AWVQJ7brlSWeBXy1iukpl5rfl1IMWtl_P0RzvUbNykoWzfK71ZbUIKrT-OcsukUvS-u_mAlKNwBreZiEAosK88ZK4NoXcgOY8 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:36:45.200223 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0184f259fa3e42a2996b750fdd8c80c6 Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: {"addFloatingIp": {"address": "172.25.6.210"}} Aug 25 12:36:45.204079 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0b57dd74-8a45-429f-b66d-7d773cb4779f', 'body': {'addFloatingIp': {'address': '172.25.6.210'}}} Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.206351 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:36:45.209114 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.212476 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.213697 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Returning 400 to user: Cannot associate floating IP 172.25.6.210 (61911aca-5b76-404f-a84d-f72a0707aff7) with port 8f2a98b4-168f-4e68-8baf-41322e9d1477 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 67ab369b-7bc4-4554-ad49-c1ad8f1d8495. Aug 25 12:36:45.214998 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-f26be315-5bd7-4d1e-a5c4-78bc353d0c83'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:45.217464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-faf89c9f-f2be-4b3d-a3fc-55899124879c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 400 len: 381 microversion: 2.1 time: 2.241042 Aug 25 12:36:45.218095 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 497/1064] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:42 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 381 bytes in 2245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:36:45.227153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:45.228108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:45.239918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:45.241237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:45.242104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:45.243077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:45.243770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:45.244444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:46.119158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:46.121937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:46.130093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c90446a-7550-44a1-846f-6a5bb966539c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.907212 Aug 25 12:36:46.130696 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 498/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:45 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:46.135722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:46.136436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:46.146751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:46.147343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:46.147802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:46.148580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:46.149040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:46.149468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:46.696576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:46.722236 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f20ecfb4-833c-461b-ab54-a67c1762f117 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1499 microversion: 2.1 time: 0.590391 Aug 25 12:36:46.723818 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 499/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:46 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1499 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:46.729705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:46.730714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:46.738147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:46.742578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:46.743461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:46.744577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:46.745291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:46.745958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:47.246992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97f9be66-c2de-4901-9ef2-0a6cc95f5374 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/36101343-46c1-4953-b96c-c64b0152f022" status: 202 len: 0 microversion: 2.1 time: 4.276092 Aug 25 12:36:47.248346 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 568/1067] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:36:42 2022] DELETE /compute/v2.1/os-floating-ips/36101343-46c1-4953-b96c-c64b0152f022 => generated 0 bytes in 4279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:36:47.257796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:47.258045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:47.267664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:47.268181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:47.268797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:47.269518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:47.269972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:47.270624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:47.301578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:47.312611 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c09d7380-f9f0-48e9-a3eb-3fef9ddac047 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1467 microversion: 2.1 time: 0.586430 Aug 25 12:36:47.313784 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 500/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:46 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1467 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:47.321351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:47.322407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:47.334794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:47.334794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:47.337815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:47.337815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:47.337815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:47.337815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:47.741693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:47.751392 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2cb9d727-1487-4480-9809-4f19546c5d60 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1269 microversion: 2.1 time: 0.436260 Aug 25 12:36:47.752407 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 501/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:47 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1269 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:47.758145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ca4eef4-c9d9-4458-a326-b0345ab79710 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '.version_select at 0x7fc6c29123a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:48.108637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:48.126322 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-208e6dd3-56d0-418e-9eff-ea068789cd89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1318 microversion: 2.1 time: 0.873165 Aug 25 12:36:48.127652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 569/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:47 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1318 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:48.143204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f3caea-4329-40a3-be65-39fc5b7af77e", "name": "network-vif-plugged", "status": "completed", "tag": "7151dec8-c3c6-459c-83f3-2ac23acaadca"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:48.161361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:48.162233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:48.163057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:48.182821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] Creating event network-vif-plugged:7151dec8-c3c6-459c-83f3-2ac23acaadca for instance e4f3caea-4329-40a3-be65-39fc5b7af77e on n-h2-850468-18 Aug 25 12:36:48.194491 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f821bfc1-bda6-4764-b480-0b3cd8ff7cb8 req-8979e9b1-4653-4289-89ff-fb23b04f926f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062131 Aug 25 12:36:48.195802 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 570/1071] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:48.204445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:48.205000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:48.218329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:48.219861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:48.220045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:48.222695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:48.223791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:48.225130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:48.842825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:48.853553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8d44369-ba75-4c0e-918a-8623e7cc2a33 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.655966 Aug 25 12:36:48.854146 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 571/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:48 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:48.859123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:48.860040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:48.871524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:48.872776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:48.875002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:48.877279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:48.878157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:48.878955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:48.926151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:36:49.053644 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e2e75e54-b8da-4663-98c9-a6db30b2631a tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 204 len: 0 microversion: 2.1 time: 0.197680 Aug 25 12:36:49.054690 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 572/1073] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:36:48 2022] DELETE /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:36:49.066609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:49.068222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:49.080983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.081890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.082669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:49.084283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.085156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.086899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:49.531851 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50a928f9-3365-4a2b-939a-64228c92b478 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1620 microversion: 2.1 time: 0.474938 Aug 25 12:36:49.532981 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 573/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:49 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1620 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:49.541474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:49.542646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:49.554013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.555106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.555919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:49.557269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.558145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.558930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:49.873789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:49.893243 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d0a909b3-4961-41fe-9eb9-ac0682e60e47 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1499 microversion: 2.1 time: 0.358382 Aug 25 12:36:49.894704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 574/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:49 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1499 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:49.905404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:49.911850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:49.925570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.926461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.927260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:49.928748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:49.929550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:49.930328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:50.150248 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ca4eef4-c9d9-4458-a326-b0345ab79710 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/61911aca-5b76-404f-a84d-f72a0707aff7" status: 202 len: 0 microversion: 2.1 time: 2.396285 Aug 25 12:36:50.154335 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 502/1076] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:36:47 2022] DELETE /compute/v2.1/os-floating-ips/61911aca-5b76-404f-a84d-f72a0707aff7 => generated 0 bytes in 2401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:36:50.160716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:50.161595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:50.169127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:50.169708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:50.170287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:50.171121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:50.172212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:50.172897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:50.415980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:50.426228 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-baf0e527-0bf8-481c-b8d6-ae7b096ec025 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.529836 Aug 25 12:36:50.426969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 575/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:49 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:50.433069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:50.434416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:50.442622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:50.443106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:50.443752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:50.444518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:50.445095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:50.445400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:51.012579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:51.028390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f27aa20-a066-4c89-8f79-01e86e9b0fff tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1526 microversion: 2.1 time: 0.872177 Aug 25 12:36:51.029464 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 503/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:50 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1526 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:51.053762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1299338094", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["5a61c5bb-e595-4272-a2db-69cd3886a0c4"]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:51.138295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:51.165580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:36:51.238267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:51.396770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:51.413770 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0742f618-3c39-4e09-96d8-a49f02d1f384 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1318 microversion: 2.1 time: 0.985280 Aug 25 12:36:51.414952 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 576/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:50 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1318 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:51.425477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:51.427451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:51.454423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:51.454957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:51.455402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:51.456746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:51.457230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:51.457655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.050091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:52.060581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d87b769-985d-4321-8c97-4887404ad001 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.642212 Aug 25 12:36:52.076584 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 577/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:51 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:52.084756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: .version_select at 0x7fc6c4604310>, body: {"removeFloatingIp": {"address": "172.25.6.189"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:52.237322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:36:52.238184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:36:52.238797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:36:52.239805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:36:52.240532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:36:52.253859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.254860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.255373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.256654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.257518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.257902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.299609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:36:52.317882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:36:52.351524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:36:52.357950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:36:52.430560 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d8ad5fc-e6be-4142-912a-16833938ed65 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399355 Aug 25 12:36:52.431953 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 504/1081] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:36:52.439837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f768c272-274f-41ca-a85e-52f4cba3560d", "name": "network-vif-plugged", "status": "completed", "tag": "05bb4f0e-5f16-41db-b3a9-649d3e563cff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:52.451921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.452456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.453370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.471764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] Creating event network-vif-plugged:05bb4f0e-5f16-41db-b3a9-649d3e563cff for instance f768c272-274f-41ca-a85e-52f4cba3560d on n-h1-850468-18 Aug 25 12:36:52.478825 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4d539feb-0ac1-424d-a87b-4b7071622e3b req-752d5587-52ea-427b-b415-3272235c4abf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045082 Aug 25 12:36:52.480416 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 505/1082] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:52.487781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:52.488955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:52.496078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.497327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.498080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.498988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.500182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.502069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.715580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:52.728032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.728587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.729077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:52.729814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:52.730497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:52.732667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:53.364005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:53.385923 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b50c2ef-fdea-43f0-95b3-ce54b3d12347 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1499 microversion: 2.1 time: 0.903469 Aug 25 12:36:53.387802 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 506/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:52 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1499 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:53.397859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbac45bc-3c6e-462b-8a42-5c2a08124143", "tag": "eacacf3e-0733-47d9-aa83-30888618a4be"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:53.417144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:53.418114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:53.418712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:53.439163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] Creating event network-changed:eacacf3e-0733-47d9-aa83-30888618a4be for instance dbac45bc-3c6e-462b-8a42-5c2a08124143 on n-h1-850468-18 Aug 25 12:36:53.445082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1d29d27a-e056-4e7b-9f06-e6e9edf93e6a req-239b5a47-fc57-48c4-a5a2-8521d91f7fe4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055136 Aug 25 12:36:53.445977 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 507/1084] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:53.453674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:53.454767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:53.462709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:53.463429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:53.463976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:53.464905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:53.465465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:53.466102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:53.555066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:36:53.555767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquired lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:36:54.360338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:54.370610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f45fcda8-b90e-44cd-93cd-67738b20af79 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.922966 Aug 25 12:36:54.371859 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 508/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:53 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:54.377911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:54.378570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:54.385729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.386202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.386840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.387552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.388372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.389027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.450082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.450979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.451841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.453755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lazy-loading 'fault' on Instance uuid 5ff543ba-5197-4589-89c2-3908aea81a09 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:36:54.552906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b7729727225458aa40314510167ef94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9466a4a4154bfeb4755f53ca566af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:54.570337 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aae0d536-f1c7-43c2-a0c3-1b579624d813 tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 200 len: 1313 microversion: 2.1 time: 0.196561 Aug 25 12:36:54.595825 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 509/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:54 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:54.607432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:54.608736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:54.621507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.622965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.623998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.625925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.626868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.627689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.803203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:54.821031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-472437f7-5165-4ec1-ac3c-27f268795853 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1275 microversion: 2.1 time: 0.222414 Aug 25 12:36:54.822692 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 510/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:54 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:54.836405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:54.837189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:54.858140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.860640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.864905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:54.869614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:54.871763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:54.872986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:55.286562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:55.298991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1af3d50f-c820-4b42-bd6e-6cbdf74621b1 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1508 microversion: 2.1 time: 0.473730 Aug 25 12:36:55.300437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 511/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:54 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:55.309195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:55.310652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:55.344018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:55.345478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:55.346470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:55.348662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:55.351403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:55.353562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:55.847965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:55.886771 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-24e7066d-69b9-45f2-bdfb-f6f5b6835ac6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.577951 Aug 25 12:36:55.888757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 512/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:55 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:55.897831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:55.898905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:55.912748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:55.914199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:55.915270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:55.918932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:55.920618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:55.922621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:55.943721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Building network info cache for instance {{(pid=122701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 12:36:56.495871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:56.515317 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad065933-ef18-41a9-bc19-f9573f0c27f9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1499 microversion: 2.1 time: 0.623533 Aug 25 12:36:56.516255 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 513/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:55 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1499 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:56.526716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:56.527683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:56.536431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:56.537528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:56.538192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:56.539287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:56.540901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:56.541671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:56.975079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:56.987652 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a67c982-382d-49bd-96e5-70006653e2da tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.466615 Aug 25 12:36:56.989864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 514/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:56 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:56.999047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff543ba-5197-4589-89c2-3908aea81a09", "name": "network-vif-deleted", "tag": "6b8d8031-7ac7-419c-ad05-6a81cc98fd1b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:57.026585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.027411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.028001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.052224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Updating instance_info_cache with network_info: [{"id": "8f2a98b4-168f-4e68-8baf-41322e9d1477", "address": "fa:16:3e:f1:e3:4c", "network": {"id": "c21f680c-12a7-4064-9b66-8c43a8f22f33", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-136094112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5af80caa01e4486cb093ae485e5bcaaa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f2a98b4-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:36:57.061014 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] Creating event network-vif-deleted:6b8d8031-7ac7-419c-ad05-6a81cc98fd1b for instance 5ff543ba-5197-4589-89c2-3908aea81a09 on n-h2-850468-18 Aug 25 12:36:57.068746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Releasing lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:36:57.069950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f43646f-4d5b-4056-9279-38a1dcc4f4ec tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 202 len: 0 microversion: 2.1 time: 4.992172 Aug 25 12:36:57.071500 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 578/1092] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:36:52 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 0 bytes in 4994 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 12:36:57.075646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-94e72d88-e57a-43a9-ac24-7bb5c4a685f5 req-dafd35fc-b3ee-4fde-bd7a-e53c611c7176 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081909 Aug 25 12:36:57.076300 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 515/1093] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:57.084088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:57.085209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] [instance: 5ff543ba-5197-4589-89c2-3908aea81a09] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:57.089977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:57.090713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:57.095086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.096274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.096971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.098061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.099035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.099724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.112623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.113135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.113586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.114332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.114793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.115220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.120780 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] HTTP exception thrown: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Request method failure captured: Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 HTTP/1.1 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2xAyLpX9YidmRr_iYryBoBEdazL9it9PRb0oXaYqlffG3AhQo5pTNphu7WOvaqOIxL3aU2OZnl58c4gyB60zUz1AO3m81wHWSTR1OwsDznI17Q9CxEtvp_dzZtpWXXi9QE0k-0oy3KGgIBi7azZeWKknnbNLsDJSehJltikk10_t14 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:36:57.122803 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e9466a4a4154bfeb4755f53ca566af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3e9466a4a4154bfeb4755f53ca566af5 Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1676298156 Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0b7729727225458aa40314510167ef94 Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1676298156-project Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. Aug 25 12:36:57.125369 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5ff543ba-5197-4589-89c2-3908aea81a09'} Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:57.126253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. Aug 25 12:36:57.127792 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:36:57.132609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] Returning 404 to user: Instance 5ff543ba-5197-4589-89c2-3908aea81a09 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:57.134095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a6b9422f-bbbd-44c6-977e-d09a942defac tempest-FloatingIPsAssociationTestJSON-1676298156 tempest-FloatingIPsAssociationTestJSON-1676298156-project] 10.222.0.60 "GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09" status: 404 len: 111 microversion: 2.1 time: 0.060765 Aug 25 12:36:57.135655 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 579/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:57 2022] GET /compute/v2.1/servers/5ff543ba-5197-4589-89c2-3908aea81a09 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:57.220047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40", "tag": "aa4604e8-be88-47e2-9f18-f3997e8d5940"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:57.232883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.233643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.235682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.271299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] Creating event network-changed:aa4604e8-be88-47e2-9f18-f3997e8d5940 for instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 on n-h2-850468-18 Aug 25 12:36:57.277811 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-88ba9ea2-429d-477b-b68b-c0d9dcf395b1 req-6b69e4ec-4a4c-4ad5-9d2f-fe2204005b8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140193 Aug 25 12:36:57.279209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 580/1095] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:36:57.286069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:57.287114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:57.296093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.321527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.322973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.326667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.328608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.333425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.775639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:57.786045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-517f5c8c-1e22-41d0-abf1-e849c5add12a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.505303 Aug 25 12:36:57.802073 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 581/1096] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:57 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:57.808473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4ab34ea-a25b-4dd3-b2d5-2afbc4f6eff5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '.version_select at 0x7fc6c271fee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:57.838550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:57.857869 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3224fd4e-58e6-41c6-a0f3-6b38eb02ce3c tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1317 microversion: 2.1 time: 0.780028 Aug 25 12:36:57.859674 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 516/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:57 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:57.867258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:57.868365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:57.880156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.881107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.882008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:57.883069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:57.883752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:57.884527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:58.842100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:58.853499 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b3b67fb-bca9-4523-b649-1b63a9ee2cae tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 200 len: 1476 microversion: 2.1 time: 0.991915 Aug 25 12:36:58.860622 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 517/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:57 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 1476 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:58.865439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:58.866217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:58.873507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:58.874141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:58.875235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:58.875974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:58.876652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:58.877220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:59.443301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:36:59.449751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:59.460868 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b8678e4-e771-4968-bf3e-5496ea24a90c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.603738 Aug 25 12:36:59.462154 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 518/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:58 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:36:59.472035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc323e6-22a2-49bd-b16e-575e2d542ea6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:36:59.476166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:59.486478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:36:59.490705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:59.491498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:59.492968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:59.493820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:59.494558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:59.495302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:59.643591 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] HTTP exception thrown: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Request method failure captured: Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e/os-volume_attachments/a6811cac-4d42-48df-a88d-1530df4fdec4 HTTP/1.1 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 74 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w7H9Aqnar0XFuIKqI4e6rsNnfFCY5pDJsxsgau9zo4mJV8pIXOSMUCBI4yw3qu88X6UT7EHYf2h1YEpArzMiQI0hNsFXsG9HNyh2iOSiV8ZsyerPzEDICSrRHF0a_GqONO8fXUohbbKx78brhsiISNiydh5UmU2g1XuVxtl2Lk3qM Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a6e0dc04e5a4406d91ee7fa6b38969e0 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:36:59.651755 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6e0dc04e5a4406d91ee7fa6b38969e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a6e0dc04e5a4406d91ee7fa6b38969e0 Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1925383040 Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesAdminNegativeTest-1925383040-project-admin Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1a65c81128624edd8f773ffaa0c1d684 Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesAdminNegativeTest-1925383040-project-admin Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: {"volumeAttachment": {"volumeId": "7dc323e6-22a2-49bd-b16e-575e2d542ea6"}} Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:36:59.654524 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'e4f3caea-4329-40a3-be65-39fc5b7af77e', 'id': 'a6811cac-4d42-48df-a88d-1530df4fdec4', 'body': {'volumeAttachment': {'volumeId': '7dc323e6-22a2-49bd-b16e-575e2d542ea6'}}} Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:36:59.657612 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. (HTTP 404) (Request-ID: req-ea88c666-0222-4024-9452-e581c0feada5) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 12:36:59.659703 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:36:59.670953 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. Aug 25 12:36:59.675171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:36:59.679404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] Returning 404 to user: Volume a6811cac-4d42-48df-a88d-1530df4fdec4 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:36:59.682157 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-696c7c26-0123-4c1e-9057-a9d6615bdbff tempest-VolumesAdminNegativeTest-1925383040 tempest-VolumesAdminNegativeTest-1925383040-project-admin] 10.222.0.60 "PUT /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e/os-volume_attachments/a6811cac-4d42-48df-a88d-1530df4fdec4" status: 404 len: 109 microversion: 2.1 time: 0.211819 Aug 25 12:36:59.687070 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 519/1100] 10.222.0.60 () {60 vars in 1433 bytes} [Thu Aug 25 12:36:59 2022] PUT /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e/os-volume_attachments/a6811cac-4d42-48df-a88d-1530df4fdec4 => generated 109 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:36:59.706652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:36:59.707824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:36:59.744158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:59.746464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:59.747602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:36:59.748992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:36:59.750713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:36:59.751782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:00.638922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:00.675123 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f43eb90-8016-4f0d-92ed-195f47bb5c55 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1314 microversion: 2.1 time: 0.985142 Aug 25 12:37:00.683254 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 520/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:36:59 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:00.706329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:00.708468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:00.727968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:00.733127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:00.737617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:00.739495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:00.740718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:00.741796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:02.274887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:02.298324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:02.317421 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0474b681-e5ce-43db-a4cd-90fd1cc13e89 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1317 microversion: 2.1 time: 1.632153 Aug 25 12:37:02.348752 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 521/1102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:00 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1317 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:02.357335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1439560786"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:02.362324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:02.366124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:02.384577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:02.385068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:02.385726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:02.386792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:02.387466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:02.388092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:02.809970 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4911af03-5cad-4db6-af5d-277ca1167973 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db/action" status: 202 len: 0 microversion: 2.1 time: 0.458864 Aug 25 12:37:02.813152 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 522/1103] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:02 2022] POST /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:37:02.825581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b57dd74-8a45-429f-b66d-7d773cb4779f", "tag": "8f2a98b4-168f-4e68-8baf-41322e9d1477"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:02.847528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:02.854243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:02.855684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:02.892015 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] Creating event network-changed:8f2a98b4-168f-4e68-8baf-41322e9d1477 for instance 0b57dd74-8a45-429f-b66d-7d773cb4779f on n-h2-850468-18 Aug 25 12:37:02.902644 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-65a1d3d1-537f-4a79-a18c-2796b62af416 req-4a836532-99e4-45ff-b1e8-d88d1433e6c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085813 Aug 25 12:37:02.904314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 523/1104] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:02.914760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:02.917296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:02.937960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:02.938595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:02.939059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:02.939823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:02.940379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:02.940811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:03.127700 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4ab34ea-a25b-4dd3-b2d5-2afbc4f6eff5 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/6b41d4e0-6daa-45fc-8847-124d9dedb0a6" status: 202 len: 0 microversion: 2.1 time: 5.323612 Aug 25 12:37:03.129906 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 582/1105] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:36:57 2022] DELETE /compute/v2.1/os-floating-ips/6b41d4e0-6daa-45fc-8847-124d9dedb0a6 => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:37:03.153333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:03.154977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:03.179075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:03.180009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:03.189007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:03.190629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:03.191848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:03.193568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:03.889200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:37:03.965523 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f3110bc-5556-42fc-98fe-549e535bbba8 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 2348 microversion: 2.25 time: 1.059081 Aug 25 12:37:03.970773 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 524/1106] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:37:02 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 2348 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:03.982392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:03.988277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:04.020630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.022267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.025588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.028075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.032878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.033845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.278949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:04.289902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-879e42f0-722b-44bf-9d0a-664bb6fe21d3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 1.157773 Aug 25 12:37:04.304055 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 583/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:03 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:04.309574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc14af8c-709f-4aac-a139-da986cac6a4d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27e8dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:04.333084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:04.344428 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-118a7d68-52a0-4837-9c49-ad5226bfd242 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1293 microversion: 2.1 time: 0.373394 Aug 25 12:37:04.374156 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 525/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:03 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1293 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:04.380193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e6f341e-d73a-4e95-a3ad-2cb863341e1f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e6f341e-d73a-4e95-a3ad-2cb863341e1f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Request method failure captured: Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action HTTP/1.1 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 34 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2yklbOw1qHVIiIH62nwlEyrAqP8kgRU261d479yDPrKFEMzByCbyBxmXvBaeAC31J9fhwbVvcSIY3AWVQJ7brlSWeBXy1iukpl5rfl1IMWtl_P0RzvUbNykoWzfK71ZbUIKrT-OcsukUvS-u_mAlKNwBreZiEAosK88ZK4NoXcgOY8 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:37:04.396016 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0184f259fa3e42a2996b750fdd8c80c6 Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: {"addFloatingIp": {"address": ""}} Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:37:04.398140 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0b57dd74-8a45-429f-b66d-7d773cb4779f', 'body': {'addFloatingIp': {'address': ''}}} Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '' Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:04.399125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:37:04.400858 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:37:04.402240 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 25 12:37:04.402240 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:04.403618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e6f341e-d73a-4e95-a3ad-2cb863341e1f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:04.407302 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e6f341e-d73a-4e95-a3ad-2cb863341e1f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 400 len: 142 microversion: 2.1 time: 0.029539 Aug 25 12:37:04.412824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 526/1109] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:04 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:37:04.425476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:04.426132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:04.437238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.438630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.439120 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc14af8c-709f-4aac-a139-da986cac6a4d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.133217 Aug 25 12:37:04.439777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.440785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.441505 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 584/1110] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:04 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:04.442381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.442837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.451701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40", "name": "network-vif-plugged", "status": "completed", "tag": "aa4604e8-be88-47e2-9f18-f3997e8d5940"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:04.473170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.475196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.476785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.504576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] Creating event network-vif-plugged:aa4604e8-be88-47e2-9f18-f3997e8d5940 for instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 on n-h2-850468-18 Aug 25 12:37:04.516136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6a5672fe-74a0-40d5-a055-0efbdf248b18 req-6b98d52a-0c57-46a3-afd0-dbaf0b92fb66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070727 Aug 25 12:37:04.518097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 585/1111] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:04.529160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:04.537690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.538895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.539752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.541269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.542126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.543263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.601826 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de70c5d9-c162-4ec8-ad03-690a6f3a661f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.080027 Aug 25 12:37:04.604033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 586/1112] 10.222.0.60 () {60 vars in 1217 bytes} [Thu Aug 25 12:37:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:37:04.618000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:04.636278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:04.661218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.662213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.662719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.663772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:04.668197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:04.668972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:04.791158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:04.809764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 12:37:04.810941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquired lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 12:37:05.042189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:05.071313 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98a55f5d-44e1-4dd9-984b-35fd7142275f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1317 microversion: 2.1 time: 0.652252 Aug 25 12:37:05.078495 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 527/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:04 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:05.088961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:05.091815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:05.104901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.106118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.107332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.110596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.111363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Releasing lock "refresh_cache-0b57dd74-8a45-429f-b66d-7d773cb4779f" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 12:37:05.112564 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] HTTP exception thrown: floating IP not found Aug 25 12:37:05.112782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.113946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Request method failure captured: Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action HTTP/1.1 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 41 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2yklbOw1qHVIiIH62nwlEyrAqP8kgRU261d479yDPrKFEMzByCbyBxmXvBaeAC31J9fhwbVvcSIY3AWVQJ7brlSWeBXy1iukpl5rfl1IMWtl_P0RzvUbNykoWzfK71ZbUIKrT-OcsukUvS-u_mAlKNwBreZiEAosK88ZK4NoXcgOY8 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:37:05.121230 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0184f259fa3e42a2996b750fdd8c80c6 Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:37:05.123909 n-d-850468-18 devstack@n-api.service[122701]: exception: floating IP not found Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b57dd74-8a45-429f-b66d-7d773cb4779f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:05.126127 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 25 12:37:05.130258 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.138409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Returning 404 to user: floating IP not found {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:05.138409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c2cb16d-dbe8-409a-90b0-2da636eef5d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 404 len: 67 microversion: 2.1 time: 0.517619 Aug 25 12:37:05.138409 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 587/1114] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:04 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 67 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:37:05.140272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f768c272-274f-41ca-a85e-52f4cba3560d", "name": "network-vif-deleted", "tag": "05bb4f0e-5f16-41db-b3a9-649d3e563cff"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:05.199295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:37:05.222889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.223744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.231364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.262317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] Creating event network-vif-deleted:05bb4f0e-5f16-41db-b3a9-649d3e563cff for instance f768c272-274f-41ca-a85e-52f4cba3560d on n-h1-850468-18 Aug 25 12:37:05.283317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f2439fbc-848c-4268-ac02-43fe66a2d3d5 req-c0390882-90e8-42f9-97f5-f940232e4ee8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152129 Aug 25 12:37:05.286185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 588/1115] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:05.314639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d6a89de-88b8-4434-b490-07a930e2e20f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:05.401344 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f2e7880-4672-4c30-a554-736213c1a82c tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 204 len: 0 microversion: 2.1 time: 0.320484 Aug 25 12:37:05.402260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 528/1116] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:37:05 2022] DELETE /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:37:05.414228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:05.418570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:05.434098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.434855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.435533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.437689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.439837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.440843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.460497 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9d6a89de-88b8-4434-b490-07a930e2e20f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d6a89de-88b8-4434-b490-07a930e2e20f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Request method failure captured: Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action HTTP/1.1 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 44 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2yklbOw1qHVIiIH62nwlEyrAqP8kgRU261d479yDPrKFEMzByCbyBxmXvBaeAC31J9fhwbVvcSIY3AWVQJ7brlSWeBXy1iukpl5rfl1IMWtl_P0RzvUbNykoWzfK71ZbUIKrT-OcsukUvS-u_mAlKNwBreZiEAosK88ZK4NoXcgOY8 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:37:05.464140 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0184f259fa3e42a2996b750fdd8c80c6 Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:37:05.465844 n-d-850468-18 devstack@n-api.service[122701]: exception: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b57dd74-8a45-429f-b66d-7d773cb4779f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:05.467288 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 25 12:37:05.469744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:05.472543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d6a89de-88b8-4434-b490-07a930e2e20f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:05.472543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d6a89de-88b8-4434-b490-07a930e2e20f tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action" status: 404 len: 88 microversion: 2.1 time: 0.179127 Aug 25 12:37:05.480285 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 589/1117] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:05 2022] POST /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f/action => generated 88 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:37:05.495181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:05.505134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:05.514369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:05.532803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.533590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.534530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.536064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.537375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.538338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.774220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:05.806650 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c399c0c-89da-42e3-b45a-d8648d9a8f22 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1293 microversion: 2.1 time: 0.324395 Aug 25 12:37:05.817421 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 590/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:05 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1293 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:05.835122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:05.839697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:05.861151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.862553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.863829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.865537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:05.866765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:05.867796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:05.890871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:05.927155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8be3cbb-e156-4e9d-8f16-aa17af0a995f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.519913 Aug 25 12:37:05.933697 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 529/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:05 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:05.962474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d73020b-ea13-4b29-9e34-36dbace6968c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c29aa790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.080825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:06.092836 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-daef61f9-6251-4c1d-99fb-8dbe1183cbfe tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1514 microversion: 2.1 time: 0.273742 Aug 25 12:37:06.095292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 591/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:05 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:06.102107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.102949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:06.126702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.127220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.127736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.129526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.130091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.130718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.142344 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d73020b-ea13-4b29-9e34-36dbace6968c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.204178 Aug 25 12:37:06.144794 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 530/1121] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:05 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:06.153502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.154173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:06.174954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.175859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.176598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.177575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.180174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.180863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.215241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:37:06.418660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:06.442556 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4e73fe8-3f1a-46a2-813d-7e7cffe44432 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1317 microversion: 2.1 time: 0.296648 Aug 25 12:37:06.443631 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 531/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:06 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:06.556667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbac45bc-3c6e-462b-8a42-5c2a08124143", "name": "network-vif-plugged", "status": "completed", "tag": "eacacf3e-0733-47d9-aa83-30888618a4be"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:06.556854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac85163a-b64a-49fc-8b8e-f2989e198775 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 204 len: 0 microversion: 2.1 time: 0.448091 Aug 25 12:37:06.556854 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 592/1123] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:37:06 2022] DELETE /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:37:06.568880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.568880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:06.580083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.580629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.581077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.589971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.591046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.594313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.596350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.597817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.598795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.610695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] Creating event network-vif-plugged:eacacf3e-0733-47d9-aa83-30888618a4be for instance dbac45bc-3c6e-462b-8a42-5c2a08124143 on n-h1-850468-18 Aug 25 12:37:06.616373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0d9fd09d-7b8c-4545-86e1-e8b4c9997c2e req-ca035c6b-27d2-47f7-8ae7-b063162657e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076342 Aug 25 12:37:06.617591 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 532/1124] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:06.841441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.842167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:06.856658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.857977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.860273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.862526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.864316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.865411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.893745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:06.904210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31c664d1-e81d-4e25-a84b-9eefebd5b381 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1541 microversion: 2.1 time: 0.350352 Aug 25 12:37:06.906380 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 593/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:06 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1541 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:06.976691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:06.978607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:06.992273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.993853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.995139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:06.996613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:06.997466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:06.998476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.005793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:07.020424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c5edcd2-bb3c-4ea2-a3bd-d33d07d590aa tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1293 microversion: 2.1 time: 0.183517 Aug 25 12:37:07.021117 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 533/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:06 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:07.144914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:07.145871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:07.167590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.172080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.173463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.185608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.190424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.191471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.481182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:07.508836 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-826b09f9-5248-4c4b-8bd3-ad9821b9ab86 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 0.544352 Aug 25 12:37:07.514124 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 594/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:06 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:07.529845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a356ee75-afaa-4d05-98d5-5ec07816665f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c29baca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:07.674385 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a356ee75-afaa-4d05-98d5-5ec07816665f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.157264 Aug 25 12:37:07.694659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 595/1128] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:07 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:07.704072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:07.705611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:07.717704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.719762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.720053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.721542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.722774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.723851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.730524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:07.751468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f17923f7-416b-40d3-8182-1ec81de6e364 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1514 microversion: 2.1 time: 0.618226 Aug 25 12:37:07.768917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 534/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:07 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1514 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:07.791424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8099ecd-0cc7-46da-9f04-153c24925213", "device": "/dev/xvdb"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:07.798493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:07.810588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.811541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.814198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:07.816302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:07.817831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:07.818938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.050117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:08.099398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:08.111120 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83693e47-1cd4-493e-853a-f59eadec1f92 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1467 microversion: 2.1 time: 0.414359 Aug 25 12:37:08.125501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 596/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:07 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1467 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:08.152449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:08.157595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:08.169011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.169590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.170080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.170859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.172253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.173036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.621639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:08.657787 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80e2cd1a-521b-4e70-a37c-b1bdaaba53d2 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1541 microversion: 2.1 time: 0.516596 Aug 25 12:37:08.674212 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 597/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:08 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1541 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:08.687163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:08.688605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:08.707108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.707610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.708055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.708819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.711449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.712191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.773450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.774506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.775418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.776517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lazy-loading 'fault' on Instance uuid f768c272-274f-41ca-a85e-52f4cba3560d {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:37:08.889501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:08.915094 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81a961cb-d426-4554-8ba6-560f1dafa6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 200 len: 1304 microversion: 2.1 time: 0.236977 Aug 25 12:37:08.916941 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 598/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:08 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 1304 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:08.933513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:08.935135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:08.986112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.988478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.989766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:08.991393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:08.992577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:08.993920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:09.291436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8862f790-34f6-4e24-929b-fc5023fd6b4c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.518955 Aug 25 12:37:09.293594 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 535/1133] 10.222.0.60 () {62 vars in 1364 bytes} [Thu Aug 25 12:37:07 2022] POST /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments => generated 194 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:37:09.313116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:09.317301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:09.337262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:09.338735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:09.340078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:09.342131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:09.343852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:09.345674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.113754 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c2d8815-423b-4ece-8a2e-041b34469a85 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1620 microversion: 2.1 time: 1.190701 Aug 25 12:37:10.119576 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 599/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:08 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1620 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:10.136704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ff33fc7-9ccd-4281-aaf8-8c7e1ddb975d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27cb040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:10.257278 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ff33fc7-9ccd-4281-aaf8-8c7e1ddb975d tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.132958 Aug 25 12:37:10.259912 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 600/1135] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:10 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:10.292936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:10.297949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:10.335875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.340416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.341803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.345927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.347943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.353355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.632043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:10.633813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:10.658512 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1149d9c-0464-4999-b3fc-1668c4fb4409 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1311 microversion: 2.1 time: 1.357637 Aug 25 12:37:10.661628 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 536/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:09 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1311 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:10.674782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48678768-f2c7-4a97-b604-acdbc4168282 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 200 len: 1472 microversion: 2.1 time: 0.397180 Aug 25 12:37:10.681189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:10.683090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:10.692345 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 601/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:10 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:10.703809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.706070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.707651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.707997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:10.709228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:10.713107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.714434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.715640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.737183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.737838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.738299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.739102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.739644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.746952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.789144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d HTTP/1.1 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:37:10.801694 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:37:10.804782 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'f768c272-274f-41ca-a85e-52f4cba3560d'} Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:10.806453 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:37:10.809510 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:10.812484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:10.814368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b18ddcae-0e67-4cc1-a6a5-1528cc29bcbb tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 404 len: 111 microversion: 2.1 time: 0.120110 Aug 25 12:37:10.815264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 602/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:10 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:37:10.825613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f3caea-4329-40a3-be65-39fc5b7af77e", "name": "network-vif-deleted", "tag": "7151dec8-c3c6-459c-83f3-2ac23acaadca"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:10.845429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.846810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.847770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.892930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] Creating event network-vif-deleted:7151dec8-c3c6-459c-83f3-2ac23acaadca for instance e4f3caea-4329-40a3-be65-39fc5b7af77e on n-h2-850468-18 Aug 25 12:37:10.903629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b3e3d1a6-aaba-4d9f-abd5-e6056dbdfb74 req-fd414a48-c4d8-4f53-b674-2ef66043c1e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086153 Aug 25 12:37:10.907095 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 603/1139] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:10.919045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be789428-d425-4afe-bdca-ebcc51da83db", "name": "network-vif-plugged", "status": "completed", "tag": "14a4cd41-32a2-43f1-9e93-978a3976f975"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:10.945477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:10.961444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:10.962214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:10.996570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] Creating event network-vif-plugged:14a4cd41-32a2-43f1-9e93-978a3976f975 for instance be789428-d425-4afe-bdca-ebcc51da83db on n-h1-850468-18 Aug 25 12:37:11.021891 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c77fd792-16bb-4f3f-970f-43a837bf97ec req-4f5d8c6d-c16d-44d7-97af-0fe7e8647350 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110999 Aug 25 12:37:11.034006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 604/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:11.053566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-878876917", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5a61c5bb-e595-4272-a2db-69cd3886a0c4"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:11.182074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:37:11.644703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0184f259fa3e42a2996b750fdd8c80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af80caa01e4486cb093ae485e5bcaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:11.667326 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8af4bfe-3d35-420c-9b56-53ac06a0f8a8 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 200 len: 1541 microversion: 2.1 time: 1.003326 Aug 25 12:37:11.691118 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 537/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:10 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 1541 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:11.691118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-925073734", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:11.857334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:37:12.689405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:37:12.690369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:37:12.691436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:37:12.696520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:37:12.697822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:37:12.747055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:12.747875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:12.749141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:12.751512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:12.752474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:12.753574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:12.828477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:37:12.843917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Getting quotas for user a4947593590940578ee293587f0cac3d and project 9887ac4ba161489dbc983267f299f400. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:37:12.917527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:37:12.931584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:37:13.095363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb64d472-e280-4c8c-b752-006d5ad09515 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057040 Aug 25 12:37:13.097974 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 605/1142] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:37:13.111662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c540391-a118-4a27-8a64-5e4564f0637b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c270a310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:13.253962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c540391-a118-4a27-8a64-5e4564f0637b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.148777 Aug 25 12:37:13.253962 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 606/1143] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:13 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:13.267470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b57dd74-8a45-429f-b66d-7d773cb4779f", "name": "network-vif-deleted", "tag": "8f2a98b4-168f-4e68-8baf-41322e9d1477"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:13.330162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:13.331148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:13.332036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:13.365236 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] Creating event network-vif-deleted:8f2a98b4-168f-4e68-8baf-41322e9d1477 for instance 0b57dd74-8a45-429f-b66d-7d773cb4779f on n-h2-850468-18 Aug 25 12:37:13.378628 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-551f3887-611c-4673-b928-79e9673bbd4a req-da388210-3182-43b0-a751-2336e8525b0c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124203 Aug 25 12:37:13.380777 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 607/1144] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:13.393448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:13.395249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:13.412561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:13.414807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:13.415882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:13.419360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:13.420521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:13.423598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.358335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:14.380264 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85cd56b0-2bc4-45b3-9170-edea460a2187 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1494 microversion: 2.1 time: 0.993359 Aug 25 12:37:14.380264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 608/1145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:13 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1494 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:14.391418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:14.393493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: e4f3caea-4329-40a3-be65-39fc5b7af77e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:14.406488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.407851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.408973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.410447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.411622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.412943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.423162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:37:14.423162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:37:14.425187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:37:14.425449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:37:14.426372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:37:14.453402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.454183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.456364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] HTTP exception thrown: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Request method failure captured: Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e HTTP/1.1 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2whZYfSrTJseUu8ujqV3IVyf-z0xLBzc_OAe056ofIWxQI3EKFSgz7zmvFXWDqofPGDj1CPbqZ1_LgLdZZ31FhSxU70yOWBJR5C56KLEcShd8pl3_3lZicweAU-exzDppjbLc6lUVF_4vwrFyCzvOFQoAUJZnNfGXFr57KThj0d5vs Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9e653d2a13844d2d98c5d7cff5bf1ad2 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:37:14.459881 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9e653d2a13844d2d98c5d7cff5bf1ad2 Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesAdminNegativeTest-1055810059-project Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3c97779db8554723a2c447c5d0ed22d5 Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesAdminNegativeTest-1055810059-project Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. Aug 25 12:37:14.462938 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e4f3caea-4329-40a3-be65-39fc5b7af77e'} Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:14.470635 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. Aug 25 12:37:14.473567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.482784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Returning 404 to user: Instance e4f3caea-4329-40a3-be65-39fc5b7af77e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:14.482784 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d6a12902-131c-47af-b236-c94d6d18cca8 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e" status: 404 len: 111 microversion: 2.1 time: 0.083030 Aug 25 12:37:14.482784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 609/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:14 2022] GET /compute/v2.1/servers/e4f3caea-4329-40a3-be65-39fc5b7af77e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:37:14.482784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:14.482784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] [instance: 0b57dd74-8a45-429f-b66d-7d773cb4779f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:14.484497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.484497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.484497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.484497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.486284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.487159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.487947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.489312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.490420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.493850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.532217 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] HTTP exception thrown: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Request method failure captured: Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f HTTP/1.1 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2yklbOw1qHVIiIH62nwlEyrAqP8kgRU261d479yDPrKFEMzByCbyBxmXvBaeAC31J9fhwbVvcSIY3AWVQJ7brlSWeBXy1iukpl5rfl1IMWtl_P0RzvUbNykoWzfK71ZbUIKrT-OcsukUvS-u_mAlKNwBreZiEAosK88ZK4NoXcgOY8 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:37:14.534923 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5af80caa01e4486cb093ae485e5bcaaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5af80caa01e4486cb093ae485e5bcaaa Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0184f259fa3e42a2996b750fdd8c80c6 Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:37:14.537763 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b57dd74-8a45-429f-b66d-7d773cb4779f'} Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:14.540800 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. Aug 25 12:37:14.548979 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:37:14.554474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] Returning 404 to user: Instance 0b57dd74-8a45-429f-b66d-7d773cb4779f could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:14.554474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31c862ac-bdc0-46d9-a390-8fe768562b4c tempest-FloatingIPsAssociationNegativeTestJSON-1803436329 tempest-FloatingIPsAssociationNegativeTestJSON-1803436329-project] 10.222.0.60 "GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f" status: 404 len: 111 microversion: 2.1 time: 0.078586 Aug 25 12:37:14.557794 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 610/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:14 2022] GET /compute/v2.1/servers/0b57dd74-8a45-429f-b66d-7d773cb4779f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:37:14.568774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:14.570271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:14.574450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:37:14.594158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:37:14.595959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.602143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.603318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.604996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:14.606179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:14.612447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:14.654848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:37:14.663954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:37:14.720977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:14.875964 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3ae82b89-6e44-4fe6-96e1-f3806270e593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.194198 Aug 25 12:37:14.878347 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 538/1148] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:37:14.891824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33598157-2db5-49a2-a51b-883600192cfe tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2728700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:15.029203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:15.050176 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ecba0c3-25a0-4456-9935-b481176880dc tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1212 microversion: 2.1 time: 0.489970 Aug 25 12:37:15.082828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 611/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:14 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1212 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:15.107450 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33598157-2db5-49a2-a51b-883600192cfe tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.223485 Aug 25 12:37:15.140761 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 539/1150] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:14 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:15.170417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ae9c672-e01e-4823-b654-5ded99042ebe tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:15.191467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ae9c672-e01e-4823-b654-5ded99042ebe tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:15.573733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ae9c672-e01e-4823-b654-5ded99042ebe tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:15.602069 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ae9c672-e01e-4823-b654-5ded99042ebe tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1214 microversion: 2.1 time: 0.455483 Aug 25 12:37:15.603674 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 540/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:15 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1214 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:15.844293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:15.845696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:15.883229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:15.884280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:15.890654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:15.892606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:15.894631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:15.898472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.100674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:16.108891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:16.162120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.170177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.173687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.194698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.201324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.202232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.449111 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62262d68-f35c-4c09-958b-7fa2294332c7 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1647 microversion: 2.1 time: 1.363896 Aug 25 12:37:16.486630 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 612/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:15 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1647 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:16.510332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ed642a42-8c3a-4691-ada2-2e374cd30630 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c28e6820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:16.650468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:16.675958 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a3a896b-01fa-4a76-b109-79e85a37e3df tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1286 microversion: 2.1 time: 0.587827 Aug 25 12:37:16.683804 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 541/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:16 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1286 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:16.698477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:16.699920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:16.726366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.730361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.731299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.734347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.739142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.741729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.767448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ed642a42-8c3a-4691-ada2-2e374cd30630 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.277939 Aug 25 12:37:16.782471 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 613/1154] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:16 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:16.809816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:16.813620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:16.828569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.830125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.831383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:16.835446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:16.837181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:16.838603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:17.107196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:17.135373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa825be9-0e31-485c-b3fd-9c400048a19d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1210 microversion: 2.1 time: 0.350855 Aug 25 12:37:17.146182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 614/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:16 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1210 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:17.630206 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aedf418b-7b38-4420-96ac-da9e837af386 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1647 microversion: 2.1 time: 0.943663 Aug 25 12:37:17.636303 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 542/1156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:16 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1647 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:17.680183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:17.728566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:17.730131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:17.731459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:17.732077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:17.732440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:17.733701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:17.734572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:17.735366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:17.783933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:17.783933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:17.788541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:17.791402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:17.791402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:17.792257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:17.969298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0e22bc9-f99f-4410-bdb9-e9863dc5cf97 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.294226 Aug 25 12:37:17.990006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 615/1157] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:37:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:18.009978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-337bd030-f823-4ffc-af95-321e213130ca tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c28e6e50>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:18.162601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-337bd030-f823-4ffc-af95-321e213130ca tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.163725 Aug 25 12:37:18.176900 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 616/1158] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:17 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:18.194521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-18", "block_migration": true, "disk_over_commit": false}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:18.202876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:18.217044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:18.218354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:18.219709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:18.221315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:18.222449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:18.223188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:18.298943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lazy-loading 'flavor' on Instance uuid dbac45bc-3c6e-462b-8a42-5c2a08124143 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:37:18.333760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Going to try to live migrate instance to n-h2-850468-18 {{(pid=122701) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:37:18.473301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:18.498407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cfda176d-1b65-46d3-a20f-1b5be62b12c0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1274 microversion: 2.1 time: 0.787241 Aug 25 12:37:18.509519 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 543/1159] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:17 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1274 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:18.529265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:18.531513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:18.542046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:18.545764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:18.547251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:18.548253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:18.555803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:18.556569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:19.976283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:20.024761 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5ec013be-6146-4b03-86e6-2ada999ee99f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1272 microversion: 2.1 time: 1.513068 Aug 25 12:37:20.039423 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 544/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:18 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1272 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:20.089423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d27f4da5-cc44-4c01-96d3-bdf0db57c353 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27678b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:20.393875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d27f4da5-cc44-4c01-96d3-bdf0db57c353 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.320733 Aug 25 12:37:20.394999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 545/1161] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:20 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:20.438672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:20.444296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:20.508086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:20.509039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:20.522130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:20.525289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:20.530181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:20.538930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:21.789895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:21.818133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3629e237-b2ea-47d0-98e7-01f4e3b6b0c8 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.421219 Aug 25 12:37:21.851924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 546/1162] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:20 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:21.903290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:21.916613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:21.943081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:21.947700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:21.948711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:21.950465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:21.954208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:21.955189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:22.584186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:22.613106 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f32153c2-469c-4b5e-8fc5-abf2918d736b tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1272 microversion: 2.1 time: 0.744312 Aug 25 12:37:22.619999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 547/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:21 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1272 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:22.663489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc8c0d27-8c62-4644-9bc7-231db6ea5c4f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26f23a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:22.893749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:22.981936 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc8c0d27-8c62-4644-9bc7-231db6ea5c4f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.358053 Aug 25 12:37:22.991135 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 548/1164] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:22 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:23.035371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:23.045100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:23.084480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:23.093239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:23.094861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:23.096583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:23.100567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:23.103042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:23.207489 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73213dd1-b6c8-4363-96cf-bce1a965465f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143/action" status: 202 len: 0 microversion: 2.1 time: 5.028125 Aug 25 12:37:23.209470 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 617/1165] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:18 2022] POST /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143/action => generated 0 bytes in 5032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:37:23.240730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:23.242397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:23.284043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:23.286187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:23.292426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:23.294097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:23.302631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:23.304902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:24.539296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:25.169442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:25.203004 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd4218fd-4531-4e8e-8cef-05dbc1d7c576 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 1.985923 Aug 25 12:37:25.232382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 618/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:23 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:25.262618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:25.264019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:25.282515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:25.285661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:25.296459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:25.299399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:25.300615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:25.301699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:25.518497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:25.555004 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71e47d44-d345-4a84-959c-0e3acd2bcad5 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 2.537512 Aug 25 12:37:25.587434 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 549/1167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:23 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:25.598638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-baef5ad2-b018-4b76-970c-0c55b57941f0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c730d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:25.639513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:25.752134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:25.769316 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-baef5ad2-b018-4b76-970c-0c55b57941f0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.177140 Aug 25 12:37:25.777643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b09c8a08-1d04-458d-83c3-146d8913241f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1272 microversion: 2.1 time: 0.540698 Aug 25 12:37:25.789522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 550/1168] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:25 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:25.791142 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 619/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:25 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1272 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:26.257455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:26.258609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:26.280918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:26.281759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:26.282403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:26.283352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:26.286537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:26.287251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:26.596018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:26.597295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:26.622963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:26.623763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:26.637439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:26.638651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:26.639519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:26.641183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:27.589095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:27.606830 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab0ca98a-aec9-44d4-90d2-5a9f86f2cf4d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 1.354381 Aug 25 12:37:27.628935 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 551/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:26 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:37:27.642647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f995a86c-5369-46ba-9937-0a766cb10f21 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2767a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:27.769121 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f995a86c-5369-46ba-9937-0a766cb10f21 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.138004 Aug 25 12:37:27.769726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 552/1171] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:27 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:27.795712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:27.797462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:27.819290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:27.833106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:27.836886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:27.841710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:27.843233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:27.844349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:27.845146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:28.107263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:28.122909 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18d9ee75-17b2-4214-9044-61461c2502f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.532179 Aug 25 12:37:28.149739 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 620/1172] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:26 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:28.656746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:28.658197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:28.693585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:28.706310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:28.712330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:28.713659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:28.722379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:28.725074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:29.765302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:29.812435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d43218d4-25e2-4cea-b14d-4dca6f525282 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 2.035249 Aug 25 12:37:29.820106 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 553/1173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:27 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:29.830088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36180a6c-d5a9-464b-a93b-0f713298cac9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26ee280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:30.054135 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36180a6c-d5a9-464b-a93b-0f713298cac9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.231854 Aug 25 12:37:30.054799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 554/1174] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:29 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:30.088886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:30.090439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:30.098326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:30.123224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:30.126244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:30.127717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:30.132295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:30.134512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:30.136872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:30.754183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:30.773430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a559cb09-441c-4e71-91b4-62d1e53dc6cf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 2.131834 Aug 25 12:37:30.811428 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 621/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:28 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:30.825612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:30.829384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:30.852391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:30.859895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:30.865968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:30.867658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:30.868572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:30.869358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:30.990158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:37:31.277894 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-044c6852-f3ab-4d68-a6f7-28f9df43be4e tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 204 len: 0 microversion: 2.1 time: 0.460774 Aug 25 12:37:31.281865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 622/1176] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:37:30 2022] DELETE /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:37:31.309168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd88d48-fb7e-4596-88a2-8ad933f6344f", "tag": "93652efb-306b-40a2-8a6d-569c56c2fcd9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:31.340900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:31.341587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:31.342228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:31.381821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] Creating event network-changed:93652efb-306b-40a2-8a6d-569c56c2fcd9 for instance edd88d48-fb7e-4596-88a2-8ad933f6344f on n-h1-850468-18 Aug 25 12:37:31.399793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-abcf39dd-71a6-4fc4-a7ff-1ac908d11426 req-fd7f144d-2f41-4cd9-b233-9f34a9827a39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110643 Aug 25 12:37:31.401392 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 623/1177] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:31.417634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:31.419426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:31.446119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:31.446831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:31.447422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:31.448472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:31.449217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:31.450984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:32.048578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:32.078006 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad67d40d-23ad-4378-9f1a-6d71219d7c3f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 2.008319 Aug 25 12:37:32.080273 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 555/1178] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:30 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:32.094131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd0006d8-9859-42f0-8c92-99113f317b19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2728160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:32.320475 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd0006d8-9859-42f0-8c92-99113f317b19 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.237759 Aug 25 12:37:32.322790 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 556/1179] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:32 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:32.337229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:32.340016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:32.353903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:32.355142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:32.356203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:32.358045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:32.359399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:32.360449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:32.422966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:32.443110 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-415a267a-ab84-40e8-867d-1d62fbe217d2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 1.036209 Aug 25 12:37:32.446642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 624/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:31 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:32.456367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:32.457569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:32.476285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:32.477100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:32.477880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:32.479145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:32.479937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:32.480729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:34.525708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:34.551105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3db42e28-cb00-451b-8d54-44f1b53e713f tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1684 microversion: 2.1 time: 2.224571 Aug 25 12:37:34.559372 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 557/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:32 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1684 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:34.576521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbac45bc-3c6e-462b-8a42-5c2a08124143", "name": "network-vif-unplugged", "status": "completed", "tag": "eacacf3e-0733-47d9-aa83-30888618a4be"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:34.615912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:34.626614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:34.628065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:34.630904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:34.659388 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ea849c8-fd5b-4b23-ba7b-b2a818a95783 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 2.210666 Aug 25 12:37:34.662426 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 625/1182] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:32 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:34.680794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:34.697654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:34.701576 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] Creating event network-vif-unplugged:eacacf3e-0733-47d9-aa83-30888618a4be for instance dbac45bc-3c6e-462b-8a42-5c2a08124143 on n-h1-850468-18 Aug 25 12:37:34.719086 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f6aaca9a-62e4-41b1-bf66-94fbcb360199 req-f7ac45cb-7c42-4915-8d36-7f869c7ecf06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156382 Aug 25 12:37:34.724386 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 558/1183] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:34.750949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:34.755811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:34.760007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a732be0d-748b-4a08-8c69-f96b8048e2e4 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2c4ddc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:34.761589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:34.765715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:34.769567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:34.777338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:35.056214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a732be0d-748b-4a08-8c69-f96b8048e2e4 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.325386 Aug 25 12:37:35.060666 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 559/1184] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:34 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:35.080331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:35.084552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:35.114915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:35.116878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:35.118112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:35.122652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:35.129557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:35.132152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:36.001268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:36.029593 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a17e5d96-fe90-4320-a690-eda3010a1ec9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 0.963909 Aug 25 12:37:36.035343 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 560/1185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:35 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:36.090734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf", "tag": "fd666cc2-3889-4435-a03a-7383da18b0f5"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:36.123075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:36.129190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:36.130540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:36.174761 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] Creating event network-changed:fd666cc2-3889-4435-a03a-7383da18b0f5 for instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf on n-h2-850468-18 Aug 25 12:37:36.200088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-de71d98a-5a29-4750-9157-f1fd886f74cc req-d1c5e27e-3897-42ae-9ce5-c02e10dc193b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133002 Aug 25 12:37:36.203251 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 561/1186] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:36.224205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:36.226652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:36.252696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:36.258119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:36.259607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:36.263843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:36.268722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:36.275902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:36.291970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:36.527158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:36.565916 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6dbbb53-b090-4817-886f-04ad40c38070 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.899655 Aug 25 12:37:36.567324 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 626/1187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:34 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:36.577786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:36.587835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:36.594364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:36.618033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:36.628327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:36.629612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:36.633635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:36.637617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:36.639591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:37.662013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:37.678088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ca33b24-c74c-4a9f-9b70-8ca1e2d88885 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1684 microversion: 2.1 time: 1.471151 Aug 25 12:37:37.680909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 562/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:36 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1684 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:37.697800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3e47fac-cda7-4883-ba6d-c849c1503c7a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2912ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:37.851824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3e47fac-cda7-4883-ba6d-c849c1503c7a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.167797 Aug 25 12:37:37.853518 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 563/1189] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:37 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:37.864018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbac45bc-3c6e-462b-8a42-5c2a08124143", "tag": "eacacf3e-0733-47d9-aa83-30888618a4be"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:37.902498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:37.903853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:37.907436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:37.946051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] Creating event network-changed:eacacf3e-0733-47d9-aa83-30888618a4be for instance dbac45bc-3c6e-462b-8a42-5c2a08124143 on n-h1-850468-18 Aug 25 12:37:37.958288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c885b2cc-9654-47b5-87c1-20d9ea3c3bc5 req-b40760b5-cc29-4bd6-901f-753e9bf6decb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101930 Aug 25 12:37:37.960284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 564/1190] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:37.988777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:38.004008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:38.035352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:38.039192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:38.041446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:38.043558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:38.044996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:38.046828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:38.431984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:38.454634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:37:38.487891 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d38b8412-fea8-412a-9a1f-1b30274e1d19 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 1.917834 Aug 25 12:37:38.501841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 627/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:36 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:38.532736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:38.534514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:38.594577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:38.599036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:38.607272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:38.628348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:38.631366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:38.635154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:39.081032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:39.097061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22a1bfc3-8d17-4128-9811-b27fb11f6c73 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 1.129360 Aug 25 12:37:39.101778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 565/1192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:37 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:39.114465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:39.116234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:39.134668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:39.135775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:39.136160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:39.138305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:39.138827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:39.141999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:40.257678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:37:40.315362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:40.321290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b0dd6e1b-6636-4439-92d2-3d5a2013ec82 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 2426 microversion: 2.25 time: 1.217793 Aug 25 12:37:40.325562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 566/1193] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:37:39 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 2426 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:40.376144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:40.382207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:40.382486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d37d082b-96c8-43f7-a1fd-8c6b8345b672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.872221 Aug 25 12:37:40.386968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 628/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:38 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:40.422407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:40.423853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:40.425122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81151272-7bba-40d9-9961-482ea7050842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26b5a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:40.428014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:40.431731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:40.433207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:40.438562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:40.645875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81151272-7bba-40d9-9961-482ea7050842 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.256754 Aug 25 12:37:40.657395 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 629/1195] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:40 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:40.710145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:40.731047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:40.779262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:40.781518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:40.786564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:40.789828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:40.796038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:40.806353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:41.167144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c97779db8554723a2c447c5d0ed22d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e653d2a13844d2d98c5d7cff5bf1ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:41.222942 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dac8844d-b4aa-4c13-9ccb-a4fcdab1be51 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 200 len: 1616 microversion: 2.1 time: 0.865263 Aug 25 12:37:41.228707 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 567/1196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:40 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 1616 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:41.248653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:41.251009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:41.286186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:41.287287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:41.297138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:41.298615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:41.300188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:41.301112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:43.562862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:43.642519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bafd9984-08d2-4d18-810f-014f1c37780a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 2.978671 Aug 25 12:37:43.643878 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 630/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:40 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 2986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:43.716995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": "auto"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:43.730388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:43.763349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:43.765548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:43.771284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:43.773445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:43.774490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:43.787459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:43.948314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'flavor' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:37:44.012329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Going to try to live migrate instance to n-h1-850468-18 {{(pid=122701) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:37:44.471496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:44.524659 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a4b327b-536e-4aab-8556-610b12276484 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 3.293759 Aug 25 12:37:44.539360 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 568/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:41 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 3310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:44.585849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39376edc-4364-4b3a-978a-a842f801a619", "name": "network-vif-deleted", "tag": "cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:44.710572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:44.739469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:44.740769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:44.828587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] Creating event network-vif-deleted:cf1b1b9b-7df3-4a4a-a75b-cf671d8512e3 for instance 39376edc-4364-4b3a-978a-a842f801a619 on n-h2-850468-18 Aug 25 12:37:44.866952 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a876621b-9fea-45d5-a2ec-c26b57521345 req-89701d76-6484-4eae-a4b6-65834ffa9d6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319747 Aug 25 12:37:44.871151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 569/1199] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:44.893395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:44.897951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:44.924568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:44.925482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:44.926290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:44.931128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:44.932413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:44.933834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:45.986611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:46.047510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e4e6fe3-2bf1-4b06-b001-358324393818 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.169104 Aug 25 12:37:46.048620 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 570/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:44 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:46.079269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc41dcde-d84e-4a7a-9cd0-56ea9ac58031 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26bb4c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:46.257447 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc41dcde-d84e-4a7a-9cd0-56ea9ac58031 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.191199 Aug 25 12:37:46.259488 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 571/1201] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:46 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:46.290653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:46.293252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] [instance: 39376edc-4364-4b3a-978a-a842f801a619] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:46.323764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:46.323764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:46.323764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:46.340972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:46.341471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:46.341929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:46.397345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] HTTP exception thrown: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Request method failure captured: Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 HTTP/1.1 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2whZYfSrTJseUu8ujqV3IVyf-z0xLBzc_OAe056ofIWxQI3EKFSgz7zmvFXWDqofPGDj1CPbqZ1_LgLdZZ31FhSxU70yOWBJR5C56KLEcShd8pl3_3lZicweAU-exzDppjbLc6lUVF_4vwrFyCzvOFQoAUJZnNfGXFr57KThj0d5vs Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9e653d2a13844d2d98c5d7cff5bf1ad2 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:37:46.409026 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9e653d2a13844d2d98c5d7cff5bf1ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9e653d2a13844d2d98c5d7cff5bf1ad2 Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1055810059 Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesAdminNegativeTest-1055810059-project Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3c97779db8554723a2c447c5d0ed22d5 Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesAdminNegativeTest-1055810059-project Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. Aug 25 12:37:46.412223 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '39376edc-4364-4b3a-978a-a842f801a619'} Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:37:46.413933 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. Aug 25 12:37:46.417710 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:37:46.422731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Returning 404 to user: Instance 39376edc-4364-4b3a-978a-a842f801a619 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:37:46.430049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d0b7c49-4c00-4e5e-bddd-91af0879ca89 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619" status: 404 len: 111 microversion: 2.1 time: 0.164671 Aug 25 12:37:46.433711 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 572/1202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:46 2022] GET /compute/v2.1/servers/39376edc-4364-4b3a-978a-a842f801a619 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:37:47.358996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6da4ea69-1b4b-443d-9816-89f98eb11119 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/action" status: 202 len: 0 microversion: 2.25 time: 3.699132 Aug 25 12:37:47.359988 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 631/1203] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:37:43 2022] POST /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/action => generated 0 bytes in 3716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:37:47.389131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:47.392474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:47.429101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:47.433718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:47.438496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:47.442582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:47.447192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:47.447915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:47.567380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4efde8ac-f2c2-4962-ba57-35629391d030 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Action: 'create', calling method: .version_select at 0x7fc6c267da60>, body: {"pool": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:48.334203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:48.361767 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b01f48fc-96ac-4731-8a2b-a5348f1a956f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 0.985333 Aug 25 12:37:48.362526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 632/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:47 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:48.391364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:48.392397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:48.400996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:48.402109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:48.402897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:48.404047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:48.404737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:48.406476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:49.123766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:49.143293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f458c5f4-46a5-4976-ae14-7786ca8b0e6e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 0.759410 Aug 25 12:37:49.157484 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 633/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:48 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:49.178334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bcfb889-769c-4f33-9b1e-82cab598c292 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] Calling method '.version_select at 0x7fc6c265e820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:49.230467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bcfb889-769c-4f33-9b1e-82cab598c292 tempest-VolumesAdminNegativeTest-1055810059 tempest-VolumesAdminNegativeTest-1055810059-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837291591" status: 202 len: 0 microversion: 2.1 time: 0.071195 Aug 25 12:37:49.231526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 634/1206] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837291591 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:37:49.240364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:49.241489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:49.262009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:49.262692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:49.263477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:49.265256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:49.268293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:49.272609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:50.648966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:50.704321 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8f166f9-448f-4bc6-880d-61eb1b47f9f7 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 1.470885 Aug 25 12:37:50.710196 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 635/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:49 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:50.737004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-481c39ff-285b-4f30-b999-af63e6146c63 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c265eb80>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:50.876200 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-481c39ff-285b-4f30-b999-af63e6146c63 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.161175 Aug 25 12:37:50.880709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 636/1208] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:50 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:50.891423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:50.898850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:50.931664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:50.935122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:50.937558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:50.940789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:50.942049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:50.948380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:52.371602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:52.462731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:52.481910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:52.484079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb8ffa93-da60-474b-841d-f0375bf3b499 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.600775 Aug 25 12:37:52.500702 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 637/1209] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:37:50 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:52.511950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf", "name": "network-vif-plugged", "status": "completed", "tag": "fd666cc2-3889-4435-a03a-7383da18b0f5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:52.531636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:52.532595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:52.540951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:52.595063 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] Creating event network-vif-plugged:fd666cc2-3889-4435-a03a-7383da18b0f5 for instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf on n-h2-850468-18 Aug 25 12:37:52.602436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9b6a2d05-a958-4a26-90eb-44e7c4fc311a req-9724c5f9-5b8a-46cc-bef1-b831611b6ecf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099148 Aug 25 12:37:52.604179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 638/1210] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:52.637714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:52.638586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:52.664681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:52.665484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:52.666286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:52.667437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:52.669928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:52.671714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:54.109102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:54.137739 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6cfdb20-6890-403c-b5a9-0cd365a355eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1504 microversion: 2.1 time: 1.532175 Aug 25 12:37:54.144229 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 639/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:52 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1504 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:54.184925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:54.193121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:54.222684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:54.232869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:54.235097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:54.235906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:54.236440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:54.236886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:55.644777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:55.661459 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f189d51-d03d-493b-98fc-e73f865ea35f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1314 microversion: 2.1 time: 1.502450 Aug 25 12:37:55.664017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 640/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:54 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1314 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:55.681293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:55.682644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:55.700243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:55.701110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:55.701571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:55.705311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:55.705816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:55.706266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.150468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4efde8ac-f2c2-4962-ba57-35629391d030 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.714303 Aug 25 12:37:56.152917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 573/1213] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:37:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:56.163980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-097cc4ac-3d2b-4440-864c-66368d6a7a2c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c267d820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:56.272103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:56.282490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-097cc4ac-3d2b-4440-864c-66368d6a7a2c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1412 microversion: 2.1 time: 0.127839 Aug 25 12:37:56.284380 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 574/1214] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:56 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:56.292794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:56.293553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a9914ab-7c37-497e-b211-7298a3a33ae0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 0.623805 Aug 25 12:37:56.294437 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 641/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:55 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:56.294861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:56.300326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd88d48-fb7e-4596-88a2-8ad933f6344f", "name": "network-vif-plugged", "status": "completed", "tag": "93652efb-306b-40a2-8a6d-569c56c2fcd9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:56.304708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:56.305980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:56.306928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.309092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:56.309884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:56.310531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.322613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:56.333954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:56.334731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.377342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] Creating event network-vif-plugged:93652efb-306b-40a2-8a6d-569c56c2fcd9 for instance edd88d48-fb7e-4596-88a2-8ad933f6344f on n-h1-850468-18 Aug 25 12:37:56.398413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-29a1a6f1-add0-42af-94af-f53edebf4f1a req-d3a74d30-4a7b-43b5-8db2-b85d30219b2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101032 Aug 25 12:37:56.399884 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 642/1216] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:56.417869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:56.419087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:56.435753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:56.441197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:56.442572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.445222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:56.446088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:56.448675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:56.602437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:56.627483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:56.630123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:56.638174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-473b249d-32c5-4ca1-b9ca-7c4f1df42071 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 0.352040 Aug 25 12:37:56.639924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 575/1217] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:37:56 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:56.688606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1187f23-1e7c-4f2b-b2ae-f01c14cfa148 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c26f21f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.219959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:57.250268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2e6c93f-2ab3-4bf9-ac5b-349417b867b6 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1494 microversion: 2.1 time: 0.845224 Aug 25 12:37:57.284371 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 643/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:56 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1494 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:57.302281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.306381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:57.347362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:57.348569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:57.349523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:57.354016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:57.361064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:57.362313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:57.384824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1187f23-1e7c-4f2b-b2ae-f01c14cfa148 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/cf1a73a9-f62c-4afa-85b4-9e55cca450cb" status: 200 len: 142 microversion: 2.1 time: 0.729824 Aug 25 12:37:57.388703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 576/1219] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:37:56 2022] GET /compute/v2.1/os-floating-ips/cf1a73a9-f62c-4afa-85b4-9e55cca450cb => generated 142 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:57.396094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cb826f1-3f98-478d-840b-8561acf70cfa tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c3104af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.479254 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cb826f1-3f98-478d-840b-8561acf70cfa tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1421 microversion: 2.1 time: 0.086877 Aug 25 12:37:57.491086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 577/1220] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:57.497736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b6756ca-c76a-493c-9857-2b6f3ecdef4f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '.version_select at 0x7fc6c26bbdc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.508095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b6756ca-c76a-493c-9857-2b6f3ecdef4f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:57.509030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b6756ca-c76a-493c-9857-2b6f3ecdef4f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:57.509743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b6756ca-c76a-493c-9857-2b6f3ecdef4f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:57.549982 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b6756ca-c76a-493c-9857-2b6f3ecdef4f tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.056545 Aug 25 12:37:57.562866 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 578/1221] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:57.568484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.571975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:57.583482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:57.584618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:57.585419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:57.586377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:57.587025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:57.587627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:57.755989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:57.766997 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-562c961b-dc1e-48a3-9f32-faa3ddfff723 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1501 microversion: 2.1 time: 0.479027 Aug 25 12:37:57.768704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 644/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1501 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:57.775028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d32ea12-a30e-455a-a802-746146a5b61a tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c26071f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:57.911027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:57.929851 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3ed5c3c-30da-4c6c-b9c0-d4d408797ade tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1316 microversion: 2.1 time: 0.365011 Aug 25 12:37:57.931969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 579/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:57.947300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84522445-e096-4327-aa66-6f2e2a342728 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27280d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:58.051354 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84522445-e096-4327-aa66-6f2e2a342728 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 200 len: 1421 microversion: 2.1 time: 0.117073 Aug 25 12:37:58.053742 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 580/1224] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:58.065759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:58.067544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:58.082625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.084571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.086395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.088725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.103229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.109181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.211041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d32ea12-a30e-455a-a802-746146a5b61a tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.440285 Aug 25 12:37:58.225384 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 645/1225] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:37:57 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:37:58.251338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:58.255697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:58.283195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.284060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.293813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.295283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.300481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.301889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.698613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a871cb25-744f-429f-a90e-734cc648abd8 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1647 microversion: 2.1 time: 0.641379 Aug 25 12:37:58.714288 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 581/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:58 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1647 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:37:58.721833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:37:58.742059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:37:58.747372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.748208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.750020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.751207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:37:58.751988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:37:58.752747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:37:58.767417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:58.802458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:58.812706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:37:58.819121 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c3bfdca-bef3-43c6-8289-3d1e3797ed5c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 0.585001 Aug 25 12:37:58.825975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 646/1227] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:37:58 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:37:58.851275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c06e2c2e-3dfc-4168-9516-9659d63ec3e0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2671040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:37:59.055708 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52da4a2f-f716-4b1c-817e-a38a16bdcb3c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.338873 Aug 25 12:37:59.056840 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 582/1228] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:37:58 2022] POST /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:37:59.081484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8d4b4f3-a081-464a-aaf3-f11dbf9734a4 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c2703160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:00.222660 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c06e2c2e-3dfc-4168-9516-9659d63ec3e0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 204 len: 0 microversion: 2.1 time: 1.394373 Aug 25 12:38:00.225007 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 647/1229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:37:58 2022] DELETE /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 0 bytes in 1398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:00.241243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:00.245855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:00.271724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:00.278353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:00.280908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:00.283395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:00.287327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:00.291123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:01.203808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:01.211969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:01.254851 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcd48f7f-8568-42b5-baf4-0cb28404a94d tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1466 microversion: 2.1 time: 1.027669 Aug 25 12:38:01.265650 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 648/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:00 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1466 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:01.288514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-389056676", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1b190f40-d315-44fa-af57-e579f81ef520"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:01.543677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] validate_networks() for [('1b190f40-d315-44fa-af57-e579f81ef520', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:02.055460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8d4b4f3-a081-464a-aaf3-f11dbf9734a4 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/cf1a73a9-f62c-4afa-85b4-9e55cca450cb" status: 202 len: 0 microversion: 2.1 time: 2.996454 Aug 25 12:38:02.056534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 583/1231] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:37:59 2022] DELETE /compute/v2.1/os-floating-ips/cf1a73a9-f62c-4afa-85b4-9e55cca450cb => generated 0 bytes in 2999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:38:02.071955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:02.076297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:02.090398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:02.119779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:02.121244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:02.122329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:02.131254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:02.132549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:02.133630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:02.667191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:02.721636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95684e8f-12ce-4c88-b5f9-fbc612cf6ef6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1486 microversion: 2.1 time: 0.655097 Aug 25 12:38:02.729575 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 584/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:02 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1486 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:02.760500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:02.772020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:02.817958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:02.819538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:02.829233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:02.832411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:02.838707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:02.840359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:03.662654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:03.720147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:03.725619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:03.731063 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c3fb0f6b-d57f-410b-84ea-40ff1309108f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 0.997862 Aug 25 12:38:03.733295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 585/1233] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:02 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:03.786659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:03.787662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:03.789269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:03.790395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:03.790577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:03.791449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:03.792099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:03.816790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:03.819676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:03.820379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:03.821200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:03.821888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:03.823831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:03.824242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:03.828230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:03.832309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:03.833655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:03.838123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:03.839197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:03.912644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:03.932725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for user c6be50aac19c400cb9883fcf881ad13c and project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:03.958979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:04.000452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:04.003982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:04.081351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:04.106805 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb4eea70-249f-4167-a622-67d4d7bc3f85 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839033 Aug 25 12:38:04.107464 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 649/1234] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:04.120994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:04.123246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:04.145415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:04.146504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:04.147205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:04.148456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:04.149111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:04.153527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:04.253093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de2b37ce-7fb9-4261-ba01-e3e5f09047dc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 204 len: 0 microversion: 2.1 time: 0.488560 Aug 25 12:38:04.260158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 586/1235] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:03 2022] DELETE /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:04.299079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-489fe894-50c3-4f6e-b3e2-96c6f871a2bc tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Action: 'create', calling method: .version_select at 0x7fc6c26eea60>, body: {"pool": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:05.773541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c831c5d8-f834-4cb8-8519-eb821a33f492 tempest-ServersOnMultiNodesTest-171395714 tempest-ServersOnMultiNodesTest-171395714-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 200 len: 1619 microversion: 2.1 time: 1.663481 Aug 25 12:38:05.782031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 650/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:04 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 1619 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:05.792876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be789428-d425-4afe-bdca-ebcc51da83db", "name": "network-vif-unplugged", "status": "completed", "tag": "14a4cd41-32a2-43f1-9e93-978a3976f975"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:05.818128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:05.819015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:05.819651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:05.857223 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] Creating event network-vif-unplugged:14a4cd41-32a2-43f1-9e93-978a3976f975 for instance be789428-d425-4afe-bdca-ebcc51da83db on n-h1-850468-18 Aug 25 12:38:05.868399 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7860c10b-43ac-497c-a9ce-2a27a0edada2 req-38b4d70d-60c0-464d-bd43-94319bd63049 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084071 Aug 25 12:38:05.870769 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 651/1237] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:05.884861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:05.886120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:05.904285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:05.905076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:05.905639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:05.906575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:05.907300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:05.907745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:05.946761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:06.195930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6132b5b6-05c0-4bea-8f07-6ac549f468c9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 204 len: 0 microversion: 2.1 time: 0.322235 Aug 25 12:38:06.196971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 652/1238] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:05 2022] DELETE /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:06.207609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:06.209511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:06.223868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:06.225553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:06.227034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:06.229026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:06.230094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:06.230928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:06.468990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:06.480585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99cd159f-c9c0-4681-9554-438d13a92597 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1206 microversion: 2.1 time: 0.281712 Aug 25 12:38:06.493108 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 653/1239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:06 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1206 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:06.503697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-424368350", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:06.604619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] validate_networks() for [('c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:08.866553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:08.867657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:08.868102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:08.868881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:08.871539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:08.881128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:08.905767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:08.909103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:08.917616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:08.918631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:08.920947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:08.921728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:09.008336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:09.035116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for user 6121e19dc50b45ca979df57e9e0b48ea and project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:09.075414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:09.086756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:09.215448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84f20b73-f338-48f3-96fa-e01437ddd996 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719836 Aug 25 12:38:09.215978 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 654/1240] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:09.227777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:09.228680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:09.239123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:09.239640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:09.240100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:09.242222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:09.242943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:09.243400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:11.067198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:11.115169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:11.117497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:11.129407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7c058def-6614-4775-b8c8-65fc5a50e7e3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.906340 Aug 25 12:38:11.131473 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 655/1241] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:09 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:11.679547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5ee55ea-6058-451e-b543-71441eeed249 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Action: 'create', calling method: .version_select at 0x7fc6c2663b80>, body: {"pool": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:12.114631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-489fe894-50c3-4f6e-b3e2-96c6f871a2bc tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 7.851034 Aug 25 12:38:12.129512 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 587/1242] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:04 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 7869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:12.145485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:12.145485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:12.174015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:12.193220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:12.195607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:12.197471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:12.198698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:12.199860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:12.286027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:12.705174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e4f1770-ba29-48af-b848-9c9f1bafd672 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 204 len: 0 microversion: 2.1 time: 0.567663 Aug 25 12:38:12.708604 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 588/1243] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:12 2022] DELETE /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:12.731394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:12.739081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:12.806105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:12.810523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:12.824403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:12.830597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:12.844513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:12.846366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:13.242365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:13.268804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c65a2b55-b2f0-4004-a6f2-ec28475f67a1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 200 len: 1284 microversion: 2.1 time: 0.553343 Aug 25 12:38:13.277160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 589/1244] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:12 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 1284 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:13.293126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:13.296384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:13.310250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:13.312475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:13.316039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:13.318165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:13.319413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:13.323085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:13.624205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:13.659384 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a5309f20-8e95-49d3-9978-fd37d9929869 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1268 microversion: 2.1 time: 0.379391 Aug 25 12:38:13.663437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 590/1245] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:13 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1268 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:13.691554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be789428-d425-4afe-bdca-ebcc51da83db", "name": "network-vif-deleted", "tag": "14a4cd41-32a2-43f1-9e93-978a3976f975"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:13.730894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:13.731417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:13.741159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:13.798754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] Creating event network-vif-deleted:14a4cd41-32a2-43f1-9e93-978a3976f975 for instance be789428-d425-4afe-bdca-ebcc51da83db on n-h1-850468-18 Aug 25 12:38:13.816208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-66ad5a37-5357-40ab-9b5e-606e6b5f9ccb req-82ec0454-a565-4c02-b63b-5bce77ddf646 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146202 Aug 25 12:38:13.817965 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 591/1246] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:13.833043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:13.835983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:13.857131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:13.859876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:13.861929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:13.863608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:13.864810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:13.865909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:14.147758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:14.174402 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5975e93f-723b-4d06-9209-28faec2ce9ec tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1265 microversion: 2.1 time: 0.353621 Aug 25 12:38:14.190595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 592/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:13 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:14.225130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-49dc5e5e-41df-4e69-b5d7-aab27e692188 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c267daf0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:18.960969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:19.062085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:19.237783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:21.086221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:22.836384 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-49dc5e5e-41df-4e69-b5d7-aab27e692188 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948" status: 202 len: 0 microversion: 2.1 time: 8.644377 Aug 25 12:38:22.838862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 593/1248] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:38:14 2022] DELETE /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948 => generated 0 bytes in 8648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:38:22.854846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:22.859649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:22.921507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:22.923186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:22.925260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:22.930775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:22.931720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:22.932584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.237482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5ee55ea-6058-451e-b543-71441eeed249 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 12.100207 Aug 25 12:38:23.242105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 656/1249] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 12108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:23.623238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:23.625101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: edd88d48-fb7e-4596-88a2-8ad933f6344f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:23.641851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.642737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.643534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.644975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.646486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.647299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.678006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f HTTP/1.1 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:38:23.681220 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. Aug 25 12:38:23.684231 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'edd88d48-fb7e-4596-88a2-8ad933f6344f'} Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:23.693276 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. Aug 25 12:38:23.696295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.698908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance edd88d48-fb7e-4596-88a2-8ad933f6344f could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:23.698908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e602886d-dda8-4cf6-9640-4169009f1131 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f" status: 404 len: 111 microversion: 2.1 time: 0.440181 Aug 25 12:38:23.698908 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 657/1250] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:23 2022] GET /compute/v2.1/servers/edd88d48-fb7e-4596-88a2-8ad933f6344f => generated 111 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:23.698908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:23.698908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:23.710658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.711601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.712639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.714135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.714945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.716194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.746149 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf HTTP/1.1 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:38:23.750000 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:38:23.751866 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf'} Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:23.752837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:38:23.755409 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:38:23.758404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:23.758404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4fd33295-e0bc-462d-9fce-17703c591e49 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 404 len: 111 microversion: 2.1 time: 0.064938 Aug 25 12:38:23.758404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 658/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:23 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:23.767048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:23.769033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:23.789033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.790495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.791720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.794070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.797096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.797096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.838702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:23.867627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:23.871203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:23.898117 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-452ea38c-b7c2-4392-b5a3-2cbe06abccb2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.056739 Aug 25 12:38:23.913003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 594/1252] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:22 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:23.938812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:23.939950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:23.960061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.961247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.962053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:23.963540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:23.964665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:23.965500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:24.667105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:24.686976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:24.697010 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77cbea69-1ff3-4c3f-a0e8-7c0a6b71a29f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1307 microversion: 2.1 time: 0.781452 Aug 25 12:38:24.698367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 595/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:23 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1307 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:24.726041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e01f4a8a-f09c-47df-9114-e28ef8a4eb36 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1310 microversion: 2.1 time: 0.968468 Aug 25 12:38:24.729997 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 659/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:23 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1310 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:24.748976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf", "name": "network-vif-deleted", "tag": "fd666cc2-3889-4435-a03a-7383da18b0f5"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:24.753699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd88d48-fb7e-4596-88a2-8ad933f6344f", "name": "network-vif-unplugged", "status": "completed", "tag": "93652efb-306b-40a2-8a6d-569c56c2fcd9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:24.785206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:24.786161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:24.787352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:24.799871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:24.801232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:24.802241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:24.831055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] Creating event network-vif-deleted:fd666cc2-3889-4435-a03a-7383da18b0f5 for instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf on n-h2-850468-18 Aug 25 12:38:24.841285 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] Creating event network-vif-unplugged:93652efb-306b-40a2-8a6d-569c56c2fcd9 for instance edd88d48-fb7e-4596-88a2-8ad933f6344f on n-h1-850468-18 Aug 25 12:38:24.852474 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b5b70bf6-8636-440d-afe2-247173f1c0cf req-ff8df275-f9da-4c91-bcc0-897beb856e23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137495 Aug 25 12:38:24.858656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-28113d58-36db-412d-8d4d-29411aa0d646 req-9058a9b1-39eb-480b-b33e-54716fb107d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123333 Aug 25 12:38:24.859675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 596/1255] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:24.861543 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 660/1256] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:24.870131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c26f2280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:24.882567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9025aff-4d60-46c2-9f0a-f4adc60e39b3 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Action: 'create', calling method: .version_select at 0x7fc6c2620ee0>, body: {"pool": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:25.150774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c6543ea-9836-4140-a5f1-8be8076a5948 could not be found", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:38:25.153061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] HTTP exception thrown: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Request method failure captured: Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948 HTTP/1.1 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB20Yy7z1yVYzgRJf6f7Uci_kWAW7v8uvnBuO-1Lpt5SPo5ygAF5EhmEp2i99W2POrxrhwqRWS-0oHC6NVn4Hb6HI8Vk9mSrZ8GsGe4nzBORuaufr5Vx0Fpa7GD2f2BXNQmwv2nBvrWHOFQqN6ZF3pJ_zA65Vm0OjsMB7Kurdtmjumx0 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 45be77e3c4a744d39a24de6a8d4401b4 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:25.157388 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 45be77e3c4a744d39a24de6a8d4401b4 Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsTestJSON-1018290841-project Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a070f39a825c4632b21e3a3eea47b86a Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsTestJSON-1018290841-project Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: exception: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '3c6543ea-9836-4140-a5f1-8be8076a5948'} Aug 25 12:38:25.160408 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:38:25.162586 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c6543ea-9836-4140-a5f1-8be8076a5948 could not be found Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ed1edb5-d60c-49ee-b59b-29a9c9137c9e'] Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948. Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:25.165248 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:25.172369 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:25.175917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:25.175917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:25.175917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Returning 404 to user: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:25.175917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3fbd066-2fc9-483b-82ab-5d4711c40420 tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948" status: 404 len: 111 microversion: 2.1 time: 0.303303 Aug 25 12:38:25.175917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 597/1257] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:38:24 2022] GET /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948 => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:25.191575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:25.192370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:25.205470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:25.207307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:25.207658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:25.209420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:25.210464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:25.211393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:25.292302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:25.465147 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d67747f-25a4-4605-ab8f-51055f5754de tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 204 len: 0 microversion: 2.1 time: 0.291056 Aug 25 12:38:25.466520 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 598/1258] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:25 2022] DELETE /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:25.477156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-440218049", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:25.581502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:27.890742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:27.895755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:27.898753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:27.899945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:27.901127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:27.925954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:27.927875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:27.928669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:27.930211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:27.931395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:27.932781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:27.978881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:27.991070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:28.027789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:28.033557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:28.145967 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6b764e3-e4d0-4205-84ea-d2493a2ba5f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676237 Aug 25 12:38:28.149401 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 599/1259] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:28.161939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:28.162996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:28.178868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:28.178868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:28.179402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:28.180900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:28.183133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:28.184308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:28.854907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:28.879138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:28.881108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:28.882563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7900c2b8-1307-42ea-bbd2-3119ede000af tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 0.733902 Aug 25 12:38:28.883824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 600/1260] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:28 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:28.891110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Calling method '.version_select at 0x7fc6c265f1f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:29.035498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c6543ea-9836-4140-a5f1-8be8076a5948 could not be found", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:38:29.037350 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] HTTP exception thrown: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Request method failure captured: Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948 HTTP/1.1 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB20Yy7z1yVYzgRJf6f7Uci_kWAW7v8uvnBuO-1Lpt5SPo5ygAF5EhmEp2i99W2POrxrhwqRWS-0oHC6NVn4Hb6HI8Vk9mSrZ8GsGe4nzBORuaufr5Vx0Fpa7GD2f2BXNQmwv2nBvrWHOFQqN6ZF3pJ_zA65Vm0OjsMB7Kurdtmjumx0 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 45be77e3c4a744d39a24de6a8d4401b4 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:29.041906 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/45be77e3c4a744d39a24de6a8d4401b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 45be77e3c4a744d39a24de6a8d4401b4 Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1018290841 Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsTestJSON-1018290841-project Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a070f39a825c4632b21e3a3eea47b86a Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsTestJSON-1018290841-project Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: exception: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '3c6543ea-9836-4140-a5f1-8be8076a5948'} Aug 25 12:38:29.044874 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:38:29.048917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c6543ea-9836-4140-a5f1-8be8076a5948 could not be found Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11b933cb-8634-432e-8d8e-87c03a5bf8ac'] Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948. Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:29.065854 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:29.070312 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:29.074360 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 Aug 25 12:38:29.074360 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:29.074360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] Returning 404 to user: Floating IP not found for ID 3c6543ea-9836-4140-a5f1-8be8076a5948 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:29.074360 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b67e6346-b018-469f-8807-722651a373ca tempest-FloatingIPsTestJSON-1018290841 tempest-FloatingIPsTestJSON-1018290841-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948" status: 404 len: 111 microversion: 2.1 time: 0.169778 Aug 25 12:38:29.075565 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 601/1261] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:38:28 2022] DELETE /compute/v2.1/os-floating-ips/3c6543ea-9836-4140-a5f1-8be8076a5948 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:29.089036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5f4ea85-1c3e-4d42-8a9e-a6accbd4cc99 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26b5f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:29.197173 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5f4ea85-1c3e-4d42-8a9e-a6accbd4cc99 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca" status: 200 len: 660 microversion: 2.1 time: 0.117623 Aug 25 12:38:29.199285 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 602/1262] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:29 2022] GET /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca => generated 660 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:29.212514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:29.215568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:29.230426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:29.231939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:29.232865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:29.234177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:29.235030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:29.235811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:29.852616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:29.887995 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e829a4db-c11b-4bc9-bd91-724ab188d5a3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 200 len: 1473 microversion: 2.1 time: 0.685972 Aug 25 12:38:29.905917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 603/1263] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:29 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 1473 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:29.924232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:29.931019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:29.953804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:29.956357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:29.958697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:29.961666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:29.964006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:29.965690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:30.616356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:30.652688 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8c345071-fb70-48e9-90c8-515d0cabbb84 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1307 microversion: 2.1 time: 0.733295 Aug 25 12:38:30.653838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 604/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:29 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1307 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:30.669360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:30.671148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:30.698841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:30.699755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:30.702975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:30.707767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:30.708842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:30.709655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.109088 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9025aff-4d60-46c2-9f0a-f4adc60e39b3 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.243648 Aug 25 12:38:31.122400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 661/1265] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:31.132377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "name": "network-vif-unplugged", "status": "completed", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}, {"server_uuid": "edd88d48-fb7e-4596-88a2-8ad933f6344f", "name": "network-vif-deleted", "tag": "93652efb-306b-40a2-8a6d-569c56c2fcd9"}, {"name": "network-changed", "server_uuid": "4b6f9e89-a8ea-4996-86d4-cb44e3943dc0", "tag": "4c6b387d-49d6-4247-a602-e24476e62f74"}, {"name": "network-changed", "server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}, {"name": "network-changed", "server_uuid": "9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760", "tag": "99fbb41a-0607-4950-b911-23086db65d5a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:31.157523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.158352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.159324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.171465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:31.190455 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5fd903f7-6412-40dc-a4a5-b6303abd136a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1310 microversion: 2.1 time: 0.534175 Aug 25 12:38:31.191319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 605/1266] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:30 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1310 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:31.195901 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Creating event network-vif-unplugged:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h2-850468-18 Aug 25 12:38:31.197077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Creating event network-vif-deleted:93652efb-306b-40a2-8a6d-569c56c2fcd9 for instance edd88d48-fb7e-4596-88a2-8ad933f6344f on n-h1-850468-18 Aug 25 12:38:31.198047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Creating event network-changed:4c6b387d-49d6-4247-a602-e24476e62f74 for instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 on n-h2-850468-18 Aug 25 12:38:31.199002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Creating event network-changed:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h2-850468-18 Aug 25 12:38:31.199957 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] Creating event network-changed:99fbb41a-0607-4950-b911-23086db65d5a for instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 on n-h1-850468-18 Aug 25 12:38:31.203933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.206011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:31.220916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.221947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.222855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.225360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.226716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.226963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c4ec2594-4cc3-4a01-b9dd-16a4b03f0e1b req-c0059e05-99b9-4379-a267-73bdb9fa78db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 857 microversion: 2.1 time: 0.100357 Aug 25 12:38:31.227651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.228434 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 662/1267] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 857 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:31.250340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a87877af-75a9-4fa1-931d-a018676956d6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2618c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.340105 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a87877af-75a9-4fa1-931d-a018676956d6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca" status: 200 len: 660 microversion: 2.1 time: 0.105120 Aug 25 12:38:31.342205 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 663/1268] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca => generated 660 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:31.409894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.413439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:31.418181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:31.423099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:31.430788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.432108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.433341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.436267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.439807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.441605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.474605 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dc4bf3a2-2c7f-4872-b7d4-005b8ebfe0cf tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1218 microversion: 2.1 time: 0.280809 Aug 25 12:38:31.475731 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 606/1269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:31.493773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:31.495255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:31.526119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.527414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.528573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.530272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:31.534575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:31.537368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:31.608458 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 HTTP/1.1 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:31.619539 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. Aug 25 12:38:31.622184 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40'} Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:31.623764 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. Aug 25 12:38:31.628469 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:31.633709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:31.647672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b2d42021-afa8-4f6f-8fc8-ced99f09f9d3 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40" status: 404 len: 111 microversion: 2.1 time: 0.168401 Aug 25 12:38:31.653618 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 607/1270] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/servers/3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:31.674307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97efdd29-eb91-4ec1-97a8-1185679dd11c tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Action: 'create', calling method: .version_select at 0x7fc6c26a5040>, body: {"pool": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:32.991428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:33.020334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:33.023844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:33.026296 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93a1eb10-89c9-4400-a62f-c02e0b1a36d7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.680698 Aug 25 12:38:33.055653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 664/1271] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:31 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:33.094839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:33.100225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:33.127979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.129049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.130282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.145924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.147085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.153986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.240147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:33.589437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5cb1499a-2616-4c97-b08b-e3ab08cc1010 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 204 len: 0 microversion: 2.1 time: 0.530660 Aug 25 12:38:33.590674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 665/1272] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:33 2022] DELETE /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:33.618032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:33.631122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:33.674230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.679769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.682930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:33.691656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:33.695921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:33.700640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:35.860628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:35.888013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25c8f79b-c811-426e-a8eb-5210304ed840 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1307 microversion: 2.1 time: 2.292961 Aug 25 12:38:35.891734 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 666/1273] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:33 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1307 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:35.910132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:35.913459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:35.933738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:35.935855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:35.937815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:35.940259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:35.942826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:35.944342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:37.953515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:38.011572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:38.829102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:38.855141 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c204534-c0c9-4c58-904f-f4a0080365aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1310 microversion: 2.1 time: 2.960778 Aug 25 12:38:38.860852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 667/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:35 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1310 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:38.888444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:38.890371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:38.931317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:38.936167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:38.941923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:38.944106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:38.945200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:38.946356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:39.488554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:39.511390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5def8a39-4775-473e-bd61-3f3c522e7ba2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1272 microversion: 2.1 time: 0.646366 Aug 25 12:38:39.514770 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 668/1275] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:38 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1272 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:39.531567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40", "name": "network-vif-deleted", "tag": "aa4604e8-be88-47e2-9f18-f3997e8d5940"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:39.554742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:39.556097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:39.557239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:39.590469 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] Creating event network-vif-deleted:aa4604e8-be88-47e2-9f18-f3997e8d5940 for instance 3654a74e-1e6c-4db1-b0ac-4ee6b3e7db40 on n-h2-850468-18 Aug 25 12:38:39.604540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2aea13a7-3229-42c0-8b48-f2ae55b2657a req-7e4c2d86-3be7-4dd7-8c59-ff9fa090de1f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086397 Aug 25 12:38:39.606814 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 669/1276] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:39.621131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:39.623124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:39.637764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:39.639400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:39.640630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:39.642790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:39.644044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:39.645135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:40.905042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:40.926790 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7f1d534-a8e0-4c9d-ae72-8a1fdb6ce128 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 200 len: 1473 microversion: 2.1 time: 1.316512 Aug 25 12:38:40.995753 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 670/1277] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:39 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 1473 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:40.995753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5be8d49-b314-4c2f-8130-8d2475e0a8b3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25d93a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.091969 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5be8d49-b314-4c2f-8130-8d2475e0a8b3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7" status: 200 len: 661 microversion: 2.1 time: 0.117527 Aug 25 12:38:41.109217 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 671/1278] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:40 2022] GET /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7 => generated 661 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:41.119911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:41.122236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:41.146807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:41.148862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:41.150372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:41.153753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:41.157095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:41.158919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:41.507980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:41.571773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:42.565623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:42.626230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:42.635356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:42.638267 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f47267f4-fd5c-4f03-8d74-9a0fa4ed696e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.527282 Aug 25 12:38:42.645525 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 672/1279] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:41 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:42.664311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f9e89-a8ea-4996-86d4-cb44e3943dc0", "name": "network-vif-plugged", "status": "completed", "tag": "4c6b387d-49d6-4247-a602-e24476e62f74"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:42.743621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:42.746956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:42.747517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:42.778394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] Creating event network-vif-plugged:4c6b387d-49d6-4247-a602-e24476e62f74 for instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 on n-h2-850468-18 Aug 25 12:38:42.789336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6c4ea6b4-9bd6-449d-b916-ec46db41a48a req-a2c5052b-a272-4e34-8155-77a902d7dcdc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141340 Aug 25 12:38:42.790877 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 673/1280] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:42.802624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:42.806394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:42.821167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:42.822566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:42.823742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:42.825526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:42.827583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:42.828885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:44.870452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:44.977975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-306bd721-479a-42ee-8acd-60268a2a6328 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1307 microversion: 2.1 time: 2.184439 Aug 25 12:38:44.985367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 674/1281] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:42 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1307 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:44.997320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:44.998728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:45.011619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.013016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.014460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.016255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.017409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.018551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.320802 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97efdd29-eb91-4ec1-97a8-1185679dd11c tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 13.663730 Aug 25 12:38:45.331657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 608/1282] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 13668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:45.341166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:45.342755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:45.356815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.358347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.359623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.361484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:45.362356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:45.363156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:45.968543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:45.999517 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d128968-4a94-404d-8859-2d0d371fe200 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1310 microversion: 2.1 time: 1.011376 Aug 25 12:38:46.008719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 675/1283] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:44 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1310 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:46.034683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bc4a724-f7ba-4846-917f-5d984658c460 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c271fc10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:46.186720 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bc4a724-f7ba-4846-917f-5d984658c460 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7" status: 200 len: 661 microversion: 2.1 time: 0.168938 Aug 25 12:38:46.198143 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 676/1284] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:46 2022] GET /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7 => generated 661 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:46.223067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf36314-9748-4704-b79d-f308fa1ac10d", "name": "network-vif-deleted", "tag": "9825c8d5-5ae7-4413-83e2-e1cc71c2ef28"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:46.251040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:46.261204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.269800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.271479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.298290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b122a5fc-6214-4920-a4ef-7ba2a81364b0 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1314 microversion: 2.1 time: 0.973834 Aug 25 12:38:46.308994 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 609/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:45 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1314 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:46.319925 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] Creating event network-vif-deleted:9825c8d5-5ae7-4413-83e2-e1cc71c2ef28 for instance ebf36314-9748-4704-b79d-f308fa1ac10d on n-h2-850468-18 Aug 25 12:38:46.333127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:46.339547 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ebbebc2d-7f25-4466-bfbc-0b9dbbf85583 req-cee2541a-568f-4243-a1cd-66be927e0df8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138727 Aug 25 12:38:46.340680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: ebf36314-9748-4704-b79d-f308fa1ac10d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:46.345784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 677/1286] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:46.359020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.360494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.361695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.363591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.366132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.366455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:46.368272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.368558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:46.394535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.396615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.399026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.403843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.405593 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. Aug 25 12:38:46.406938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.408198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d HTTP/1.1 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:46.410365 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. Aug 25 12:38:46.413257 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ebf36314-9748-4704-b79d-f308fa1ac10d'} Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:46.414833 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. Aug 25 12:38:46.419400 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:46.429447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance ebf36314-9748-4704-b79d-f308fa1ac10d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:46.435128 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f8591762-c1cd-497f-98e2-3ec38ad89543 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d" status: 404 len: 111 microversion: 2.1 time: 0.121722 Aug 25 12:38:46.444618 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 610/1287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:46 2022] GET /compute/v2.1/servers/ebf36314-9748-4704-b79d-f308fa1ac10d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:46.473699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf36314-9748-4704-b79d-f308fa1ac10d", "name": "network-vif-unplugged", "status": "completed", "tag": "9825c8d5-5ae7-4413-83e2-e1cc71c2ef28"}, {"server_uuid": "9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760", "name": "network-vif-plugged", "status": "completed", "tag": "99fbb41a-0607-4950-b911-23086db65d5a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:46.512445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:46.514458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:46.517270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:46.554864 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Creating event network-vif-unplugged:9825c8d5-5ae7-4413-83e2-e1cc71c2ef28 for instance ebf36314-9748-4704-b79d-f308fa1ac10d on n-h2-850468-18 Aug 25 12:38:46.556043 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] Creating event network-vif-plugged:99fbb41a-0607-4950-b911-23086db65d5a for instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 on n-h1-850468-18 Aug 25 12:38:46.613626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a517187f-a715-4a58-b507-c9bffdaa84ac req-41abd162-e617-4978-9ed3-f6a76d299fe2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.160659 Aug 25 12:38:46.617815 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 611/1288] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:46.652375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a57638fc-260b-4e7d-8818-902559972211 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Action: 'create', calling method: .version_select at 0x7fc6c28155e0>, body: {"pool": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:48.187290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:48.208417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:48.211986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:48.218132 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb9b3521-b051-476f-a6c3-ed1a13bec701 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1815 microversion: 2.25 time: 1.868047 Aug 25 12:38:48.219771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 678/1289] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:46 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1815 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:48.233970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:48.238041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:48.272036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:48.273433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:48.274528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:48.276581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:48.277998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:48.281750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:49.008235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:49.040482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-438503c6-6363-4739-98d7-ec7091593c5a tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1307 microversion: 2.1 time: 0.817221 Aug 25 12:38:49.065015 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 679/1290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:48 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1307 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:49.082686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:49.084140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:49.097167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:49.108046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:49.109954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:49.111922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:49.113328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:49.119966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:49.247586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:49.315658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:49.553958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:38:49.625305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7ff462c-a8d5-4f89-9d9e-ca21e2154213 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce" status: 204 len: 0 microversion: 2.1 time: 0.555414 Aug 25 12:38:49.625305 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 680/1291] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:49 2022] DELETE /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:49.635006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:49.636941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:49.653049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:49.655362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:49.656613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:49.658368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:49.659620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:49.660798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:50.574737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:50.600076 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa1c45e4-b820-4d52-a11f-e649a46ed456 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1494 microversion: 2.1 time: 0.972544 Aug 25 12:38:50.603187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 681/1292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:49 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1494 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:51.491615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:51.493630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:51.511915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:51.515314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:51.516941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:51.518664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:51.520334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:51.521718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:52.249717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:52.284676 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b54c3e3b-2fcd-4f57-9a79-eb3bc70197f5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1314 microversion: 2.1 time: 1.679512 Aug 25 12:38:52.286885 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 682/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:50 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1314 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:52.309961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9caf7045-0a3e-4e9a-9d5b-e2fef28f458d", "tag": "cd628230-0a07-4870-a525-92ca95349c73"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:52.353586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:52.356217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:52.359639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:52.397656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] Creating event network-changed:cd628230-0a07-4870-a525-92ca95349c73 for instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d on n-h1-850468-18 Aug 25 12:38:52.421413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-82a78ea6-514a-4ee3-9199-32a647bf1b8a req-a1826538-cc73-4bbc-a86f-1ce695d64f05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129732 Aug 25 12:38:52.426209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 683/1294] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:52.445835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-688c8dfd-4f46-4334-9528-412512e2b067 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26b9dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:52.558662 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-688c8dfd-4f46-4334-9528-412512e2b067 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94" status: 200 len: 661 microversion: 2.1 time: 0.130151 Aug 25 12:38:52.560236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 684/1295] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:52 2022] GET /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94 => generated 661 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:52.587995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:52.595763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:52.622170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:52.624051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:52.625842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:52.629089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:52.630183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:52.631504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:53.777332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:53.797082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:53.800358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:53.802752 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6588f77-1574-445f-bee0-55188fd474df tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1805 microversion: 2.25 time: 1.239283 Aug 25 12:38:53.805214 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 685/1296] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:52 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1805 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:53.817262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:53.818297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:53.830730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:53.831568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:53.832579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:53.834883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:53.835766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:53.836716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:53.902449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:38:53.957683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a57638fc-260b-4e7d-8818-902559972211 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.336006 Aug 25 12:38:53.973756 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 612/1297] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:53.985749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:53.987209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:54.002465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.003393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.005166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.006636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.007482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.012499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.140762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-edf41e80-06b3-430e-bc68-464dc192182f tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 204 len: 0 microversion: 2.1 time: 0.331010 Aug 25 12:38:54.142370 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 686/1298] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:38:53 2022] DELETE /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:38:54.155257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.156740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:54.172826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.173352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.174396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.175791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.176905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.177737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.529255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:54.551125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6cd1b61-4252-42b1-9f1f-9b9c3db49ee9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1487 microversion: 2.1 time: 0.575418 Aug 25 12:38:54.573189 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 613/1299] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:53 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1487 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:54.587904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d74c7db-2825-4887-aefe-8c67633551c7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2815ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.604863 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-384319cd-385b-4519-bdf3-31180b49a044 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1647 microversion: 2.1 time: 0.460278 Aug 25 12:38:54.606364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 687/1300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1647 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:54.713087 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d74c7db-2825-4887-aefe-8c67633551c7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94" status: 200 len: 661 microversion: 2.1 time: 0.137122 Aug 25 12:38:54.733183 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 614/1301] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94 => generated 661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:54.760516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:54.764732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:54.780457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.782231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.783479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.787447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:54.789048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:54.791480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:54.823494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64396f0f-ff9a-4479-beec-12c0ad10c1d3 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Calling method '.version_select at 0x7fc6c2627dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:55.037980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64396f0f-ff9a-4479-beec-12c0ad10c1d3 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.413114 Aug 25 12:38:55.039969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 688/1302] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:38:55.063136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0919c977-fffb-406d-b998-7d6c2c3e7a33 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '.version_select at 0x7fc6c31073a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:55.074975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0919c977-fffb-406d-b998-7d6c2c3e7a33 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.076135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0919c977-fffb-406d-b998-7d6c2c3e7a33 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.076951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0919c977-fffb-406d-b998-7d6c2c3e7a33 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.123808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0919c977-fffb-406d-b998-7d6c2c3e7a33 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1712 microversion: 2.25 time: 0.080569 Aug 25 12:38:55.145183 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 689/1303] 10.222.0.60 () {60 vars in 1184 bytes} [Thu Aug 25 12:38:55 2022] GET /compute/v2.1/os-migrations => generated 1712 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:55.145183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a4e0a88-3777-4893-8d80-1ea108c14287 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c25ba430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:55.393198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:55.410693 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-996b6b66-8e5e-4363-b1e0-788a90bba6b5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1314 microversion: 2.1 time: 0.675251 Aug 25 12:38:55.419387 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 615/1304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:54 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:55.438495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:55.440757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:55.457790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.458840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.459993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.462784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.464995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.466120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.503488 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce HTTP/1.1 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:55.507575 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. Aug 25 12:38:55.510315 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7e9b4d7e-8201-4974-8df0-8a1d9d7327ce'} Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:55.511806 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. Aug 25 12:38:55.514785 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:55.520373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:55.520373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61227a8e-b8db-4895-8a80-632079b727ca tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce" status: 404 len: 111 microversion: 2.1 time: 0.085497 Aug 25 12:38:55.520373 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 616/1305] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:55 2022] GET /compute/v2.1/servers/7e9b4d7e-8201-4974-8df0-8a1d9d7327ce => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:38:55.522713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9b4d7e-8201-4974-8df0-8a1d9d7327ce", "name": "network-vif-deleted", "tag": "c259d601-52e0-4856-9414-399762b37fea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:55.541654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.542979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.543649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.569892 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] Creating event network-vif-deleted:c259d601-52e0-4856-9414-399762b37fea for instance 7e9b4d7e-8201-4974-8df0-8a1d9d7327ce on n-h2-850468-18 Aug 25 12:38:55.582818 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7eda2498-ad49-4233-9bd2-8580e5837dbf req-ba7c65c5-bcec-46b8-97f1-1cdd30a6e58d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065505 Aug 25 12:38:55.583978 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 617/1306] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:55.596166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:55.597294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:55.612539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.613694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.614465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.615797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.616716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.617503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.676270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lazy-loading 'flavor' on Instance uuid 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:38:55.822485 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a4e0a88-3777-4893-8d80-1ea108c14287 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/8cc817db-b07e-4f1d-b89a-435e50f7a6e3" status: 200 len: 141 microversion: 2.1 time: 0.690056 Aug 25 12:38:55.824661 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 690/1307] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:38:55 2022] GET /compute/v2.1/os-floating-ips/8cc817db-b07e-4f1d-b89a-435e50f7a6e3 => generated 141 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:38:55.835935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:55.838348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:55.856107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.858582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.861088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.862858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:55.864065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:55.865236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:55.991203 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf980f2c-2762-4c2e-9b22-5af30a8a2721 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760/action" status: 202 len: 0 microversion: 2.1 time: 0.404301 Aug 25 12:38:55.993126 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 618/1308] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:38:55 2022] POST /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:38:56.003553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f34766e1-7a02-4f29-92a2-2b8e080a0bc6 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Action: 'create', calling method: .version_select at 0x7fc6c2c4ddc0>, body: {"pool": "non_exist_pool"} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:56.101057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f34766e1-7a02-4f29-92a2-2b8e080a0bc6 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] HTTP exception thrown: Floating IP pool not found. Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f34766e1-7a02-4f29-92a2-2b8e080a0bc6 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Request method failure captured: Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 26 Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB21c5edHeXmcZt_cnRB_Yzpx8JGHiRjKToLEHlzS1HVXzjvoM530jqJyL2SBYI6qgnVczVth-geZgaUJOoCJSUBWvBc14Z6csonThdir-SugsUa5KVLR6MXhsnPKf1TSSA-HaoGGr6BJD8K1J6nJJH5IKkq5UN77kZ87K34kuLUTghM Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ad5896a34e44416fb1ffc4939121a7fd Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:38:56.104757 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ad5896a34e44416fb1ffc4939121a7fd Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-FloatingIPsNegativeTestJSON-790104721-project Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 311905ec885d4da881ec0e37ac03b3e0 Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-790104721-project Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: {"pool": "non_exist_pool"} Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: exception: Floating IP pool not found. Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 25 12:38:56.109105 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:38:56.111657 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 25 12:38:56.114111 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:38:56.116863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f34766e1-7a02-4f29-92a2-2b8e080a0bc6 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Returning 404 to user: Floating IP pool not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:38:56.117951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f34766e1-7a02-4f29-92a2-2b8e080a0bc6 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.122512 Aug 25 12:38:56.118983 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 619/1309] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 12:38:55 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:38:56.131355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1669955340", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:38:56.270712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:38:56.659868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b831242a-ba30-41b0-9b33-78155eb8f8bf tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1647 microversion: 2.1 time: 0.830977 Aug 25 12:38:56.665659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 691/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:55 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1647 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:56.676450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:56.678247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:56.699065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:56.700668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:56.703236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:56.705659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:56.705659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:56.706328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.779704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:38:57.788451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:38:57.790382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:38:57.791671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:38:57.792811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:38:57.793909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:38:57.813250 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93144a69-325c-47b1-b170-3d3d3713453d tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 2426 microversion: 2.25 time: 1.144493 Aug 25 12:38:57.814433 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 692/1311] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:38:56 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 2426 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:38:57.831136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.832649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.834090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.835544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:57.836781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.837026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:57.839043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.840614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.858452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.859466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.860323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.861731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:57.862595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:57.863375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:57.928489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Getting quotas for project ec8a9d2d442e476d88dc76f2d27bbfad. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:38:57.956260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Getting quotas for user a2ea8427596f4ab6b4727f7b0d519177 and project ec8a9d2d442e476d88dc76f2d27bbfad. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:38:57.990260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:38:57.996672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:38:58.096598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7e8a449-a9fc-44d8-9d62-1b4f844fd294 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973264 Aug 25 12:38:58.098943 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 620/1312] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:38:58.109038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1202f8c-50cf-4001-89c3-27aebb97e910 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c26a5670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:59.311051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:38:59.336707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52ff4bd4-3bff-48d0-b29a-510b50647d27 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 200 len: 1474 microversion: 2.1 time: 1.519607 Aug 25 12:38:59.339389 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 693/1313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:57 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 1474 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:38:59.351977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:38:59.353892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:38:59.374006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:59.375559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:59.377503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:38:59.379999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:38:59.381605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:38:59.382800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:00.516236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:00.551718 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a168bc7-758a-4019-a3fd-79eca88eef90 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 200 len: 1478 microversion: 2.1 time: 1.206521 Aug 25 12:39:00.572465 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 694/1314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:38:59 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 1478 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:00.595339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Calling method '.version_select at 0x7fc6c2827940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:01.080938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 98659327-b803-489f-9ff9-73f7796cd0db could not be found", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:39:01.084161 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] HTTP exception thrown: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Request method failure captured: Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-floating-ips/98659327-b803-489f-9ff9-73f7796cd0db HTTP/1.1 Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB21c5edHeXmcZt_cnRB_Yzpx8JGHiRjKToLEHlzS1HVXzjvoM530jqJyL2SBYI6qgnVczVth-geZgaUJOoCJSUBWvBc14Z6csonThdir-SugsUa5KVLR6MXhsnPKf1TSSA-HaoGGr6BJD8K1J6nJJH5IKkq5UN77kZ87K34kuLUTghM Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ad5896a34e44416fb1ffc4939121a7fd Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:39:01.097068 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad5896a34e44416fb1ffc4939121a7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ad5896a34e44416fb1ffc4939121a7fd Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-790104721 Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPsNegativeTestJSON-790104721-project Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 311905ec885d4da881ec0e37ac03b3e0 Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-790104721-project Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: exception: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '98659327-b803-489f-9ff9-73f7796cd0db'} Aug 25 12:39:01.100546 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:39:01.102687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 98659327-b803-489f-9ff9-73f7796cd0db could not be found Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d56cc81b-fe48-432a-9128-4352e4f3b0a2'] Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db. Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:01.111879 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:01.120082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:01.126607 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db Aug 25 12:39:01.126607 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:01.126607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] Returning 404 to user: Floating IP not found for ID 98659327-b803-489f-9ff9-73f7796cd0db {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:01.126607 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9280d0ee-57b0-4a01-874c-c9faf80224a2 tempest-FloatingIPsNegativeTestJSON-790104721 tempest-FloatingIPsNegativeTestJSON-790104721-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/98659327-b803-489f-9ff9-73f7796cd0db" status: 404 len: 111 microversion: 2.1 time: 0.531930 Aug 25 12:39:01.126607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 695/1315] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:39:00 2022] DELETE /compute/v2.1/os-floating-ips/98659327-b803-489f-9ff9-73f7796cd0db => generated 111 bytes in 543 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:01.155950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:01.161880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:01.199499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:01.204610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:01.208584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:01.211689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:01.218424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:01.220254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.408602 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1202f8c-50cf-4001-89c3-27aebb97e910 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/8cc817db-b07e-4f1d-b89a-435e50f7a6e3" status: 202 len: 0 microversion: 2.1 time: 4.295257 Aug 25 12:39:02.424503 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 621/1316] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:38:58 2022] DELETE /compute/v2.1/os-floating-ips/8cc817db-b07e-4f1d-b89a-435e50f7a6e3 => generated 0 bytes in 4324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:02.458629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:02.470471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.471822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.473056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.475375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.476823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.478212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.549701 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5aea9a0-b82e-4155-ab82-367e5a82988a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.123144 Aug 25 12:39:02.551126 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 622/1317] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:39:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:02.564336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:02.566084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:02.606459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.608054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.619922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.622976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:02.624005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:02.624892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:02.834934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:02.871575 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4995d88a-eca8-44d4-a812-f95966721efc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1314 microversion: 2.1 time: 1.752013 Aug 25 12:39:02.888676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 696/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:01 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1314 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:02.920612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2011323264", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:03.098586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:39:03.839114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:39:03.874608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e3e7d68-8966-469d-889a-9adf050d708b tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 2426 microversion: 2.25 time: 1.321190 Aug 25 12:39:03.876157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 623/1319] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:39:02 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 2426 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:39:03.889609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f719f4-eb6d-477b-acdb-328a338401cd", "name": "network-vif-deleted", "tag": "949ed8cc-161f-4726-9fc6-1f293bac975f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:03.932049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:03.937984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:03.939205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:03.974687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] Creating event network-vif-deleted:949ed8cc-161f-4726-9fc6-1f293bac975f for instance 51f719f4-eb6d-477b-acdb-328a338401cd on n-h1-850468-18 Aug 25 12:39:03.988859 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3cd031f9-645f-4247-92bb-e2c897ed52d2 req-1bf0f298-35e5-43ee-ae6f-0baa98944252 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109106 Aug 25 12:39:03.991520 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 624/1320] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:04.006174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:04.008303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 51f719f4-eb6d-477b-acdb-328a338401cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:04.021540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.023212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.024966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.026743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.028018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.029589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.068722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd HTTP/1.1 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:39:04.075200 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. Aug 25 12:39:04.078362 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '51f719f4-eb6d-477b-acdb-328a338401cd'} Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:04.080006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. Aug 25 12:39:04.082771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:04.087669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance 51f719f4-eb6d-477b-acdb-328a338401cd could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:04.091250 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f75f5892-fa22-47f1-8071-e290afcf0847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd" status: 404 len: 111 microversion: 2.1 time: 0.095711 Aug 25 12:39:04.094389 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 625/1321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:03 2022] GET /compute/v2.1/servers/51f719f4-eb6d-477b-acdb-328a338401cd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:04.372342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-313510220"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:04.377768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:04.395504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.396515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.397349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.399416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.400374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.401347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.467735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:39:04.469982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:39:04.471256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:39:04.472820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:39:04.474009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:39:04.534091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.535096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.539325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.541597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.544583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.545584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.639691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Getting quotas for project ec8a9d2d442e476d88dc76f2d27bbfad. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:39:04.653875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Getting quotas for user a2ea8427596f4ab6b4727f7b0d519177 and project ec8a9d2d442e476d88dc76f2d27bbfad. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:39:04.685127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:39:04.693914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:39:04.846471 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e598410-cb90-4139-bd27-c2fe681f3aae tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954323 Aug 25 12:39:04.851961 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 697/1322] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:39:04.865072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9caf7045-0a3e-4e9a-9d5b-e2fef28f458d", "name": "network-vif-plugged", "status": "completed", "tag": "cd628230-0a07-4870-a525-92ca95349c73"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:04.888961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:04.890704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:04.892013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:04.962402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] Creating event network-vif-plugged:cd628230-0a07-4870-a525-92ca95349c73 for instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d on n-h1-850468-18 Aug 25 12:39:04.994364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4543a00a-6819-4c17-af95-bb262e99ddda req-2a4ade68-08da-4c30-bf69-ac002899c3a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123820 Aug 25 12:39:04.994364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 698/1323] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:05.027789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b663b466-d3dd-46af-81c5-9e7dba498799 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c28c30d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:05.199924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-469845c6-b0f5-4312-a2bd-477c5781c0a0 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760/action" status: 202 len: 0 microversion: 2.1 time: 1.102576 Aug 25 12:39:05.215087 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 626/1324] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:39:04 2022] POST /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760/action => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:39:05.228691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:05.230802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:05.249445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.250924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.252024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.254047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.255240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.256953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.467394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-436f70a7-bf84-4407-8185-e010485ea32d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.247023 Aug 25 12:39:05.470777 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 627/1325] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:39:05 2022] POST /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:05.493369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:05.516977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:05.561035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.565142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.565974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:05.575609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:05.578671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:05.582671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:06.008092 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b663b466-d3dd-46af-81c5-9e7dba498799 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.012349 Aug 25 12:39:06.011785 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 699/1326] 10.222.0.60 () {58 vars in 1164 bytes} [Thu Aug 25 12:39:04 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:39:06.060645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:06.063969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:06.112704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:06.114368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:06.116312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:06.118135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:06.123256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:06.130016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:06.321598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:06.362625 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6972d344-6450-4c18-8bfc-f4e0838b5bb1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1314 microversion: 2.1 time: 0.882878 Aug 25 12:39:06.366872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 628/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:05 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:06.386228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21d9a982-f561-4a6d-9e96-6c025bbd72f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:06.585742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21d9a982-f561-4a6d-9e96-6c025bbd72f0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/fb35254f-c289-4684-9033-e85f26786b8b" status: 204 len: 0 microversion: 2.1 time: 0.214886 Aug 25 12:39:06.594748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 629/1328] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 12:39:06 2022] DELETE /compute/v2.1/os-server-groups/fb35254f-c289-4684-9033-e85f26786b8b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:06.605905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b0ed293-9069-4925-8191-a4c1f2510818 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:06.607039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b0ed293-9069-4925-8191-a4c1f2510818 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:06.663288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lazy-loading 'services' on Instance uuid 013e2821-945e-4304-b2fc-0d04ec5f23fe {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:39:06.696879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:06.869920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b0ed293-9069-4925-8191-a4c1f2510818 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:06.904812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b0ed293-9069-4925-8191-a4c1f2510818 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1218 microversion: 2.1 time: 0.311836 Aug 25 12:39:06.906556 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 630/1329] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:06 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1218 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:06.918000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28ab5475-fb2a-4fcd-9418-1830b9ccf246 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c264adc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:07.025300 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c50e8ecf-9c36-4eb5-a230-acb7169cac5d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments/f8099ecd-0cc7-46da-9f04-153c24925213" status: 202 len: 0 microversion: 2.25 time: 1.009244 Aug 25 12:39:07.030944 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 700/1330] 10.222.0.60 () {60 vars in 1457 bytes} [Thu Aug 25 12:39:06 2022] DELETE /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments/f8099ecd-0cc7-46da-9f04-153c24925213 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:07.045319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:07.046326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:07.061063 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28ab5475-fb2a-4fcd-9418-1830b9ccf246 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1437 microversion: 2.1 time: 0.152107 Aug 25 12:39:07.063442 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 631/1331] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:06 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1437 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:07.074467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65beecaa-179f-44b7-93c0-5ccc1e210e4d tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c26b50d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:07.078753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.079992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.082195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:07.084651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.085606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.086394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:07.865805 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-65beecaa-179f-44b7-93c0-5ccc1e210e4d tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.799814 Aug 25 12:39:07.867718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 632/1332] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:39:07 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:07.876997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:07.885466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:07.914930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.915839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.921938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:07.924797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:07.926007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:07.930302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:08.012834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:39:08.026552 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5f4dbbd-38fb-4051-96ce-3e596de6c902 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1632 microversion: 2.1 time: 0.992858 Aug 25 12:39:08.044356 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 701/1333] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:07 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1632 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:08.079018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:08.085104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:08.099061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:08.100554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:08.101705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:08.103510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:08.104974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:08.107238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:08.133350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:08.285743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d90b3299-4c1e-4069-b687-f49ef10036c5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.238862 Aug 25 12:39:08.309548 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 702/1334] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:39:08 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:08.339802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:08.342273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:08.350694 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6553400-f194-40b0-a5ad-1ccf654d565a tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111" status: 204 len: 0 microversion: 2.1 time: 0.480376 Aug 25 12:39:08.352305 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 633/1335] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:39:07 2022] DELETE /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:08.366179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:08.367691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:08.369273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:08.369558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f9f1dfc-7c00-48f6-a93e-58f03c80630e tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c2728af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:08.371327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:08.372588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:08.374346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:09.414700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:09.437640 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ebe0620d-eb58-4649-a2f3-7860869b1ddc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1501 microversion: 2.1 time: 1.125073 Aug 25 12:39:09.457087 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 703/1336] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:08 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1501 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:09.486036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:09.492447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:09.510953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.516739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.521240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:09.523239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.532374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.533955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:09.785548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:09.815318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd7723e6-8943-4218-84a6-c00852097604 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1276 microversion: 2.1 time: 0.355579 Aug 25 12:39:09.832606 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 704/1337] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:09 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:09.832606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": true, "disk_over_commit": false}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:09.849342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:09.875160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.876097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.877002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:09.878351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:09.892777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:09.898951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:10.007249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lazy-loading 'flavor' on Instance uuid 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:39:10.056803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Going to try to live migrate instance to n-h1-850468-18 {{(pid=122701) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:39:12.498940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:13.863546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f9f1dfc-7c00-48f6-a93e-58f03c80630e tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/ca7dc110-4f84-44c2-8899-1e7e8862027d" status: 202 len: 0 microversion: 2.1 time: 5.507684 Aug 25 12:39:13.872606 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 634/1338] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:39:08 2022] DELETE /compute/v2.1/os-floating-ips/ca7dc110-4f84-44c2-8899-1e7e8862027d => generated 0 bytes in 5518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:13.893431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b63acf6b-5da7-4c99-b59b-b3dacece964b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c25cfee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:14.115304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b63acf6b-5da7-4c99-b59b-b3dacece964b tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1437 microversion: 2.1 time: 0.242216 Aug 25 12:39:14.116682 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 635/1339] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:13 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1437 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:14.149762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:14.152241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:14.156994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:14.174211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.175690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.176962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.178666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.179960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.181467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.286905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:39:14.593073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:14.673088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:14.864045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eaa0170f-8dce-4713-9192-bec04a779585 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0/action" status: 202 len: 0 microversion: 2.1 time: 5.044078 Aug 25 12:39:14.868488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 705/1340] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:39:09 2022] POST /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0/action => generated 0 bytes in 5051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:14.883556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:14.893213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:14.919547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.922238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.924355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:14.932814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:14.934903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:14.938068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.100244 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4511a708-16ea-4b8f-831d-780b19df7739 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 204 len: 0 microversion: 2.1 time: 0.966775 Aug 25 12:39:15.108818 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 636/1341] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:39:14 2022] DELETE /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:15.130911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:15.132083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:15.154550 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb171fcc-fb11-4124-a0ab-1da1ca00127b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.282109 Aug 25 12:39:15.159942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:15.160917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:15.161719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.163019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:15.163867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:15.164744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.167318 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 706/1342] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:39:14 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments => generated 197 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:15.186938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:15.242063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:15.246273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:15.248287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.267442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lazy-loading 'flavor' on Instance uuid 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:39:15.309241 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] Creating event network-changed:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:39:15.345861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-81a00d28-6df3-4e7d-92ca-4a8f61a88d0e req-edf421e8-77f3-49d5-b28a-69baeb8f9094 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170779 Aug 25 12:39:15.347647 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 707/1343] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:15.374314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:15.377806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:15.412052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:15.418130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:15.419205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:15.425320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:15.428878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:15.430346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:16.282277 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-793668da-63bc-46dc-bb69-08d447ccfba5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d/action" status: 202 len: 0 microversion: 2.1 time: 1.162943 Aug 25 12:39:16.288901 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 637/1344] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:39:15 2022] POST /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:16.341432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca470171-8da5-483e-9699-4ef386d60f23 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c26f2790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:16.899254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:16.948743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:16.991796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f633cc91-36a7-40b6-bb1e-c3596bcb08fa tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.635866 Aug 25 12:39:16.993750 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 708/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:15 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:17.016625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760", "name": "network-vif-plugged", "status": "completed", "tag": "99fbb41a-0607-4950-b911-23086db65d5a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:17.053900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:17.063667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:17.065529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:17.101075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] Creating event network-vif-plugged:99fbb41a-0607-4950-b911-23086db65d5a for instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 on n-h1-850468-18 Aug 25 12:39:17.115750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1ea971ed-ebbc-4a77-925c-9aa29deb12de req-08ee4e48-a030-4423-9374-c93b1d189564 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118295 Aug 25 12:39:17.119687 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 709/1346] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:17.133121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:17.135783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:17.150214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:17.152150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:17.153168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:17.155434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:17.156952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:17.157982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.130999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:19.173033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd21c375-98d2-495f-bf23-9ca256a8b52e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 2.050073 Aug 25 12:39:19.175323 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 710/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:17 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:19.189798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.191950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 9dc6ea59-df58-470e-97d1-a3d900ef2111] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:19.206484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.208263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.210110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.213358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.215582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.217495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.262026 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111 HTTP/1.1 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:39:19.270074 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. Aug 25 12:39:19.273134 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9dc6ea59-df58-470e-97d1-a3d900ef2111'} Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:19.276353 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. Aug 25 12:39:19.283440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:19.290127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:19.291409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ed9854e-e00e-41f8-9524-148fe4024847 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111" status: 404 len: 111 microversion: 2.1 time: 0.113606 Aug 25 12:39:19.292757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 711/1348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/servers/9dc6ea59-df58-470e-97d1-a3d900ef2111 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:19.303350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eed1a3af-919a-40cc-8aac-b7121e847fe3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c28c3a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.459341 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eed1a3af-919a-40cc-8aac-b7121e847fe3 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1437 microversion: 2.1 time: 0.165048 Aug 25 12:39:19.488589 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 712/1349] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1437 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:19.533111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.554364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:19.581381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.586750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.587719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.589138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.589987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.590773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.761377 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-afef696f-cc11-4fab-afed-04cc7ee1a350 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.270393 Aug 25 12:39:19.765541 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 713/1350] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:39:19.784230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:19.791558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:19.800725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:19.830884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.832451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.833574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:19.834700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:19.835411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:19.836034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.669195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:22.713058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60968ec2-341c-4a7c-9607-a24e887d2e43 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1507 microversion: 2.1 time: 2.944719 Aug 25 12:39:22.719584 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 714/1351] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:19 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1507 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:22.739884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:22.756411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:22.783938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.785715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.788923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:22.791611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:22.792907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:22.793971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.337870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:24.357587 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cf0f193-ea8d-417d-a81e-85963916d4b6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.632197 Aug 25 12:39:24.380557 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 715/1352] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:22 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:24.398651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc6ea59-df58-470e-97d1-a3d900ef2111", "name": "network-vif-deleted", "tag": "d1687c1a-4e75-42f3-a095-253e683d34a9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:24.418871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:24.420236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:24.421066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.454582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] Creating event network-vif-deleted:d1687c1a-4e75-42f3-a095-253e683d34a9 for instance 9dc6ea59-df58-470e-97d1-a3d900ef2111 on n-h1-850468-18 Aug 25 12:39:24.468100 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7528a626-80ac-4caa-bd57-9c9939f3541c req-961ad433-11e8-4f58-be11-a60307346f48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084584 Aug 25 12:39:24.470026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 716/1353] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:24.481441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:24.483827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:24.496179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:24.497040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:24.498698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:24.500709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:24.501486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:24.502257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:25.144494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:25.612758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=33,nova_cell1:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:26.035832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca470171-8da5-483e-9699-4ef386d60f23 tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/78938b38-79da-48f3-a1e4-068bb1f9e511" status: 202 len: 0 microversion: 2.1 time: 9.734981 Aug 25 12:39:26.045866 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 638/1354] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:39:16 2022] DELETE /compute/v2.1/os-floating-ips/78938b38-79da-48f3-a1e4-068bb1f9e511 => generated 0 bytes in 9756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:26.061064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:26.061495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:26.103071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.104010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.104919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.106487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.107382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.108214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.246617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:26.273067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-783e096e-7126-40ce-941d-78652ff51a1b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 200 len: 1474 microversion: 2.1 time: 1.800140 Aug 25 12:39:26.276986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 717/1355] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:24 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 1474 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:26.318351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa95c016-29d1-4e0d-87de-f7d8538f9ae6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c25bad30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:26.566865 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa95c016-29d1-4e0d-87de-f7d8538f9ae6 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1437 microversion: 2.1 time: 0.280154 Aug 25 12:39:26.574369 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 718/1356] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1437 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:26.611596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:26.625987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:26.711419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.721403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.725205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.731075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:26.733214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:26.734677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:26.902999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:26.914849 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5b91835-fbd5-4a08-a730-f2cadb80d804 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.335526 Aug 25 12:39:26.917265 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 719/1357] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe/os-volume_attachments => generated 25 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:26.961998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7", "name": "network-vif-unplugged", "status": "completed", "tag": "c72a276f-0950-48e1-ad55-cd55e887ea34"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:27.005200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.007004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.008554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.048045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] Creating event network-vif-unplugged:c72a276f-0950-48e1-ad55-cd55e887ea34 for instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 on n-h1-850468-18 Aug 25 12:39:27.060943 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f19c7163-ce6d-44c0-9c63-2537da84f63e req-d2d96caf-06a1-4717-9457-701b0b866fd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138626 Aug 25 12:39:27.062870 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 720/1358] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:27.075875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:27.078663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:27.093303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.094288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.095439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.097030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.099613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.101569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.618031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:27.665362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4916b28d-f075-4db4-bc5d-a2a17ed75916 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 1.613346 Aug 25 12:39:27.672664 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 639/1359] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:26 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:27.729612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:27.734131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:27.751307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.753228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.754599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:27.757475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:27.760569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:27.764378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:28.639473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:28.676299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d0152c1e-d103-4d3e-97d4-6a8cdf5a33df tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1507 microversion: 2.1 time: 1.610422 Aug 25 12:39:28.693806 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 721/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:27 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1507 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:28.708943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15f18d81-f943-4226-8991-1ab65097089a tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] Calling method '.version_select at 0x7fc6c28c3820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:29.344628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:29.390774 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe646d06-b0aa-4b7e-bec6-507eb2eaf848 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.701645 Aug 25 12:39:29.393075 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 640/1361] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:27 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:29.402713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7", "name": "network-vif-deleted", "tag": "c72a276f-0950-48e1-ad55-cd55e887ea34"}, {"name": "network-changed", "server_uuid": "a0a1cadc-61f5-4d92-b04f-0f4cd58729eb", "tag": "e417e798-1d1c-48b5-90b1-a7665079f1ea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:29.456584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.467004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.468272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.543185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Creating event network-vif-deleted:c72a276f-0950-48e1-ad55-cd55e887ea34 for instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 on n-h1-850468-18 Aug 25 12:39:29.544035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] Creating event network-changed:e417e798-1d1c-48b5-90b1-a7665079f1ea for instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb on n-h2-850468-18 Aug 25 12:39:29.586347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-cc9b9d77-2942-44ae-aca5-509770acb4ee req-0f40af6f-2236-498b-b675-fae1ca3128a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.189203 Aug 25 12:39:29.593003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 641/1362] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:29.622632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:29.629836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:29.680998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.684362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.689157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.692949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:29.695162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:29.699746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:29.822227 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 HTTP/1.1 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:39:29.831475 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. Aug 25 12:39:29.834762 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7'} Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:29.839438 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. Aug 25 12:39:29.842545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:39:29.850690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:29.850690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cdc85814-790d-4623-b931-40fdcad08dd0 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7" status: 404 len: 111 microversion: 2.1 time: 0.250662 Aug 25 12:39:29.852415 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 642/1363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:29 2022] GET /compute/v2.1/servers/f778c3a5-9e2e-4bb4-8fd1-886bae2fd7f7 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:29.870065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fdcb106f-3247-4cd1-9556-2ffb460523a1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2815040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.077843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fdcb106f-3247-4cd1-9556-2ffb460523a1 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1437 microversion: 2.1 time: 0.196508 Aug 25 12:39:30.093362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 643/1364] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:29 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1437 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:30.093362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:30.093362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:30.177108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.178407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.179417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:30.181066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:30.182956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:30.184258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.335293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:32.382821 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d299ef25-1e68-4983-8739-c5299b47c55a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 2.300089 Aug 25 12:39:32.391778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 644/1365] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:30 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:32.472553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-plugged", "status": "completed", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:32.510514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.511363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.512226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.553214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] Creating event network-vif-plugged:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:39:32.590695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e9d10852-1cec-4514-9c6b-98b30ef5a481 req-1191d4db-9617-466f-947a-b51247a6382e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190306 Aug 25 12:39:32.597464 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 645/1366] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:32.627537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:32.630662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:32.660405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.662193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.663600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:32.665523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:32.672274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:32.674121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:34.650439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:34.720683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-316e7554-3ae2-4b6f-8d75-83c1b8611454 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1507 microversion: 2.1 time: 2.100095 Aug 25 12:39:34.739177 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 646/1367] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:32 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1507 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:34.784087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c24bc045-8b62-4faa-aa05-6f59a0491749 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:35.035338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c24bc045-8b62-4faa-aa05-6f59a0491749 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/5a7e4f2d-3250-4112-ab92-19ce64b81514" status: 204 len: 0 microversion: 2.1 time: 0.293987 Aug 25 12:39:35.041499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 647/1368] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 12:39:34 2022] DELETE /compute/v2.1/os-server-groups/5a7e4f2d-3250-4112-ab92-19ce64b81514 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:35.080421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:35.083201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:35.149655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.157286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.159065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:35.167755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:35.176348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:35.181714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:36.533325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:36.587565 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95e4515d-39a0-469c-91b0-89cb1f45e8d1 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.536911 Aug 25 12:39:36.593680 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 648/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:35 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:36.631626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbc03744-c078-4418-854e-7f47271e1d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26f2550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:37.092514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=13 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:37.767051 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15f18d81-f943-4226-8991-1ab65097089a tempest-FloatingIPDetailsTestJSON-1530221778 tempest-FloatingIPDetailsTestJSON-1530221778-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/7a2f0d76-b793-4d4e-8a27-f7a98d2f7fda" status: 202 len: 0 microversion: 2.1 time: 9.069936 Aug 25 12:39:37.772167 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 722/1370] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:39:28 2022] DELETE /compute/v2.1/os-floating-ips/7a2f0d76-b793-4d4e-8a27-f7a98d2f7fda => generated 0 bytes in 9073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:39:37.786262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f9e89-a8ea-4996-86d4-cb44e3943dc0", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6b387d-49d6-4247-a602-e24476e62f74"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:37.835753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:37.839790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:37.844552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:37.914537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] Creating event network-vif-unplugged:4c6b387d-49d6-4247-a602-e24476e62f74 for instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 on n-h2-850468-18 Aug 25 12:39:37.969488 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e5e585a8-036e-42aa-af87-f175a3c1f5ea req-c6b9a7e5-fe6a-4614-8468-d10fdf2e466f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198626 Aug 25 12:39:37.985718 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 723/1371] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:38.034035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:38.053505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:38.107868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.119798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.123116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:38.127356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:38.134622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:38.167448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.119990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:39.161920 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83d216c7-a72b-4e2a-a5a1-4697f467560b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 1.173208 Aug 25 12:39:39.163415 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 724/1372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:37 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:39.210047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.211005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.254550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.279805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.281133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.304545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.309084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.316691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.513850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:39:39.947088 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7521160-dd2f-4c27-9a18-cf52f596601b tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 204 len: 0 microversion: 2.1 time: 0.780589 Aug 25 12:39:39.948505 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 725/1373] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:39:39 2022] DELETE /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:39.965263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:39.967796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:39.985460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.986755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.987916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:39.989559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:39.991052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:39.992219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.792384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:41.821143 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b30b37b-08c2-4acb-97b1-eb59291cd104 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1507 microversion: 2.1 time: 1.866313 Aug 25 12:39:41.847264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 726/1374] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:39 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1507 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:41.873434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:41.874863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:41.903556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.904371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.908821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:41.913381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:41.918653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:41.920462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:43.680917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:43.698616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d20f5bec-6a70-48ac-806c-a61a33e3ba53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.849813 Aug 25 12:39:43.707982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 727/1375] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:41 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:44.250752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] Calling method '.version_select at 0x7fc6c2625a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:44.852263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f78049e1-db4f-439c-aa55-d2ce2c656dd3 could not be found", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:39:44.853631 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] HTTP exception thrown: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] Request method failure captured: Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-floating-ips/f78049e1-db4f-439c-aa55-d2ce2c656dd3 HTTP/1.1 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB22LFFfZw1iJjypDYiaEqqsKhEQp3QDVM5vghZq2XdirDtdCE0Ma1S17I29Y1Wm79JECF3pblLuJx6GaQ1701VWHRVoMswRsebeWK9i4u8q5ThZ1HgCD_xPk4rm5tVmTPndvvfPlHM2RlC_2cYWdM7F8CKGtvyqdx6EauArdUR1Xd7Y Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d4805bd83fbf4e28876031c46e6e72df Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602603938 Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:39:44.860091 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4805bd83fbf4e28876031c46e6e72df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4805bd83fbf4e28876031c46e6e72df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4805bd83fbf4e28876031c46e6e72df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4805bd83fbf4e28876031c46e6e72df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1602603938 Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d4805bd83fbf4e28876031c46e6e72df Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602603938 Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8e6d9dae45394ba9b044bd71f3482cb4 Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: exception: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3 Aug 25 12:39:44.862755 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'f78049e1-db4f-439c-aa55-d2ce2c656dd3'} Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:44.864438 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f78049e1-db4f-439c-aa55-d2ce2c656dd3 could not be found Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a6b49e31-7302-4e20-95d5-c84743581ebd'] Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3. Aug 25 12:39:44.866907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3 Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:44.869650 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:44.878403 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:44.878403 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3 Aug 25 12:39:44.878403 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:44.878403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] Returning 404 to user: Floating IP not found for ID f78049e1-db4f-439c-aa55-d2ce2c656dd3 {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:44.878403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ba3a49f-33ed-456b-8296-479c5e9e878a tempest-FloatingIPDetailsNegativeTestJSON-1602603938 tempest-FloatingIPDetailsNegativeTestJSON-1602603938-project] 10.222.0.60 "GET /compute/v2.1/os-floating-ips/f78049e1-db4f-439c-aa55-d2ce2c656dd3" status: 404 len: 111 microversion: 2.1 time: 1.123112 Aug 25 12:39:44.883059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 728/1376] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:39:43 2022] GET /compute/v2.1/os-floating-ips/f78049e1-db4f-439c-aa55-d2ce2c656dd3 => generated 111 bytes in 1172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:44.891638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:44.908162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:44.953633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.957483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.958478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:44.959864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:44.960504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:44.960877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.112047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:45.332803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4947593590940578ee293587f0cac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9887ac4ba161489dbc983267f299f400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:45.377068 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41721417-7255-4a56-8b45-bf54d94db409 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 200 len: 1431 microversion: 2.1 time: 0.494506 Aug 25 12:39:45.391312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 729/1377] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:44 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 1431 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:45.416538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:45.421859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:45.458382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:45.471477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:45.472886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:45.475868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:45.477160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:45.486583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:46.574184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:47.258201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:47.295994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3e4a535-ac05-4320-baef-e4488a9f6e98 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 1.898936 Aug 25 12:39:47.301467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 730/1378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:45 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:47.326943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f9e89-a8ea-4996-86d4-cb44e3943dc0", "tag": "4c6b387d-49d6-4247-a602-e24476e62f74"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:47.373613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.379462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.381478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.443529 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] Creating event network-changed:4c6b387d-49d6-4247-a602-e24476e62f74 for instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 on n-h2-850468-18 Aug 25 12:39:47.459478 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7e5489be-f9fb-4507-af21-2d33a060905e req-4b560e38-5e47-48e7-9c85-b204178fa1fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151579 Aug 25 12:39:47.468408 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 731/1379] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:47.479185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1cadc-61f5-4d92-b04f-0f4cd58729eb", "name": "network-vif-plugged", "status": "completed", "tag": "e417e798-1d1c-48b5-90b1-a7665079f1ea"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:47.513957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.517331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.519333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.573213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] Creating event network-vif-plugged:e417e798-1d1c-48b5-90b1-a7665079f1ea for instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb on n-h2-850468-18 Aug 25 12:39:47.594729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e5e067a7-110d-4ffd-8e78-665237053ad5 req-81f2eba6-d57b-44b9-a717-f4062c184b37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123379 Aug 25 12:39:47.607604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 732/1380] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:47.626328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:47.632629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:47.657314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.658656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.660035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:47.661746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:47.662743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:47.663647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:48.888987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:48.928793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e70bf39-96f7-45d8-8f23-39c509814aad tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1507 microversion: 2.1 time: 1.302270 Aug 25 12:39:48.929853 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 733/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:47 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1507 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:48.952777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:48.954296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:48.977908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:48.979130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:48.983471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:48.988402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:48.989932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:48.992152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:50.038810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:50.076725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-822bcc53-01f3-4ec3-ac00-a5149606a65e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1318 microversion: 2.1 time: 1.139910 Aug 25 12:39:50.087680 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 734/1382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:48 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1318 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:50.118639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:50.148403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] [instance: 5a61c5bb-e595-4272-a2db-69cd3886a0c4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:50.177276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:50.185038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:50.190427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:50.194606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:50.198699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:50.210037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:50.280798 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] HTTP exception thrown: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Request method failure captured: Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 HTTP/1.1 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wLn3pIa12VgEDxZbginO5p5vt3wv7F9ZhKmhPRCrVsEwaAzSc54ZraTNzQpwW1QRDEgCQOAEYRrGczdGcIzMQTyvR_gCYvFPMuOlu1GcAbkQHbTM4jnJ3I4VK14AIukV_OIcgltZzYbOuVgs4elKsA2wMU_sCs0VHEv3wEwJiI1xY Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:39:50.293470 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9887ac4ba161489dbc983267f299f400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9887ac4ba161489dbc983267f299f400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9887ac4ba161489dbc983267f299f400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9887ac4ba161489dbc983267f299f400 Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1080318958 Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a4947593590940578ee293587f0cac3d Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersOnMultiNodesTest-1080318958-project Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. Aug 25 12:39:50.299504 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5a61c5bb-e595-4272-a2db-69cd3886a0c4'} Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:39:50.302158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. Aug 25 12:39:50.307262 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:39:50.327280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] Returning 404 to user: Instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:39:50.327280 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff5923fe-b35d-40c1-bc9d-e654e7efd3b9 tempest-ServersOnMultiNodesTest-1080318958 tempest-ServersOnMultiNodesTest-1080318958-project] 10.222.0.60 "GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4" status: 404 len: 111 microversion: 2.1 time: 0.232177 Aug 25 12:39:50.328945 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 735/1383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:50 2022] GET /compute/v2.1/servers/5a61c5bb-e595-4272-a2db-69cd3886a0c4 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:39:50.339722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:50.342473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:50.356532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:50.358915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:50.360715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:50.362577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:50.363954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:50.365117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:51.488366 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbc03744-c078-4418-854e-7f47271e1d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1446 microversion: 2.1 time: 14.892040 Aug 25 12:39:51.491449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 649/1384] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:36 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1446 bytes in 14896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:51.505983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a61c5bb-e595-4272-a2db-69cd3886a0c4", "name": "network-vif-deleted", "tag": "c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:51.559139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:51.562762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:51.565051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:51.618597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] Creating event network-vif-deleted:c5e97ff1-c86d-47fe-9be4-f1a6c5fa7327 for instance 5a61c5bb-e595-4272-a2db-69cd3886a0c4 on n-h1-850468-18 Aug 25 12:39:51.636346 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-74174d36-076f-4cb3-a113-697644931bdf req-dd70fd26-07c0-467a-8bbf-baf11e941e9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136425 Aug 25 12:39:51.642225 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 650/1385] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:51.652932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:51.654939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:51.672537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:51.673963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:51.675137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:51.676821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:51.677852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:51.678877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.597613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:52.673184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bc54bc5-523d-4cfd-b831-45473ee0f938 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 2.332566 Aug 25 12:39:52.674078 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 736/1386] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:50 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:52.686712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:52.687945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:52.710183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.711966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.712741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:52.715584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:52.722581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:52.726598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.234421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:54.281648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b67f146-881d-48e4-8064-9b97151867ae tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1528 microversion: 2.1 time: 2.637040 Aug 25 12:39:54.291095 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 651/1387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:51 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1528 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:54.336254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4dde4ec5-3530-4e12-81f5-ddcdeb6f5040 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c26a5310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.498889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:54.523234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d9e15b7-4738-4c2a-b0e1-ccdfac6d401d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1468 microversion: 2.1 time: 1.847101 Aug 25 12:39:54.552842 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4dde4ec5-3530-4e12-81f5-ddcdeb6f5040 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 200 len: 1446 microversion: 2.1 time: 0.258677 Aug 25 12:39:54.553939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 652/1388] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:39:54 2022] GET /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 1446 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:54.566402 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 737/1389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:52 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1468 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:54.582375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.582375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:54.589853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:54.595467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:54.619419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.620355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.621559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.624400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.630149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.631134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.640708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.645668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.648238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:54.660780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:54.662094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:54.667649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:55.568598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:55.637444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8eab11f2-60c0-40e8-b405-21380493246c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1468 microversion: 2.1 time: 1.065320 Aug 25 12:39:55.647151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 738/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:54 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1468 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:55.672805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7be098a4-e660-49bd-a042-587198319203 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30533a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:55.741530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:55.782404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5beff399-6da5-4157-8f9c-7af9e6323b7a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1504 microversion: 2.1 time: 1.215802 Aug 25 12:39:55.785054 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 653/1391] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:54 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1504 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:55.822074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760", "name": "network-vif-unplugged", "status": "completed", "tag": "99fbb41a-0607-4950-b911-23086db65d5a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:55.913723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:55.917111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:55.918388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:56.023342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] Creating event network-vif-unplugged:99fbb41a-0607-4950-b911-23086db65d5a for instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 on n-h1-850468-18 Aug 25 12:39:56.057395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3474fe6d-c721-4133-8cff-956e8953afe9 req-d4257eb4-42b9-473c-acd2-009dd1f154b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.269555 Aug 25 12:39:56.058565 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 654/1392] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:39:56.110746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:56.117035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:56.161190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.171546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.177155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:56.184526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:56.186118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:56.200625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:57.900950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:39:57.920847 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7796304-8f91-4819-b9a2-a5022b33ac03 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1528 microversion: 2.1 time: 1.849546 Aug 25 12:39:57.938825 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 655/1393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:56 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1528 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:39:57.968681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-689391169"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:57.973623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:57.997843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.002594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.003484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.004837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.005704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.011518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.909065 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7be098a4-e660-49bd-a042-587198319203 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 204 len: 0 microversion: 2.1 time: 3.257916 Aug 25 12:39:58.911059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 739/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:55 2022] DELETE /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 0 bytes in 3262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:39:58.926268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:39:58.927758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:39:58.955624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.963835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.964668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:58.971834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:58.973054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:58.974067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.125764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:39:59.796426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-661c7d0a-87db-4634-bda4-b8eb200d3adb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "POST /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808/action" status: 202 len: 0 microversion: 2.1 time: 1.854529 Aug 25 12:39:59.800206 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 656/1395] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:39:57 2022] POST /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808/action => generated 0 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:39:59.815104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9caf7045-0a3e-4e9a-9d5b-e2fef28f458d", "name": "network-vif-plugged", "status": "completed", "tag": "cd628230-0a07-4870-a525-92ca95349c73"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:39:59.895803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:39:59.898317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:39:59.899971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:39:59.996620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] Creating event network-vif-plugged:cd628230-0a07-4870-a525-92ca95349c73 for instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d on n-h1-850468-18 Aug 25 12:40:00.048655 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5d310aa0-3d03-4e8d-86b0-26df78180f4f req-b274f967-22a2-4cb2-8560-77c98afba2eb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240470 Aug 25 12:40:00.056732 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 657/1396] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:00.115258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:00.119840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:00.244576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:00.281610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:00.292276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.294346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:00.303030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:00.303966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.395994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:00.509348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba3af3e7-1e65-455b-87d2-b613c32d040d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1479 microversion: 2.1 time: 1.596428 Aug 25 12:40:00.552241 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 740/1397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:39:58 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1479 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:00.565860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:00.568341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:00.583711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:00.585178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:00.586361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.588065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:00.589385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:00.591374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:00.603192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:40:01.288429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0605ac0d-a22f-4412-893f-9ba2212054ed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 204 len: 0 microversion: 2.1 time: 1.217992 Aug 25 12:40:01.298638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 658/1398] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:00 2022] DELETE /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:40:01.338777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32427645-6057-48ad-9ba8-ab9079736566 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26a5b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:01.407834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:01.458878 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a3eb9be-b40f-4f1e-a841-ec4c253660e1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1523 microversion: 2.1 time: 0.895259 Aug 25 12:40:01.467442 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 741/1399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:00 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1523 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:01.511921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5942c6c3-6b77-4bd5-9846-fb7530756ff9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '.version_select at 0x7fc6c2a7a310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:01.535151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5942c6c3-6b77-4bd5-9846-fb7530756ff9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:01.539735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5942c6c3-6b77-4bd5-9846-fb7530756ff9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:01.543049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5942c6c3-6b77-4bd5-9846-fb7530756ff9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:01.587183 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5942c6c3-6b77-4bd5-9846-fb7530756ff9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.1 time: 0.117397 Aug 25 12:40:01.607050 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 742/1400] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:40:01 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:01.624649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:01.626378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:01.642160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:01.643951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:01.646286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:01.648790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:01.650257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:01.651920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:02.396288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-357d7e40-2f17-43bd-a0f9-68eb1e67b47d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1632 microversion: 2.1 time: 0.781998 Aug 25 12:40:02.412063 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 743/1401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:01 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1632 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:02.445354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1904208697", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.786835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] validate_networks() for [('c8e6fa16-5a9f-428f-9fb0-fa7da9f09a9d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:40:06.798422 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32427645-6057-48ad-9ba8-ab9079736566 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e" status: 200 len: 1452 microversion: 2.1 time: 5.490489 Aug 25 12:40:06.799503 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 659/1402] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:01 2022] GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e => generated 1452 bytes in 5497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:06.834112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-645e4dd8-d0a9-43fe-b428-4fa54f602db5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: .version_select at 0x7fc6c2a29c10>, body: {"keypair": {"name": "tempest-keypair-1615614537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuPBvNWbkh/hLeuepCg63lhPtnMRM3BsRtnUx6csWBsO1J5mEEFKjVz9kR1SJZs8Tdp4bDy/DhT3dN38i7YD/LjOFq4JFwjAHKztwsmhKeeHO79QyXm8kUilp+yXxfBBg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:06.881397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-645e4dd8-d0a9-43fe-b428-4fa54f602db5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for project 6fc96e94ab95423d81077cf6af360715. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:06.932944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-645e4dd8-d0a9-43fe-b428-4fa54f602db5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for user c6be50aac19c400cb9883fcf881ad13c and project 6fc96e94ab95423d81077cf6af360715. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:07.163700 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-645e4dd8-d0a9-43fe-b428-4fa54f602db5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.354615 Aug 25 12:40:07.177355 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 660/1403] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:40:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:07.190179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:07.192478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:07.209080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:07.210471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:07.212310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:07.214285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:07.216317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:07.218895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.687774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:40:09.690063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:40:09.691601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:40:09.693217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:40:09.694366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:40:09.698133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:09.721698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:09.733845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-997a681d-0d2a-49fc-a35f-5f42c14f30ca tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1523 microversion: 2.1 time: 2.551319 Aug 25 12:40:09.738999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 661/1404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:07 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1523 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:09.756697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:09.762254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:09.764425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.766267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:09.770886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:09.773220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:09.889390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:09.909776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Getting quotas for user 6121e19dc50b45ca979df57e9e0b48ea and project 2f5e2b04f8e64966b5d3487c30894d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:09.967039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:40:09.985903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:40:10.353741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24c465ff-44c6-4e1f-98d3-5718635c879e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.942311 Aug 25 12:40:10.382484 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 744/1405] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 7967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:40:10.391085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760", "name": "network-vif-deleted", "tag": "99fbb41a-0607-4950-b911-23086db65d5a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:10.480082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:10.481049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:10.491522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:10.551383 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] Creating event network-vif-deleted:99fbb41a-0607-4950-b911-23086db65d5a for instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 on n-h1-850468-18 Aug 25 12:40:10.582402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d71d7d86-250e-498e-8548-db46cda5cfb5 req-66eea18c-bedc-49a6-9327-c78d89b3993d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202569 Aug 25 12:40:10.583458 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 745/1406] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:10.622819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-492825a4-73f4-4874-b917-82f4402072bc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25e04c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:11.009586 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9964338f-fc22-48ce-941b-6efd191751b4 tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-24T12%3A40%3A04.023447&end=2022-08-26T12%3A40%3A04.023447" status: 404 len: 112 microversion: - time: 1.267707 Aug 25 12:40:11.014292 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 662/1407] 10.222.0.60 () {58 vars in 1316 bytes} [Thu Aug 25 12:40:09 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-24T12%3A40%3A04.023447&end=2022-08-26T12%3A40%3A04.023447 => generated 112 bytes in 1274 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:40:11.080445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-plugged", "status": "completed", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:11.125064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:11.125986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:11.126769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:11.161753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] Creating event network-vif-plugged:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:40:11.188772 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ec6ce857-271c-470e-818f-dc4f8e8df1e0 req-50f0b431-932a-41e7-ad50-cab5417a218a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147877 Aug 25 12:40:11.189942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 663/1408] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:11.223025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6eacdf7-c7a5-4775-bf26-a0e119f00d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:11.228839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6eacdf7-c7a5-4775-bf26-a0e119f00d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:11.508321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6eacdf7-c7a5-4775-bf26-a0e119f00d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:11.532427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6eacdf7-c7a5-4775-bf26-a0e119f00d02 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 200 len: 1208 microversion: 2.1 time: 0.338600 Aug 25 12:40:11.536748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 664/1409] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:11 2022] GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 1208 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:13.036422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1849629837", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:19.823546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:19.947571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:20.477062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:20.515331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=23 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:21.160311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:21.516303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:23.071882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:27.140077 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 12:40:27.140077 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 12:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e (ip 10.222.0.60) !!! Aug 25 12:40:27.954906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-492825a4-73f4-4874-b917-82f4402072bc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e" status: 200 len: 1452 microversion: 2.1 time: 17.351769 Aug 25 12:40:27.957170 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 746/1410] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:10 2022] GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e => generated 1452 bytes in 17360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:27.978473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:40:27.983272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:27.984694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:28.007197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.009071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.009907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.011278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.012797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.013932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.544755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:40:28.545528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:40:28.546589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:40:28.547317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:40:28.549795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:40:28.580105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.582116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.583853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.585910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.592712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:28.597467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.598278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.641755 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7b17106-345a-4797-a148-8547bf12e789 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1523 microversion: 2.1 time: 0.681923 Aug 25 12:40:28.646682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Getting quotas for project d4c7847d95af4a5dbb8b469099b37bba. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:28.649154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 747/1411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:27 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:28.661677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Getting quotas for user c293b8d9fbef415dbc73654bf2d2a7ba and project d4c7847d95af4a5dbb8b469099b37bba. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:28.695262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e29a712-362e-4555-8e49-eedfa197fd6a tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] Calling method '.version_select at 0x7fc6c25c9ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.710613 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-6e29a712-362e-4555-8e49-eedfa197fd6a tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 25 12:40:28.717739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e29a712-362e-4555-8e49-eedfa197fd6a tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] Request method failure captured: Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-simple-tenant-usage/805dd3888ae246d1bbd57b1db92c93e0?start=2022-08-26T12%3A40%3A04.023447&end=2022-08-24T12%3A40%3A04.023447 HTTP/1.1 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB22jvUNBkyy9DLgtoY1-rvawW3NGixi2HHH11qfrNM80W-Q3UiBaI9oPQ68AyWy-JWFwuBCkq3CyZcHUIAf363_gUwKfYOw5F9QP1p-ugPbITF31turDPDc8uV17hkgFfdvuYqHh9gD52iKD_BkrbsFi2_7lCXREExbN6n0pDl7lblA Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 198d2961f3b44f629b05efe3da530111 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1488612454 Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 12:40:28.721787 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_198d2961f3b44f629b05efe3da530111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/198d2961f3b44f629b05efe3da530111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d2961f3b44f629b05efe3da530111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/198d2961f3b44f629b05efe3da530111"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1488612454 Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 198d2961f3b44f629b05efe3da530111 Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1488612454 Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: cc6ae2d2be7e4980ab956085ddc55658 Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid start time. The start time cannot occur after the end time. Aug 25 12:40:28.725110 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '805dd3888ae246d1bbd57b1db92c93e0'} Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 12:40:28.726846 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e29a712-362e-4555-8e49-eedfa197fd6a tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:28.729531 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e29a712-362e-4555-8e49-eedfa197fd6a tempest-TenantUsagesNegativeTestJSON-1488612454 tempest-TenantUsagesNegativeTestJSON-1488612454-project-admin] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage/805dd3888ae246d1bbd57b1db92c93e0?start=2022-08-26T12%3A40%3A04.023447&end=2022-08-24T12%3A40%3A04.023447" status: 400 len: 111 microversion: 2.1 time: 0.072710 Aug 25 12:40:28.731845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 748/1412] 10.222.0.60 () {58 vars in 1412 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/os-simple-tenant-usage/805dd3888ae246d1bbd57b1db92c93e0?start=2022-08-26T12%3A40%3A04.023447&end=2022-08-24T12%3A40%3A04.023447 => generated 111 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:40:28.733428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:40:28.747750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:28.749063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:28.763721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.764761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.766017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.767221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:28.768061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:28.769009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:28.849256 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-83b0c11a-7e93-4cd9-b1a0-80a1f8f2e5fb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.310131 Aug 25 12:40:28.850462 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 665/1413] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 17313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:40:28.862538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-124466740", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1b190f40-d315-44fa-af57-e579f81ef520"}], "security_groups": [{"name": "tempest-securitygroup--1564948010"}], "key_name": "tempest-keypair-1615614537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:29.280401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:29.298236 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e16496ee-9f17-4137-a4c2-a75f3c8a7598 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 200 len: 1308 microversion: 2.1 time: 0.570037 Aug 25 12:40:29.299590 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 749/1414] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:28 2022] GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:29.310624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8855c71-5854-45b3-ab59-b6d1d3c5db33", "tag": "381dd6b1-1035-478b-8f23-93053594e6d1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:29.331463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] validate_networks() for [('1b190f40-d315-44fa-af57-e579f81ef520', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:40:29.345899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:29.347200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:29.348071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:29.372915 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] Creating event network-changed:381dd6b1-1035-478b-8f23-93053594e6d1 for instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 on n-h2-850468-18 Aug 25 12:40:29.383624 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d38d162a-395c-417e-a50d-29c57ff7e442 req-1f1824ca-e099-478f-8076-17b759d24940 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081382 Aug 25 12:40:29.385185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 750/1415] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:29.397307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8855c71-5854-45b3-ab59-b6d1d3c5db33", "name": "network-vif-plugged", "status": "completed", "tag": "381dd6b1-1035-478b-8f23-93053594e6d1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:29.422647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:29.424011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:29.424913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:29.452197 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] Creating event network-vif-plugged:381dd6b1-1035-478b-8f23-93053594e6d1 for instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 on n-h2-850468-18 Aug 25 12:40:29.463343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fc72d176-c79f-4d06-be76-eda399bdffe3 req-c08a83b6-c7ab-4ee8-a2e3-b71ac0fc64cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075516 Aug 25 12:40:29.464539 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 751/1416] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:29.885272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2b1a0a8-ca8e-44c9-863f-1737911e6a32 tempest-TenantUsagesNegativeTestJSON-1815519488 tempest-TenantUsagesNegativeTestJSON-1815519488-project] Calling method '.version_select at 0x7fc6c25e5550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:29.898686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d2b1a0a8-ca8e-44c9-863f-1737911e6a32 tempest-TenantUsagesNegativeTestJSON-1815519488 tempest-TenantUsagesNegativeTestJSON-1815519488-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '14fa967772424690a724e928cecffc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805dd3888ae246d1bbd57b1db92c93e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2b1a0a8-ca8e-44c9-863f-1737911e6a32 tempest-TenantUsagesNegativeTestJSON-1815519488 tempest-TenantUsagesNegativeTestJSON-1815519488-project] Request method failure captured: Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A40%3A04.023447&end=2022-08-26T12%3A40%3A04.023447&detailed=1 HTTP/1.1 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB22fIL18lhN-cZj3DWUcbaRgr8K70twvAUVpVo1wrvaeL9nV9UdXWNv3m6O267LbisMdceVOqn8k4hWDT0XaoZn-d-OfiRzGIJ6yuKkvxI3tsWvoby19KsVblTK6yFMS9S9K-aYAUx5LhUwVCgP8HnuYX35Of96Qqw5885eRPKuuKno Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 805dd3888ae246d1bbd57b1db92c93e0 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1815519488 Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:40:29.906806 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_805dd3888ae246d1bbd57b1db92c93e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/805dd3888ae246d1bbd57b1db92c93e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/805dd3888ae246d1bbd57b1db92c93e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/805dd3888ae246d1bbd57b1db92c93e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1815519488 Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 805dd3888ae246d1bbd57b1db92c93e0 Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1815519488 Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TenantUsagesNegativeTestJSON-1815519488-project Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 14fa967772424690a724e928cecffc35 Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1815519488-project Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: action_args: {} Aug 25 12:40:29.909724 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 25 12:40:29.912717 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 25 12:40:29.919964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 25 12:40:29.924462 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 25 12:40:29.924462 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:29.924462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2b1a0a8-ca8e-44c9-863f-1737911e6a32 tempest-TenantUsagesNegativeTestJSON-1815519488 tempest-TenantUsagesNegativeTestJSON-1815519488-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:29.928157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d2b1a0a8-ca8e-44c9-863f-1737911e6a32 tempest-TenantUsagesNegativeTestJSON-1815519488 tempest-TenantUsagesNegativeTestJSON-1815519488-project] 10.222.0.60 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A40%3A04.023447&end=2022-08-26T12%3A40%3A04.023447&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.454530 Aug 25 12:40:29.938129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 752/1417] 10.222.0.60 () {58 vars in 1335 bytes} [Thu Aug 25 12:40:29 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-24T12%3A40%3A04.023447&end=2022-08-26T12%3A40%3A04.023447&detailed=1 => generated 123 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:29.951164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67706a82-2389-4f3d-80fc-5ce150a159d1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:29.953294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67706a82-2389-4f3d-80fc-5ce150a159d1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:30.174554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67706a82-2389-4f3d-80fc-5ce150a159d1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:30.193201 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67706a82-2389-4f3d-80fc-5ce150a159d1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1217 microversion: 2.1 time: 0.252584 Aug 25 12:40:30.198922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 753/1418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:29 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:30.219127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78289828-05fc-414b-91af-8c72870f3d3d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2625f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.367331 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-78289828-05fc-414b-91af-8c72870f3d3d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92" status: 200 len: 636 microversion: 2.1 time: 0.158381 Aug 25 12:40:30.368772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 754/1419] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:30 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92 => generated 636 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:30.381665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-edf7142c-d9d3-43b2-a179-ca97f30fff13 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25e5d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.510973 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-edf7142c-d9d3-43b2-a179-ca97f30fff13 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e" status: 200 len: 1461 microversion: 2.1 time: 0.139345 Aug 25 12:40:30.513345 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 755/1420] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:30 2022] GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e => generated 1461 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:30.538196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:30.552252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:30.576572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:30.582689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:30.589146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:30.592380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:30.593814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:30.596265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.578419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:40:31.581615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:40:31.584751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:40:31.586177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:40:31.587331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:40:31.612436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.614850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.616403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.619776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:31.622372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:31.625335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:31.688602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:31.704327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for user c6be50aac19c400cb9883fcf881ad13c and project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:31.737303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:40:31.744914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:40:31.848987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:31.910733 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ffa9e117-1a8e-456b-9001-f422cfae4091 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1505 microversion: 2.1 time: 1.391335 Aug 25 12:40:31.929606 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 756/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:30 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1505 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:31.952032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:31.953544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:31.976384 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ccc58cc7-d718-42a4-8521-5f2046cc18ed tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.123598 Aug 25 12:40:31.999846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:32.001375 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 666/1422] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:40:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:40:32.010839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:32.012537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:32.016437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:32.017903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:32.019202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:32.021834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fdc6fb4-847b-4f39-bcf6-e167dabf6ad2 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c27c6670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:32.220063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4fdc6fb4-847b-4f39-bcf6-e167dabf6ad2 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:32.251201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4fdc6fb4-847b-4f39-bcf6-e167dabf6ad2 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:33.314759 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4fdc6fb4-847b-4f39-bcf6-e167dabf6ad2 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 1.311175 Aug 25 12:40:33.315904 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 667/1423] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:40:32 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:33.334546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9366fddb-6f50-47e4-b74a-69cf819ed4e7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c27b5940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.545139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9366fddb-6f50-47e4-b74a-69cf819ed4e7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e" status: 200 len: 1461 microversion: 2.1 time: 0.211895 Aug 25 12:40:33.570240 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 668/1424] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e => generated 1461 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:33.599985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.606359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:33.631151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.641325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.646738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:33.652230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.654074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.654986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:33.683180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:33.734322 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-482d6124-4052-4e79-8cd1-37c675f2aefc tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 200 len: 1488 microversion: 2.1 time: 1.811923 Aug 25 12:40:33.735289 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 757/1425] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:31 2022] GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 1488 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:33.742723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:33.743843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:33.773359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.774702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.776007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:33.778216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:33.779636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:33.781052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.045352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:34.077048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d67383fb-9a11-4f06-9323-2cc90234e176 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1275 microversion: 2.1 time: 0.504118 Aug 25 12:40:34.078960 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 669/1426] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1275 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:34.089831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9caf7045-0a3e-4e9a-9d5b-e2fef28f458d", "name": "network-vif-unplugged", "status": "completed", "tag": "cd628230-0a07-4870-a525-92ca95349c73"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:34.118147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.119216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.120095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.142549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:34.169426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] Creating event network-vif-unplugged:cd628230-0a07-4870-a525-92ca95349c73 for instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d on n-h1-850468-18 Aug 25 12:40:34.172641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2baa1a91-81d5-4208-9b37-a337e9c4656f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1238 microversion: 2.1 time: 0.435292 Aug 25 12:40:34.198133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8f9f339a-6bc4-48c6-a0ff-9ddd404498df req-7a8e4a8e-7a63-4da4-9bde-cdb591485f70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116336 Aug 25 12:40:34.201959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 758/1427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:33 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1238 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:34.205633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 670/1428] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:34.233441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d9decd1-0e1a-4036-ba5a-4ad9ddeaa1d4 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2a298b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:34.240745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:34.242256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:34.280778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.281965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.282947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.289289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.290162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.290996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.782894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:34.817571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e503390b-ab21-41fb-ad71-708a0634f241 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 200 len: 1508 microversion: 2.1 time: 0.609398 Aug 25 12:40:34.819099 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 759/1429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:34 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:34.829528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:34.843081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:34.877911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.879526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.880691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:34.884144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:34.898786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:34.902120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.101109 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d9decd1-0e1a-4036-ba5a-4ad9ddeaa1d4 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "DELETE /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.888748 Aug 25 12:40:35.103158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 671/1430] 10.222.0.60 () {58 vars in 1296 bytes} [Thu Aug 25 12:40:34 2022] DELETE /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_version => generated 0 bytes in 897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:40:35.122388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1207616575"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:35.131227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:35.158016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:35.159109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:35.160336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.161706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:35.162512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:35.163588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.875673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25a0d6b3-a481-4902-8dac-c0017a22be5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "POST /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33/action" status: 202 len: 0 microversion: 2.1 time: 0.769677 Aug 25 12:40:35.877986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 672/1431] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:40:35 2022] POST /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:40:35.892703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:35.894886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:35.915801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:35.917727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:35.928912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.930853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:35.931997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:35.933702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:35.960427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:36.002336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c723e91-29df-4655-82ca-afdfd1032832 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1468 microversion: 2.1 time: 1.171032 Aug 25 12:40:36.003527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 760/1432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:34 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1468 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:36.011758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:40:36.012774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e90c2067-4384-4fb1-8af5-b7272e3ab3af tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2adcf70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:36.044030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.api [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Working on deleting snapshot a1abaa7f-8f9f-4c63-8eb9-adad112bca12 from shelved instance... Aug 25 12:40:36.151286 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e90c2067-4384-4fb1-8af5-b7272e3ab3af tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 37 microversion: 2.1 time: 0.145416 Aug 25 12:40:36.152405 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 761/1433] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:40:36 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 37 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:36.179448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:36.184698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:36.206367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.208022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.210182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.214695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.221452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.223067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.889493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:36.926312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f52d8bd-dbdb-4ab7-be55-7915e0407307 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1275 microversion: 2.1 time: 0.771405 Aug 25 12:40:36.932482 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 762/1434] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:36 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1275 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:36.946833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:36.958600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:36.983888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.986872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:36.994332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:36.998136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:36.999553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.002277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.681410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Doing local delete in cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122700) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 25 12:40:37.684737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.686087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.687985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.689371 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.api [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 25 12:40:37.695953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:37.702106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] deallocate_for_instance() {{(pid=122700) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 25 12:40:37.725480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-081722fc-4a21-4f49-a614-9c2bd23ff7a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1292 microversion: 2.1 time: 0.794150 Aug 25 12:40:37.727274 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 763/1435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:36 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1292 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:37.738561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9476a70-4f43-469e-b539-9752135e9d3f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2993310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:37.846868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9476a70-4f43-469e-b539-9752135e9d3f tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db" status: 200 len: 1412 microversion: 2.1 time: 0.117000 Aug 25 12:40:37.848015 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 764/1436] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:37 2022] GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:37.858779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-956662968"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:37.863687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:37.879135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.880504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.881689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:37.883295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:37.884188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:37.885292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:38.587560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a304b0da-6ccf-4bfa-91b0-1a25f896532e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "POST /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb/action" status: 202 len: 0 microversion: 2.1 time: 0.737039 Aug 25 12:40:38.600099 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 765/1437] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:40:37 2022] POST /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:40:38.634292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28421f73-5612-4746-9831-beeaf91b2c4d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c25e0820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:38.972590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-28421f73-5612-4746-9831-beeaf91b2c4d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:40:38.999263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-28421f73-5612-4746-9831-beeaf91b2c4d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:40:40.123211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28421f73-5612-4746-9831-beeaf91b2c4d tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 1.519042 Aug 25 12:40:40.124317 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 766/1438] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:40:38 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:40.148159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-unplugged", "status": "completed", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:40.205460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:40.216844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:40.218039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:40.254873 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] Creating event network-vif-unplugged:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:40:40.272619 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3e82b714-aee8-4b17-9627-26f383760b3e req-4128cbdb-29a6-415a-8917-d05ef96ce0a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146291 Aug 25 12:40:40.275613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 767/1439] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:40.289393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89f92669-7439-48b1-a8fd-f3245ea68019 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c25e6d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:40.572318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89f92669-7439-48b1-a8fd-f3245ea68019 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db" status: 200 len: 1412 microversion: 2.1 time: 0.292288 Aug 25 12:40:40.592514 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 768/1440] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:40 2022] GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db => generated 1412 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:40.607331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:40.608925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:40.635707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:40.636714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:40.638626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:40.639661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:40.640607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:40.641529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:41.666640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:41.925842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:41.970396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc2d2182-df38-4c14-96fe-eb65aab03ec7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1317 microversion: 2.1 time: 1.370079 Aug 25 12:40:41.979869 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 769/1441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:40 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1317 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:42.009644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da72908d-8382-4cd7-8f34-7206cfb7ea5e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25e50d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:42.175002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da72908d-8382-4cd7-8f34-7206cfb7ea5e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6" status: 200 len: 1452 microversion: 2.1 time: 0.190374 Aug 25 12:40:42.177208 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 770/1442] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:41 2022] GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6 => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:42.209530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:42.213014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:42.244369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.249896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.251218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:42.261394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:42.262884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:42.264080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:42.268704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:42.447614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Updating instance_info_cache with network_info: [] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 12:40:43.524342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:43.584605 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d1d2ed1-0b2c-4646-ae4f-404874a7523b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1360 microversion: 2.1 time: 1.395547 Aug 25 12:40:43.600522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 771/1443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:42 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1360 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:43.645598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee9a474a-758f-4b5a-abba-5f428f0d8331 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2a431f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:44.247170 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae3d39ec-1f7d-438a-acb5-a16c087a5ce7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 204 len: 0 microversion: 2.1 time: 8.365751 Aug 25 12:40:44.250615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 673/1444] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:40:35 2022] DELETE /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 0 bytes in 8372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:40:44.273964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d00062a2-6b1b-4769-a505-0c0f3a7ed943 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27611f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:45.812948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d00062a2-6b1b-4769-a505-0c0f3a7ed943 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db" status: 204 len: 0 microversion: 2.1 time: 1.556961 Aug 25 12:40:45.815193 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 674/1445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:44 2022] DELETE /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db => generated 0 bytes in 1564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:40:45.838275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9caf7045-0a3e-4e9a-9d5b-e2fef28f458d", "name": "network-vif-deleted", "tag": "cd628230-0a07-4870-a525-92ca95349c73"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:45.866519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee9a474a-758f-4b5a-abba-5f428f0d8331 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 2.263267 Aug 25 12:40:45.869044 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 772/1446] 10.222.0.60 () {58 vars in 1290 bytes} [Thu Aug 25 12:40:43 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_distro => generated 33 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:40:45.893135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:45.906897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:45.927242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:45.940540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:45.940540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:45.940913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:45.954587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:45.954587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:45.954587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:45.954587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:45.955304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:45.991425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.server_external_events [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] Unable to find a host for instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d. Dropping event network-vif-deleted {{(pid=122700) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 12:40:46.000359 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e1cbada4-ad04-498e-9b83-ea5a9ba25be4 req-e1609357-593c-4d74-9956-c0f433769cac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.180855 Aug 25 12:40:46.014138 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 675/1447] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 196 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 12:40:46.041605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ab2f815-033f-4b01-9ad5-9725ebc50266 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26f2e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:48.906153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:48.943474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9204853a-dec2-492d-9f21-5e5e329f46bf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1317 microversion: 2.1 time: 3.061075 Aug 25 12:40:48.963299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 773/1448] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:45 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1317 bytes in 3093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:48.993672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:49.015517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:49.050952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.052225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.055614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.062522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.066634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.068274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.077875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:49.200980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d HTTP/1.1 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:40:49.209723 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:40:49.214490 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9caf7045-0a3e-4e9a-9d5b-e2fef28f458d'} Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:40:49.217562 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:40:49.235003 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:40:49.241310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:40:49.253014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd187ec5-8869-418f-ad63-34c076120518 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 404 len: 111 microversion: 2.1 time: 0.280528 Aug 25 12:40:49.257647 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 774/1449] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:48 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:40:49.352443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:49.359582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:40:49.397788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.398307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.401235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:49.406528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:49.411050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:49.416366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:50.920964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:40:50.927398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:51.008700 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-194e4a13-fb23-4ef1-9e2c-a650c8ee6421 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1360 microversion: 2.1 time: 1.741307 Aug 25 12:40:51.036261 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 775/1450] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:40:49 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1360 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:40:51.050907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8855c71-5854-45b3-ab59-b6d1d3c5db33", "name": "network-vif-plugged", "status": "completed", "tag": "381dd6b1-1035-478b-8f23-93053594e6d1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:40:51.103394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=49 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:51.108475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:40:51.110601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:40:51.112065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:40:51.140834 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] Creating event network-vif-plugged:381dd6b1-1035-478b-8f23-93053594e6d1 for instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 on n-h2-850468-18 Aug 25 12:40:51.164087 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e5590fa4-38cc-4918-8eed-6fe6e41c9227 req-3b0a8643-c317-4d2d-a2a4-e5e865116de9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126702 Aug 25 12:40:51.172078 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 776/1451] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:40:51.196712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74385cc5-fa29-42b3-a25e-a3b724af7f5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c269ef70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:40:55.898902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:40:55.989875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:01.186342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:01.194127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:15.967045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-74385cc5-fa29-42b3-a25e-a3b724af7f5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Image not found. Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74385cc5-fa29-42b3-a25e-a3b724af7f5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db HTTP/1.1 Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:41:15.973728 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'f53603b8-e402-41fb-ba64-286bc9b798db'} Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:15.976832 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f53603b8-e402-41fb-ba64-286bc9b798db Aug 25 12:41:15.978663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:41:15.989102 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f53603b8-e402-41fb-ba64-286bc9b798db could not be found. Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:16.000808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74385cc5-fa29-42b3-a25e-a3b724af7f5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:16.003273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74385cc5-fa29-42b3-a25e-a3b724af7f5c tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db" status: 404 len: 62 microversion: 2.1 time: 24.799790 Aug 25 12:41:16.006017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 777/1452] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:51 2022] GET /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db => generated 62 bytes in 24812 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:41:16.029285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3eaa7971-38e9-4279-840f-d73f2b657773 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c2f98ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:16.258368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ab2f815-033f-4b01-9ad5-9725ebc50266 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6" status: 200 len: 1452 microversion: 2.1 time: 30.241666 Aug 25 12:41:16.274507 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 676/1453] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:40:46 2022] GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6 => generated 1452 bytes in 30259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:16.283713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-469377211", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "88522008-cbe6-46f9-95cf-76e2176a4cab"}], "block_device_mapping_v2": [{"uuid": "32064126-106d-423b-a5c3-e243ea16c7fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:16.506925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] validate_networks() for [('88522008-cbe6-46f9-95cf-76e2176a4cab', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:16.837455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3eaa7971-38e9-4279-840f-d73f2b657773 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:16.899107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3eaa7971-38e9-4279-840f-d73f2b657773 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:17.579211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3eaa7971-38e9-4279-840f-d73f2b657773 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 1.572131 Aug 25 12:41:17.602652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 778/1454] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:41:15 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:17.886211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:17.975985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:17.977547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:17.978738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:18.048191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] Creating event network-changed:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:41:18.070679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-63f83909-feee-4fa6-b994-ee8e138b8fe2 req-e9162ac0-20d7-468e-a207-21fea76cc135 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464991 Aug 25 12:41:18.072209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 779/1455] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:18.092215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-229638128", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:18.290498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:41:19.786182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:19.805554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:19.817554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:19.819557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:19.827265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:19.881277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:19.882743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:19.883944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:19.885862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:19.899384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:19.900992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:19.971364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:20.013326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Getting quotas for user 3f41f5c8cf9e4d78b4fb62eac79b093e and project 5f998a63a08d4ddfa853e64c12b2f64a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:20.287686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:20.297585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32064126-106d-423b-a5c3-e243ea16c7fc',volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:20.881199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12003542-2461-4366-bee1-e13b7c02f1e4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.597673 Aug 25 12:41:20.882498 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 677/1456] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:41:20.908062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:20.925641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:20.971216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:20.985391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:20.987205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:20.994180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:20.996998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.008071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.835019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:41:21.836320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:41:21.837461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:41:21.838296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:41:21.839342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:41:21.878931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:21.879197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.879965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.880833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.882379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.884508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:21.885886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:21.921924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-978e9eb6-7917-490b-81dc-b70d1298a55b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1317 microversion: 2.1 time: 1.030685 Aug 25 12:41:21.921924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 678/1457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:20 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1317 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:21.936332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:21.940226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:21.942152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:21.957732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:21.991625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:21.996542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:41:21.998148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.000662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.003568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.005142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.006598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.008076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:41:22.231573 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64697734-9107-477a-8a96-e64fa8b791db tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.151675 Aug 25 12:41:22.238304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 780/1458] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:41:22.516702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:22.550814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51fc4b12-92b5-4750-90bd-c10745d60415 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1360 microversion: 2.1 time: 0.620708 Aug 25 12:41:22.552952 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 679/1459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:21 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1360 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:22.573824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:22.576570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:22.595459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1cadc-61f5-4d92-b04f-0f4cd58729eb", "name": "network-vif-plugged", "status": "completed", "tag": "e417e798-1d1c-48b5-90b1-a7665079f1ea"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:22.598044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.598977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.599812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.603499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.604453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.605318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.625714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:22.626628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:22.627458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:22.708873 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] Creating event network-vif-plugged:e417e798-1d1c-48b5-90b1-a7665079f1ea for instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb on n-h2-850468-18 Aug 25 12:41:22.754628 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4f467c22-ab4f-4f93-8a76-ba7e18bf410c req-665cfbc3-9d16-469b-84bf-78cd47354c67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510174 Aug 25 12:41:22.774940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 781/1460] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:22.809947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74a5efe9-532b-437a-9d80-01bfb001ab4b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25b9790>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.047955 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74a5efe9-532b-437a-9d80-01bfb001ab4b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6" status: 200 len: 1461 microversion: 2.1 time: 0.265773 Aug 25 12:41:23.066470 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 782/1461] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:22 2022] GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6 => generated 1461 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:23.130225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d24c8a7-6efb-4d80-92eb-abb05042aa3e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c25ba280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.187216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6121e19dc50b45ca979df57e9e0b48ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5e2b04f8e64966b5d3487c30894d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:23.232258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6847a420-602a-4c83-97a8-9b0f10c03561 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 200 len: 1488 microversion: 2.1 time: 0.674197 Aug 25 12:41:23.253175 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 680/1462] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:22 2022] GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 1488 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:23.285723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:23.361712 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d24c8a7-6efb-4d80-92eb-abb05042aa3e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.267917 Aug 25 12:41:23.363525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.366108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.367530 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 783/1463] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:23.373171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.409191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.410680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:23.462157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.463599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.464213 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] Creating event network-changed:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h1-850468-18 Aug 25 12:41:23.466029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.468142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.469719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.472795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.502601 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a7ce20fb-6b58-4d42-95c3-a1f319cd5051 req-dda038d2-de0e-4c78-8429-62042591f90c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244755 Aug 25 12:41:23.519781 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 681/1464] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:23.547163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c62c2dd2-d4e5-4316-a0f5-356e61819acc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.549287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c62c2dd2-d4e5-4316-a0f5-356e61819acc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:23.787717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c62c2dd2-d4e5-4316-a0f5-356e61819acc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:23.828447 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c62c2dd2-d4e5-4316-a0f5-356e61819acc tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1214 microversion: 2.1 time: 0.297960 Aug 25 12:41:23.831601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 682/1465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:23.850970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:23.857368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:23.888877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.905558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.908941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.915398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:23.919636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:23.922982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:23.948013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:24.013196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:24.018439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:24.033793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1504bf3-f21b-444a-b5ea-3bb2296f849b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1176 microversion: 2.25 time: 0.664211 Aug 25 12:41:24.040516 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 784/1466] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1176 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:24.064586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2af49739-ef58-4aa8-972e-f72f28350a6e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2625ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.256821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2af49739-ef58-4aa8-972e-f72f28350a6e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6" status: 200 len: 1461 microversion: 2.1 time: 0.213413 Aug 25 12:41:24.282121 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 785/1467] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:24 2022] GET /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6 => generated 1461 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:24.303532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:24.305503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:24.335582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.337662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.339099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.343682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:24.346911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:24.350431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:24.514640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:41:24.938609 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-469ef7b5-e714-499e-bf3a-7dbc18c905ad tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 204 len: 0 microversion: 2.1 time: 0.652936 Aug 25 12:41:24.941085 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 786/1468] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:24 2022] DELETE /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:41:24.958205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8abc3add-b017-47a2-86e9-165e9e384699 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c25b9820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:25.165557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8abc3add-b017-47a2-86e9-165e9e384699 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:25.194638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8abc3add-b017-47a2-86e9-165e9e384699 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:25.651557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8abc3add-b017-47a2-86e9-165e9e384699 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 0.707173 Aug 25 12:41:25.654238 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 787/1469] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:41:24 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:25.673833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:25.680092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:25.696309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.697670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.699948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.702003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:25.705532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:25.706972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:25.991138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:26.016088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea245a9d-67cd-49aa-bdb2-c65f7d37cf3c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1317 microversion: 2.1 time: 2.181838 Aug 25 12:41:26.025579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 683/1470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:23 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1317 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:26.043963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:26.052755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:26.062991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.064641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.065412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.066466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.067410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.068451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:26.727191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:26.780106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43350913-24c2-4128-9bf2-caa4674366cd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1360 microversion: 2.1 time: 1.119978 Aug 25 12:41:26.804166 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 788/1471] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:25 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1360 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:26.866894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-plugged", "status": "completed", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}, {"server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}, {"server_uuid": "a0a1cadc-61f5-4d92-b04f-0f4cd58729eb", "name": "network-vif-unplugged", "status": "completed", "tag": "e417e798-1d1c-48b5-90b1-a7665079f1ea"}, {"server_uuid": "f8855c71-5854-45b3-ab59-b6d1d3c5db33", "name": "network-vif-unplugged", "status": "completed", "tag": "381dd6b1-1035-478b-8f23-93053594e6d1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:26.940519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:26.941680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:26.942491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.101489 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Creating event network-vif-plugged:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:41:27.102888 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Creating event network-vif-plugged:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h1-850468-18 Aug 25 12:41:27.125609 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Creating event network-vif-unplugged:e417e798-1d1c-48b5-90b1-a7665079f1ea for instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb on n-h2-850468-18 Aug 25 12:41:27.132567 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] Creating event network-vif-unplugged:381dd6b1-1035-478b-8f23-93053594e6d1 for instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 on n-h2-850468-18 Aug 25 12:41:27.249796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-28b81e35-f3f8-4024-825c-29fa69952d9c req-1e51f549-6157-4763-a87b-62e28a09db1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.432947 Aug 25 12:41:27.253866 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 789/1472] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:27.297287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:27.302085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:27.360627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.366517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.369247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.389039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.389993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.390788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.493322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:27.530395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a95b137-df97-4265-974a-e7b78a0e2fa3 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1468 microversion: 2.1 time: 1.502375 Aug 25 12:41:27.545256 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 684/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:26 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1468 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:27.575923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc438350-a24c-4ee8-aa4d-593027fb1eed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c36bbf70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:27.716280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-cc438350-a24c-4ee8-aa4d-593027fb1eed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Image not found. Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc438350-a24c-4ee8-aa4d-593027fb1eed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db HTTP/1.1 Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:41:27.772079 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f53603b8-e402-41fb-ba64-286bc9b798db'} Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:27.775346 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f53603b8-e402-41fb-ba64-286bc9b798db to delete Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.779675 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f53603b8-e402-41fb-ba64-286bc9b798db could not be found. Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:27.784249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:41:27.791141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:27.795338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc438350-a24c-4ee8-aa4d-593027fb1eed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:27.795338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc438350-a24c-4ee8-aa4d-593027fb1eed tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db" status: 404 len: 62 microversion: 2.1 time: 0.247431 Aug 25 12:41:27.796551 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 685/1474] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:27 2022] DELETE /compute/v2.1/images/f53603b8-e402-41fb-ba64-286bc9b798db => generated 62 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:41:27.831267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:27.839022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:27.908948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.909919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.924234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:27.926375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:27.932920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:27.933809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:28.417878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.448019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96d2e503-6375-4a67-915f-e1ae152b8882 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1266 microversion: 2.1 time: 1.191271 Aug 25 12:41:28.497379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 790/1475] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:27 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1266 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:28.544725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9cde4cd-9ce6-485e-8112-309ff8d1ccb3 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c2663790>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:28.774170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e9cde4cd-9ce6-485e-8112-309ff8d1ccb3 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:28.798400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e9cde4cd-9ce6-485e-8112-309ff8d1ccb3 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:28.838268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.891076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.923596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:28.937451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd799f42-a239-4890-8e89-4172351d13fc tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1250 microversion: 2.25 time: 1.135058 Aug 25 12:41:28.945234 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 686/1476] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:27 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1250 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:28.977634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:28.984911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:29.031054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:29.034361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:29.037800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:29.041850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:29.046290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:29.047302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:29.934910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:30.115995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9cde4cd-9ce6-485e-8112-309ff8d1ccb3 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 64 microversion: 2.1 time: 1.615735 Aug 25 12:41:30.117357 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 791/1477] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:41:28 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 64 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:30.131220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2024754841"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:30.138139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:30.152669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.154213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.156739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:30.158776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:30.160236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:30.161511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.003735 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee02d5c9-414c-46df-8ed5-863954c3d490 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "POST /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808/action" status: 202 len: 0 microversion: 2.1 time: 0.882227 Aug 25 12:41:31.013839 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 792/1478] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:41:30 2022] POST /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:41:31.024637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:31.036943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:31.039274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:31.064241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d53a9c1-97c8-48ec-bbc2-39c75f05c9bb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1317 microversion: 2.1 time: 2.115895 Aug 25 12:41:31.066911 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 687/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:28 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1317 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:31.087899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.089486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.109448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.111456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.126442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.127564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:31.128221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:31.129443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.150743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.151689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.156648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.160009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.163011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.165028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.207304 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 HTTP/1.1 Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:41:31.223391 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:31.226147 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'f8855c71-5854-45b3-ab59-b6d1d3c5db33'} Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:31.228053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:31.229958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:31.232831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:31.234817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c20a6e3-c2e5-46b3-b811-960d5db36ba9 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 404 len: 111 microversion: 2.1 time: 0.217912 Aug 25 12:41:31.239385 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 793/1480] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:31 2022] DELETE /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:31.254499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8855c71-5854-45b3-ab59-b6d1d3c5db33", "name": "network-vif-deleted", "tag": "381dd6b1-1035-478b-8f23-93053594e6d1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:31.314443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.315988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.317192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.345261 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] Creating event network-vif-deleted:381dd6b1-1035-478b-8f23-93053594e6d1 for instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 on n-h2-850468-18 Aug 25 12:41:31.355480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cd98a04e-8cdc-47af-b568-e943143a4a4c req-79fcaf81-eddb-481d-88b2-bcc353e3027e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116492 Aug 25 12:41:31.362006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 794/1481] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:31.372895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:31.374225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:31.388368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.389334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.390190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.391636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.392850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.408246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.750852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:31.786725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae3f69cb-50c0-40fc-9344-9de9f567727c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1272 microversion: 2.1 time: 0.422456 Aug 25 12:41:31.796337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 795/1482] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:31 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:31.818373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:31.819532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:31.846407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.847294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.848085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.861850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:31.862818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:31.864102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:31.912064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:32.486991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:32.526775 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a94ed3e0-fa40-43ac-b99d-a77b8f15bbb7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1360 microversion: 2.1 time: 1.424907 Aug 25 12:41:32.529334 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 688/1483] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:31 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1360 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:32.570245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0af3526f-37be-44a6-9906-5d609e2f2c24 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2929160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:32.815870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0af3526f-37be-44a6-9906-5d609e2f2c24 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 64 microversion: 2.1 time: 0.235116 Aug 25 12:41:32.819204 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 689/1484] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:41:32 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 64 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:32.849024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0a6abf0-98b6-420b-8178-c7ec215c28f0 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26f2dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:33.006829 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0a6abf0-98b6-420b-8178-c7ec215c28f0 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 200 len: 1453 microversion: 2.1 time: 0.177600 Aug 25 12:41:33.009013 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 690/1485] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:32 2022] GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:33.020862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:33.022829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: f8855c71-5854-45b3-ab59-b6d1d3c5db33] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:33.038835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.041406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.044010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.046008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.047380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.048518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.102986 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 HTTP/1.1 Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:41:33.109042 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:33.114329 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f8855c71-5854-45b3-ab59-b6d1d3c5db33'} Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:33.117327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. Aug 25 12:41:33.122550 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:33.133569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance f8855c71-5854-45b3-ab59-b6d1d3c5db33 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:33.133569 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8df1261-9f61-4253-8a3e-5417056c875e tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33" status: 404 len: 111 microversion: 2.1 time: 0.117696 Aug 25 12:41:33.133569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 691/1486] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:33 2022] GET /compute/v2.1/servers/f8855c71-5854-45b3-ab59-b6d1d3c5db33 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:33.159932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:33.161604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:33.173550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.174725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.175703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.184341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.184341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.184341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.193022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:33.226363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:33.232330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:33.247378 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d85284d-ab78-4dcc-8446-607a96c4ac11 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1292 microversion: 2.25 time: 1.456592 Aug 25 12:41:33.259287 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 796/1487] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:31 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1292 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:33.298350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:33.300491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:33.314581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.315974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.317121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.318797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:33.320621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:33.321842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:33.684678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:33.718645 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21f4a69a-78f0-4762-9e97-38d4b8652f8c tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1272 microversion: 2.1 time: 0.456626 Aug 25 12:41:33.736748 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 797/1488] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:33 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1272 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:33.756535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8bb95b7a-066e-41b4-aca4-01d55daa745c tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c2663040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:33.804289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:33.909698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8bb95b7a-066e-41b4-aca4-01d55daa745c tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:33.927291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8bb95b7a-066e-41b4-aca4-01d55daa745c tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:34.130618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:34.171968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40033cd6-821c-435d-8bb1-7ef1d38391c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1466 microversion: 2.1 time: 1.038934 Aug 25 12:41:34.173711 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 692/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:33 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1466 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:34.186048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c03ffc91-033a-4294-8c63-80a47498da68 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c27be8b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:34.349182 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c03ffc91-033a-4294-8c63-80a47498da68 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Image not found. Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c03ffc91-033a-4294-8c63-80a47498da68 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 HTTP/1.1 Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:41:34.371608 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'b3b9803b-89f3-4461-94f9-88e0a407a0f3'} Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:34.375411 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3b9803b-89f3-4461-94f9-88e0a407a0f3 to delete Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.380050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3b9803b-89f3-4461-94f9-88e0a407a0f3 could not be found. Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:34.387791 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:41:34.398122 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:34.405454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c03ffc91-033a-4294-8c63-80a47498da68 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:34.411751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c03ffc91-033a-4294-8c63-80a47498da68 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3" status: 404 len: 62 microversion: 2.1 time: 0.234669 Aug 25 12:41:34.415809 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 693/1490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:34 2022] DELETE /compute/v2.1/images/b3b9803b-89f3-4461-94f9-88e0a407a0f3 => generated 62 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:41:34.472953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:34.474254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:34.504316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:34.505278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:34.506203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:34.513960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:34.514906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:34.515733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.182292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8bb95b7a-066e-41b4-aca4-01d55daa745c tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 1.443116 Aug 25 12:41:35.184053 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 798/1491] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:41:33 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:35.225832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa668957-100f-4814-90f1-2ee3a6ad67ec tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c269ef70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:35.413565 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa668957-100f-4814-90f1-2ee3a6ad67ec tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 200 len: 1453 microversion: 2.1 time: 0.227200 Aug 25 12:41:35.414730 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 799/1492] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:35 2022] GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:35.448549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-748010809", "metadata": {"image_type": "test"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:35.454729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:35.468828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.470277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.471564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.473394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:35.475745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:35.475745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:35.657237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Getting quotas for project d4c7847d95af4a5dbb8b469099b37bba. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:35.687775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Getting quotas for user c293b8d9fbef415dbc73654bf2d2a7ba and project d4c7847d95af4a5dbb8b469099b37bba. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:35.895896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:35.939668 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9c0cd50-02c6-41c3-8391-eeb5b1f2ff11 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1543 microversion: 2.1 time: 1.490756 Aug 25 12:41:35.952775 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 694/1493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:34 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1543 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:35.983472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:35.989721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:36.018659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.019995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.021181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.025858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:36.028040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:36.035563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:36.939855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1cd49c0c-770c-4306-af78-f2b60cc079c5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "POST /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a/action" status: 202 len: 0 microversion: 2.1 time: 1.490719 Aug 25 12:41:36.953610 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 800/1494] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:41:35 2022] POST /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a/action => generated 0 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:41:37.031225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:37.050425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:37.108297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.111764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.113029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.117067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.125613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.130129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.219535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 HTTP/1.1 Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:41:37.228386 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:37.233305 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760'} Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:37.235663 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:37.241434 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:37.251478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:37.253838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6f8e604e-ad98-4c7a-9c53-193b48492067 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 404 len: 111 microversion: 2.1 time: 0.296579 Aug 25 12:41:37.256609 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 801/1495] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:36 2022] DELETE /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:37.274132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:37.275947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:37.306008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.306399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.307076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.308581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:37.309463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:37.328620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:37.356979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:38.904181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.970688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.979525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:38.993613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7da45fb6-1abb-48d5-bf11-fd7274bc93e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1292 microversion: 2.25 time: 3.037617 Aug 25 12:41:38.994900 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 695/1496] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:35 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1292 bytes in 3042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:39.021451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b8ab2b9-c25e-49fc-acb5-42f5b5654f25 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update', calling method: .version_select at 0x7fc6c2b234c0>, body: {"meta": {"os_version": "alt"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:39.218815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:39.250411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96136ac2-1ef5-4a21-8fff-919e5d9e06f3 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1314 microversion: 2.1 time: 1.991595 Aug 25 12:41:39.257535 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 802/1497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:37 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1314 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:39.276102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:39.282671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:39.314351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:39.322213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:39.323535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:39.327634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:39.328996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:39.330718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:40.893604 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22b859de-8a59-421e-9c00-0ab0fb5eb47a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.634091 Aug 25 12:41:40.895288 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 803/1498] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:41:39 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-interface => generated 284 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:40.905615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8d93114-5702-41c3-8871-9da5d2997d69 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25e6310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:43.946910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=22 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:46.017751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:48.925046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=72 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:49.296367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:49.467967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:41:57.174110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7b8ab2b9-c25e-49fc-acb5-42f5b5654f25 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:57.174999 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8d93114-5702-41c3-8871-9da5d2997d69 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 200 len: 1453 microversion: 2.1 time: 16.276603 Aug 25 12:41:57.190954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7b8ab2b9-c25e-49fc-acb5-42f5b5654f25 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:57.210234 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 804/1499] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:40 2022] GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 1453 bytes in 16314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:57.220354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d5cdd27-fb5e-4a3e-a232-1469635ccab4 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2993310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:57.687958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d5cdd27-fb5e-4a3e-a232-1469635ccab4 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.475822 Aug 25 12:41:57.689664 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 805/1500] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:57 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:57.707318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:57.708436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:57.730856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.731595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.732247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:57.733209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.734019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.734795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:57.758982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 HTTP/1.1 Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:41:57.763217 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:57.766865 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760'} Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:57.769914 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. Aug 25 12:41:57.773147 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:41:57.775930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance 9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:57.775930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0b531fe-55af-475b-9521-da6d89b44a71 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760" status: 404 len: 111 microversion: 2.1 time: 0.075990 Aug 25 12:41:57.775930 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 806/1501] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:57 2022] GET /compute/v2.1/servers/9bcc6894-0e2b-49e6-ae2d-1ebabd6f8760 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:57.785119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-plugged", "status": "completed", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:57.800508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.801390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.802250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:57.827553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] Creating event network-vif-plugged:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:41:57.835263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c9580989-dce5-49fe-9176-fd448364f175 req-f8f32c69-a693-4f43-bd6e-41f595353965 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058877 Aug 25 12:41:57.836831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 807/1502] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:57.846129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:57.847459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:57.859410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.860250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.861533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:57.862952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:57.863768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:57.864334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.131512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:58.150192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:58.154428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:58.156962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2170aba4-4bea-4843-b434-279e05198738 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1280 microversion: 2.25 time: 0.318206 Aug 25 12:41:58.158122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 808/1503] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:57 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:41:58.171643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:58.178350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:58.198258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.200084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.201308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.202724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.203761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.204636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.556649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:41:58.590157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd3a0ed3-45ab-4bf8-aca1-a4e2e560dd23 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1314 microversion: 2.1 time: 0.428118 Aug 25 12:41:58.591188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b8ab2b9-c25e-49fc-acb5-42f5b5654f25 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 19.588916 Aug 25 12:41:58.592381 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 809/1504] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:58 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:58.600375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3dcc6f-b789-4189-a00f-c87af6921f45", "tag": "ffbaa69c-ea08-4665-97ef-e3a08231bc92"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:58.611532 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 696/1505] 10.222.0.60 () {60 vars in 1313 bytes} [Thu Aug 25 12:41:38 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata/os_version => generated 31 bytes in 19613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:58.627936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.629372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.630488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.658689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] Creating event network-changed:ffbaa69c-ea08-4665-97ef-e3a08231bc92 for instance bd3dcc6f-b789-4189-a00f-c87af6921f45 on n-h2-850468-18 Aug 25 12:41:58.675514 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ce946e9b-2e26-4c6a-8323-8250f0bdb26c req-d5df79de-49b6-4cdc-a696-afb5899823f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081247 Aug 25 12:41:58.676895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 810/1506] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:58.811972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:58.833412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:58.834845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:58.836782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:58.860832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] Creating event network-changed:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h1-850468-18 Aug 25 12:41:58.878548 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3389a27d-f727-491e-abcb-9b650480cb8e req-1b10c881-aa21-4233-a68a-d294420b686f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263614 Aug 25 12:41:58.881827 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 697/1507] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:58.898967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4c386cd-b964-480d-8dc0-d75ecd64b8be tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c2815280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:58.971156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c4c386cd-b964-480d-8dc0-d75ecd64b8be tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Image not found. Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4c386cd-b964-480d-8dc0-d75ecd64b8be tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 HTTP/1.1 Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:41:58.976615 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '39415318-66dd-4bd9-a67a-21fa87acbe61'} Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:58.981066 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 39415318-66dd-4bd9-a67a-21fa87acbe61 to delete Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.983012 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 39415318-66dd-4bd9-a67a-21fa87acbe61 could not be found. Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:58.986317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4c386cd-b964-480d-8dc0-d75ecd64b8be tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:58.994485 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4c386cd-b964-480d-8dc0-d75ecd64b8be tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61" status: 404 len: 62 microversion: 2.1 time: 0.090151 Aug 25 12:41:58.997683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d81adefb-a8c7-43fa-82ae-2a501d243b14 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Action: 'create', calling method: .version_select at 0x7fc6c25e6dc0>, body: {"keypair": {"name": "tempest-keypair-1048163009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3llujnOU0rqGDfyjKNxVqMphPwgJgn0wGv1uoZ73+rx7MQs0l2thsKn5HaHADsvm68UmYVGIaI74/iJug3Pa62qEfJOAvL1YvoUOtp4tB2PZ0L37M/7AvQkhuM6XKydg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:58.997824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 698/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:41:58 2022] DELETE /compute/v2.1/images/39415318-66dd-4bd9-a67a-21fa87acbe61 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:41:59.004761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db23cd76-5ec9-4361-a385-a10a98ffc9a9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c3104550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.048830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d81adefb-a8c7-43fa-82ae-2a501d243b14 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Getting quotas for project a0bb85d78d22495b99ddd9a1c4efff22. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:59.066428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d81adefb-a8c7-43fa-82ae-2a501d243b14 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Getting quotas for user 0c22ede4a9de4abc9606e234a210d8a1 and project a0bb85d78d22495b99ddd9a1c4efff22. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:41:59.124507 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db23cd76-5ec9-4361-a385-a10a98ffc9a9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 200 len: 1462 microversion: 2.1 time: 0.131315 Aug 25 12:41:59.132220 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 699/1509] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:58 2022] GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:59.164712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6f3cddb-6f16-4993-bb26-a4516083e275 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c2815e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.193799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d81adefb-a8c7-43fa-82ae-2a501d243b14 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507751 Aug 25 12:41:59.211581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 811/1510] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:41:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:41:59.225573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-641f11e3-9156-4656-b20f-99d96022861b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c271fee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.442935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6f3cddb-6f16-4993-bb26-a4516083e275 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 58 microversion: 2.1 time: 0.307729 Aug 25 12:41:59.448307 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 700/1511] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:41:59 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 58 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:41:59.452077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-641f11e3-9156-4656-b20f-99d96022861b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.243073 Aug 25 12:41:59.454781 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 812/1512] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:59 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:59.470391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73b3cf5d-1cfc-40c3-a913-95258606d545 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2993310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.483939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.488451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:59.518875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.520436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.522796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.526730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.528626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.530032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.569861 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db HTTP/1.1 Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:41:59.575409 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:41:59.579140 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'be789428-d425-4afe-bdca-ebcc51da83db'} Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:41:59.582362 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:41:59.587497 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:41:59.595104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:41:59.599318 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9af6811a-9acf-4b44-9c17-17ea55388efd tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 404 len: 111 microversion: 2.1 time: 0.146338 Aug 25 12:41:59.607681 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 701/1513] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:41:59 2022] DELETE /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:41:59.613104 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73b3cf5d-1cfc-40c3-a913-95258606d545 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 200 len: 1462 microversion: 2.1 time: 0.151338 Aug 25 12:41:59.614171 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 813/1514] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:41:59 2022] GET /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 1462 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:41:59.623768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:41:59.626056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:41:59.644595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97b23a6f-8036-4cca-a007-fff14c55a730 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'update_all', calling method: .version_select at 0x7fc6c269e280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:41:59.664677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.665537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.666262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.669810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:41:59.673998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:41:59.674493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:41:59.848562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-97b23a6f-8036-4cca-a007-fff14c55a730 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:41:59.862280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-97b23a6f-8036-4cca-a007-fff14c55a730 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:00.816061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97b23a6f-8036-4cca-a007-fff14c55a730 tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 61 microversion: 2.1 time: 1.184869 Aug 25 12:42:00.826887 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 814/1515] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:41:59 2022] PUT /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 61 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:42:00.836721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:00.838597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: be789428-d425-4afe-bdca-ebcc51da83db] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:00.865092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.872660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:00.872660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:00.878304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:00.879692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:00.880586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:00.885656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:00.928667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.945052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:00.949201 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0dbd1310-b8d4-4036-bdf6-4743908c0b6d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1280 microversion: 2.25 time: 1.337631 Aug 25 12:42:00.951821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:42:00.952703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 702/1516] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:41:59 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1280 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db HTTP/1.1 Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:00.956170 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:42:00.959270 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'be789428-d425-4afe-bdca-ebcc51da83db'} Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:00.960963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. Aug 25 12:42:00.963667 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:00.972452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance be789428-d425-4afe-bdca-ebcc51da83db could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:00.972452 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e0d55f9-5fc5-40b7-914f-9dda4a563798 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db" status: 404 len: 111 microversion: 2.1 time: 0.131264 Aug 25 12:42:00.972452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 815/1517] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:00 2022] GET /compute/v2.1/servers/be789428-d425-4afe-bdca-ebcc51da83db => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:00.982388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:00.983900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:00.992065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:00.999780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:01.033577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.037482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.038175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.038432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.039725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:01.048255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.049978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.051194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:01.052402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:01.052920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:01.065402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:01.066205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.084735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:02.125179 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a516fc72-3ede-42b4-91eb-8f99b618c672 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1468 microversion: 2.1 time: 1.165161 Aug 25 12:42:02.132717 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 703/1518] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:00 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1468 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:02.158486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-plugged", "status": "completed", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}, {"server_uuid": "aedbee79-3926-4601-aa94-f0b5565739bb", "name": "network-vif-plugged", "status": "completed", "tag": "7016d95d-df6c-4ffc-91e9-761ee8729826"}, {"server_uuid": "bd3dcc6f-b789-4189-a00f-c87af6921f45", "name": "network-vif-plugged", "status": "completed", "tag": "ffbaa69c-ea08-4665-97ef-e3a08231bc92"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:02.213817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.214994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.219166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:02.232853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.243815 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d3b20c9-8069-44e4-b40e-76309d625254 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1314 microversion: 2.1 time: 1.273229 Aug 25 12:42:02.258868 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 816/1519] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:00 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1314 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:02.271869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca93153b-09e6-4f1d-8e75-add98fa2f022 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c269e9d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:02.315443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Creating event network-vif-plugged:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:42:02.317273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Creating event network-vif-plugged:7016d95d-df6c-4ffc-91e9-761ee8729826 for instance aedbee79-3926-4601-aa94-f0b5565739bb on n-h2-850468-18 Aug 25 12:42:02.325246 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] Creating event network-vif-plugged:ffbaa69c-ea08-4665-97ef-e3a08231bc92 for instance bd3dcc6f-b789-4189-a00f-c87af6921f45 on n-h2-850468-18 Aug 25 12:42:02.375093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-979ba2c9-4115-42fb-b4bf-1ea664653819 req-8ca4e6a6-313e-47e9-9cba-00e36b0b9b0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.239606 Aug 25 12:42:02.385483 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 704/1520] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:02.423145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aedbee79-3926-4601-aa94-f0b5565739bb", "tag": "7016d95d-df6c-4ffc-91e9-761ee8729826"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:02.477428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.484319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.488337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.493339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca93153b-09e6-4f1d-8e75-add98fa2f022 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.232287 Aug 25 12:42:02.496224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 817/1521] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:02 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:02.532218 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] Creating event network-changed:7016d95d-df6c-4ffc-91e9-761ee8729826 for instance aedbee79-3926-4601-aa94-f0b5565739bb on n-h2-850468-18 Aug 25 12:42:02.533874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-828c4b3b-b904-476c-b15b-e284971a169e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Action: 'create', calling method: .version_select at 0x7fc6c2585c10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:02.566956 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d7c66012-9473-4249-9e82-9ebcd6f511c7 req-b3983ed6-d38c-4214-9203-486a631951f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178250 Aug 25 12:42:02.572637 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 705/1522] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:02.597238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab88044c-ed28-4b93-83e5-96980e1b2e05 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '.version_select at 0x7fc6c30944c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:02.704674 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ab88044c-ed28-4b93-83e5-96980e1b2e05 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Image not found. Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab88044c-ed28-4b93-83e5-96980e1b2e05 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef HTTP/1.1 Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:02.710136 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1a33fcc1-744f-4f03-9f47-574d30e734ef'} Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:02.713117 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a33fcc1-744f-4f03-9f47-574d30e734ef to delete Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.715499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a33fcc1-744f-4f03-9f47-574d30e734ef could not be found. Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:02.718052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab88044c-ed28-4b93-83e5-96980e1b2e05 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:02.724884 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab88044c-ed28-4b93-83e5-96980e1b2e05 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef" status: 404 len: 62 microversion: 2.1 time: 0.147918 Aug 25 12:42:02.737826 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 706/1523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:02 2022] DELETE /compute/v2.1/images/1a33fcc1-744f-4f03-9f47-574d30e734ef => generated 62 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:02.766462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:02.768108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:02.791553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.793008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.794605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.795450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:02.796345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:02.797095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:02.867854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-828c4b3b-b904-476c-b15b-e284971a169e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:02.893926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-828c4b3b-b904-476c-b15b-e284971a169e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Getting quotas for user fb69e05c69294f02aa15322de026d19b and project 115b44e80f054192b73f9603e1b31266. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:03.389393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.411055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.414933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:03.418937 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ba53394-06c9-4a4c-b640-e09e261d6fed tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1280 microversion: 2.25 time: 0.675884 Aug 25 12:42:03.436164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 707/1524] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:02 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1280 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:03.453212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f23f3ef9-1c20-4ea9-8f6a-f0146e80a39f tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2f84dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:03.857897 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-828c4b3b-b904-476c-b15b-e284971a169e tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "POST /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 85 microversion: 2.1 time: 1.359158 Aug 25 12:42:03.858958 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 818/1525] 10.222.0.60 () {60 vars in 1281 bytes} [Thu Aug 25 12:42:02 2022] POST /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 85 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:42:03.886755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:03.887663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:03.941563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.942408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.943181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.944569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:03.945392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:03.946148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:03.961826 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f23f3ef9-1c20-4ea9-8f6a-f0146e80a39f tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?changes-since=2022-08-25T12%3A38%3A46Z" status: 200 len: 2327 microversion: 2.1 time: 0.519775 Aug 25 12:42:03.977451 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 708/1526] 10.222.0.60 () {58 vars in 1199 bytes} [Thu Aug 25 12:42:03 2022] GET /compute/v2.1/images?changes-since=2022-08-25T12%3A38%3A46Z => generated 2327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:03.994746 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.001684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.003977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 HTTP/1.1 Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:04.018205 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.022400 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e5359d43-a53b-4c4b-9de0-5e522e23afc1'} Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:04.024188 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.030301 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.040807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:04.040807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45a114de-eee8-4626-a570-5016efe576ef tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 404 len: 111 microversion: 2.1 time: 0.159873 Aug 25 12:42:04.040807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 819/1527] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:03 2022] DELETE /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:04.041830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-040e0916-ab25-4a63-abb0-34c34197a976 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c270a820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.046984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.049021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.050971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.055114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.057050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.058591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.252691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-040e0916-ab25-4a63-abb0-34c34197a976 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.221314 Aug 25 12:42:04.266406 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 820/1528] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:04 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:04.275369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dbb17754-2e66-4d67-bd01-7487cf2490ed tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] Calling method '.version_select at 0x7fc6c25b9670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.375750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dbb17754-2e66-4d67-bd01-7487cf2490ed tempest-ImagesMetadataTestJSON-192035641 tempest-ImagesMetadataTestJSON-192035641-project] 10.222.0.60 "GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata" status: 200 len: 85 microversion: 2.1 time: 0.106642 Aug 25 12:42:04.377278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 821/1529] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:42:04 2022] GET /compute/v2.1/images/51a23437-b24f-4623-af87-bcebde891e92/metadata => generated 85 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:42:04.408249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-262872a3-1d3c-47f2-9344-45b724ebe6f4 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c271fdc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.500095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:04.533238 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ea63634-ef39-4223-8759-cf97ad6a6bf8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1314 microversion: 2.1 time: 0.543517 Aug 25 12:42:04.535831 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 709/1530] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:03 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:04.565852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:04.567572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] [instance: e5359d43-a53b-4c4b-9de0-5e522e23afc1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:04.602571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.603993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.607264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.610971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:04.617103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:04.622073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:04.731212 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] HTTP exception thrown: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Request method failure captured: Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 HTTP/1.1 Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2w5czaV4Id4bZXTVj6Cav0EcZSyP72doPxylW7GT5NMc0z7GPnw7_Jxq6MHskwNOpbkS6rhVUuDOw9CHq10L4JRwKjj20WBZRD_qZgtza5P53l-10OkOJNfUxtcRvAIH0T2zrrpmw1_glw4II3_PvyBeY93wDycQ3prwH9at8RT_As Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:04.745310 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2f5e2b04f8e64966b5d3487c30894d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2f5e2b04f8e64966b5d3487c30894d0b Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesTestJSON-421870951 Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6121e19dc50b45ca979df57e9e0b48ea Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesTestJSON-421870951-project Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.749366 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'e5359d43-a53b-4c4b-9de0-5e522e23afc1'} Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:04.751028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. Aug 25 12:42:04.755846 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:04.765292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] Returning 404 to user: Instance e5359d43-a53b-4c4b-9de0-5e522e23afc1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:04.765292 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6fa11bf1-6e09-4218-9ed6-3f2486424938 tempest-ImagesTestJSON-421870951 tempest-ImagesTestJSON-421870951-project] 10.222.0.60 "GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1" status: 404 len: 111 microversion: 2.1 time: 0.222521 Aug 25 12:42:04.773152 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 710/1531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:04 2022] GET /compute/v2.1/servers/e5359d43-a53b-4c4b-9de0-5e522e23afc1 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:04.791245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1931612885", "imageRef": "46d3ac31-1f1d-4ed2-8394-466bbf68e904", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2ec5e8ca-b3f5-4e90-86f8-c7d08a258ce2"}], "security_groups": [{"name": "tempest-securitygroup--1808515355"}], "key_name": "tempest-keypair-1048163009", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:05.609195 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-262872a3-1d3c-47f2-9344-45b724ebe6f4 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-23803505" status: 200 len: 483 microversion: 2.1 time: 1.229106 Aug 25 12:42:05.610029 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 822/1532] 10.222.0.60 () {58 vars in 1227 bytes} [Thu Aug 25 12:42:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-23803505 => generated 483 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:05.652650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-unplugged", "status": "completed", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:05.736251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:05.738457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:05.741268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:05.793692 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] Creating event network-vif-unplugged:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:42:05.805606 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1074657f-96de-49da-a3bc-15d159c5b68a req-df7dff1f-1f1d-4cf3-9797-6ed2b1446b6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172098 Aug 25 12:42:05.807134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 823/1533] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:05.818410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:05.819729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:05.835108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:05.837478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:05.842448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:05.848413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:05.849385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:05.850176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:06.424604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] validate_networks() for [('2ec5e8ca-b3f5-4e90-86f8-c7d08a258ce2', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:07.019174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:07.088767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:07.110706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:07.112902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64db35cd-9d0f-4679-b12a-ccc5aeb9047d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1476 microversion: 2.25 time: 1.303053 Aug 25 12:42:07.114534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 824/1534] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:05 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1476 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:07.124007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6aad69a4-4ba5-4775-99be-fd98b578d57f tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2674550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:07.213749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:07.259680 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6aad69a4-4ba5-4775-99be-fd98b578d57f tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.141051 Aug 25 12:42:07.274985 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 825/1535] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:07 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:07.288475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:07.291327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:07.318136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:07.320093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:07.322464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:07.326162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:07.328272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:07.329559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.161973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:08.193595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce6031ae-1ba5-4702-ae88-85540ba17f2f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1502 microversion: 2.1 time: 0.914465 Aug 25 12:42:08.194588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 826/1536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:07 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1502 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:08.213727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a94fd9c-b33b-490b-ba16-3235ebee8cd9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2adcf70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:08.459221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a94fd9c-b33b-490b-ba16-3235ebee8cd9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?server=1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 957 microversion: 2.1 time: 0.252957 Aug 25 12:42:08.460304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 827/1537] 10.222.0.60 () {58 vars in 1209 bytes} [Thu Aug 25 12:42:08 2022] GET /compute/v2.1/images?server=1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 957 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:08.477933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:08.485822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:08.507977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.509752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.511526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.513206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.515222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.516939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.545562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:08.547428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:08.548510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:08.549352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:08.550212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:08.594056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.595752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.597497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.600065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.602048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.603255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:08.660424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Getting quotas for project a0bb85d78d22495b99ddd9a1c4efff22. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:08.674851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Getting quotas for user 0c22ede4a9de4abc9606e234a210d8a1 and project a0bb85d78d22495b99ddd9a1c4efff22. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:08.721090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:08.727344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46d3ac31-1f1d-4ed2-8394-466bbf68e904',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:08.918687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acd83453-e20a-44fd-be94-c8a21bffb24a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.142330 Aug 25 12:42:08.920636 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 711/1538] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 4147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:08.931536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:08.953008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:08.954855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:08.956471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:09.144077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Going to try to stop instance {{(pid=122700) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 12:42:09.200012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid bd3dcc6f-b789-4189-a00f-c87af6921f45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:09.272821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1fec42ee-1d91-47a7-acc8-2adf48fd29c9 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1970 microversion: 2.25 time: 0.791922 Aug 25 12:42:09.275159 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 828/1539] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:08 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1970 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:09.295065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-07888d54-5b69-4558-8f43-39de93436cdb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c25e5280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:09.319258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d6a14e5-13c7-42e3-9240-acd477c19542 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb/action" status: 202 len: 0 microversion: 2.1 time: 0.393116 Aug 25 12:42:09.328147 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 712/1540] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:42:08 2022] POST /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:09.346773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61d560a4-6ab8-48c8-9877-42b63e009168 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c26b5b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:09.561927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-07888d54-5b69-4558-8f43-39de93436cdb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.282965 Aug 25 12:42:09.571836 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 829/1541] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:09 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:09.572598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61d560a4-6ab8-48c8-9877-42b63e009168 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 484 microversion: 2.1 time: 0.237195 Aug 25 12:42:09.575517 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 713/1542] 10.222.0.60 () {58 vars in 1317 bytes} [Thu Aug 25 12:42:09 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 484 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:09.614517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a35c45eb-ccc1-4347-8a93-388f0fa36ada tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:09.617395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a35c45eb-ccc1-4347-8a93-388f0fa36ada tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:09.929129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a35c45eb-ccc1-4347-8a93-388f0fa36ada tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:09.964799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a35c45eb-ccc1-4347-8a93-388f0fa36ada tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1246 microversion: 2.1 time: 0.384275 Aug 25 12:42:09.973774 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 830/1543] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:09 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1246 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:09.998130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:10.012666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:10.031003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:10.036907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:10.056870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:10.059128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:10.060071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:10.061151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:10.145271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6eb187f4-f0e8-4217-9f6a-e2b9747e3ea0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Calling method '.version_select at 0x7fc6c2c2de50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:10.212444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6eb187f4-f0e8-4217-9f6a-e2b9747e3ea0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6eb187f4-f0e8-4217-9f6a-e2b9747e3ea0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/d4b8cedf-03e5-4c12-ac5f-4103c8cacb58/metadata/os_distro HTTP/1.1 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:10.228423 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'image_id': 'd4b8cedf-03e5-4c12-ac5f-4103c8cacb58', 'id': 'os_distro'} Aug 25 12:42:10.232828 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:10.235652 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d4b8cedf-03e5-4c12-ac5f-4103c8cacb58 Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:10.239565 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4b8cedf-03e5-4c12-ac5f-4103c8cacb58 could not be found. Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:10.252682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:10.257709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6eb187f4-f0e8-4217-9f6a-e2b9747e3ea0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:10.272504 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6eb187f4-f0e8-4217-9f6a-e2b9747e3ea0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "DELETE /compute/v2.1/images/d4b8cedf-03e5-4c12-ac5f-4103c8cacb58/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.660498 Aug 25 12:42:10.272504 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 714/1544] 10.222.0.60 () {58 vars in 1293 bytes} [Thu Aug 25 12:42:09 2022] DELETE /compute/v2.1/images/d4b8cedf-03e5-4c12-ac5f-4103c8cacb58/metadata/os_distro => generated 62 bytes in 666 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:10.272504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:10.272504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:10.298039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:10.298962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:10.299812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:10.301274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:10.302185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:10.303065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:10.999181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid bd3dcc6f-b789-4189-a00f-c87af6921f45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:11.040626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff4ff9bd-14a8-4d1e-a2f5-f024cae9647f tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1970 microversion: 2.25 time: 1.064282 Aug 25 12:42:11.043813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 831/1545] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:09 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1970 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:11.054254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce2eb066-3b91-4216-9db3-c35eb96b940e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25e64c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.208167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce2eb066-3b91-4216-9db3-c35eb96b940e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 484 microversion: 2.1 time: 0.161552 Aug 25 12:42:11.209616 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 832/1546] 10.222.0.60 () {58 vars in 1303 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 484 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:11.217138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:11.218322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-492a2b18-cd7d-4f1d-b713-f9162ed3dc7f tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Calling method '.version_select at 0x7fc6c2993a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.240967 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-106e76e4-3b54-4ea1-8ad3-a7fbf62de362 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1512 microversion: 2.1 time: 0.993453 Aug 25 12:42:11.243056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 715/1547] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:10 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1512 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:11.272084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d88c972e-aced-4cb8-ba14-db697e5f9f6c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c3094040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.297262 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-492a2b18-cd7d-4f1d-b713-f9162ed3dc7f tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-492a2b18-cd7d-4f1d-b713-f9162ed3dc7f tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/97e72504-c201-4360-a381-0dccf468ac02/metadata/os_version HTTP/1.1 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:11.302447 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'image_id': '97e72504-c201-4360-a381-0dccf468ac02', 'id': 'os_version'} Aug 25 12:42:11.306084 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:11.310784 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 97e72504-c201-4360-a381-0dccf468ac02 Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:11.322688 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 97e72504-c201-4360-a381-0dccf468ac02 could not be found. Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:11.327847 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.330994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-492a2b18-cd7d-4f1d-b713-f9162ed3dc7f tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:11.337948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-492a2b18-cd7d-4f1d-b713-f9162ed3dc7f tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "GET /compute/v2.1/images/97e72504-c201-4360-a381-0dccf468ac02/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.093713 Aug 25 12:42:11.337948 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 833/1548] 10.222.0.60 () {58 vars in 1293 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/images/97e72504-c201-4360-a381-0dccf468ac02/metadata/os_version => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:11.337948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.337948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:11.361292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.362173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.367445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.368959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.369824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.371253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.447037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d88c972e-aced-4cb8-ba14-db697e5f9f6c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1423 microversion: 2.1 time: 0.190031 Aug 25 12:42:11.449701 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 716/1549] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1423 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:11.460760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.472006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.473834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.476839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.479764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.481168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.482860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.542356 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1abf765c-1317-459b-998b-66b6bf99d244 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.090077 Aug 25 12:42:11.543634 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 717/1550] 10.222.0.60 () {60 vars in 1217 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:42:11.556543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42639223-edca-4c8a-9d67-6227d8fabacc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2912160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.567524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:11.585986 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e16e32d3-b4fc-4b1a-8ee7-1596a24c5ca5 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1298 microversion: 2.1 time: 0.271153 Aug 25 12:42:11.589933 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 834/1551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:11.606802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9f3ac59-3412-4611-8ba3-be2a1fd401d4 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Calling method '.version_select at 0x7fc6c2ff6940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:11.885570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-c9f3ac59-3412-4611-8ba3-be2a1fd401d4 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9f3ac59-3412-4611-8ba3-be2a1fd401d4 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/a7526ad9-79d6-4a5e-b5b0-23c5b260f890/metadata HTTP/1.1 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:11.892839 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'image_id': 'a7526ad9-79d6-4a5e-b5b0-23c5b260f890'} Aug 25 12:42:11.896070 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:11.898452 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a7526ad9-79d6-4a5e-b5b0-23c5b260f890 Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:11.902352 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7526ad9-79d6-4a5e-b5b0-23c5b260f890 could not be found. Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:11.909248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:11.915689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9f3ac59-3412-4611-8ba3-be2a1fd401d4 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:11.921553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9f3ac59-3412-4611-8ba3-be2a1fd401d4 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "GET /compute/v2.1/images/a7526ad9-79d6-4a5e-b5b0-23c5b260f890/metadata" status: 404 len: 62 microversion: 2.1 time: 0.307911 Aug 25 12:42:11.921553 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 835/1552] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/images/a7526ad9-79d6-4a5e-b5b0-23c5b260f890/metadata => generated 62 bytes in 328 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:11.953770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-18", "block_migration": "auto"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:11.963575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:11.994948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:11.997364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:11.998224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:11.999590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:12.000663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:12.001219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:12.114743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'flavor' on Instance uuid bd3dcc6f-b789-4189-a00f-c87af6921f45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:12.155793 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42639223-edca-4c8a-9d67-6227d8fabacc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3703 microversion: 2.1 time: 0.609347 Aug 25 12:42:12.165683 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 718/1553] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:42:11 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3703 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:12.169867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Going to try to live migrate instance to n-h1-850468-18 {{(pid=122701) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:42:12.216381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-677ef398-e9e4-4e0b-9ca1-bac382ec6f44 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Action: 'update_all', calling method: .version_select at 0x7fc6c3094790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:12.353449 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-677ef398-e9e4-4e0b-9ca1-bac382ec6f44 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-677ef398-e9e4-4e0b-9ca1-bac382ec6f44 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/images/e74e3720-df14-4472-b52e-2b8d1779f759/metadata HTTP/1.1 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 57 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:12.358253 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:12.361603 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'image_id': 'e74e3720-df14-4472-b52e-2b8d1779f759', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:12.363660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e74e3720-df14-4472-b52e-2b8d1779f759 Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:12.366197 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e74e3720-df14-4472-b52e-2b8d1779f759 could not be found. Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:12.368972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:12.378105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:12.381290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-677ef398-e9e4-4e0b-9ca1-bac382ec6f44 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:12.381290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-677ef398-e9e4-4e0b-9ca1-bac382ec6f44 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "PUT /compute/v2.1/images/e74e3720-df14-4472-b52e-2b8d1779f759/metadata" status: 404 len: 62 microversion: 2.1 time: 0.209798 Aug 25 12:42:12.390369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 719/1554] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:42:12 2022] PUT /compute/v2.1/images/e74e3720-df14-4472-b52e-2b8d1779f759/metadata => generated 62 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:12.399899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cfea97b7-eadf-4c3b-a5b6-5a78b433c63b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2f51b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:12.698743 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cfea97b7-eadf-4c3b-a5b6-5a78b433c63b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.313936 Aug 25 12:42:12.701452 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 720/1555] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 12:42:12 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:12.714763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:12.716446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:12.731411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:12.732964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:12.734187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:12.735898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:12.737635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:12.738988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:13.693636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:13.737543 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c14707f6-d638-452d-a24d-d91671d50956 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1512 microversion: 2.1 time: 1.031579 Aug 25 12:42:13.739671 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 721/1556] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:12 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1512 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:13.755029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c730f00-d9b4-48c6-85e7-5f83059247ae tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Action: 'update', calling method: .version_select at 0x7fc6c2830ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:18.581453 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85d1783e-93f7-4911-848b-0fce5fb93032 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45/action" status: 202 len: 0 microversion: 2.25 time: 6.653686 Aug 25 12:42:18.583592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 836/1557] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:42:11 2022] POST /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45/action => generated 0 bytes in 6660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:18.633313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ab244ba-d75a-4cb9-8d77-b82f109dcbdc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2a88790>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:18.694664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:19.952152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:21.498622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:22.244190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:22.581580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:22.730769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:23.722510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:25.670542 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6c730f00-d9b4-48c6-85e7-5f83059247ae tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c730f00-d9b4-48c6-85e7-5f83059247ae tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/images/0d697605-7a85-4f0b-9b12-339196e45ad3/metadata/os_distro HTTP/1.1 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 30 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:25.675871 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: {"meta": {"os_distro": "alt"}} Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:25.680230 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'image_id': '0d697605-7a85-4f0b-9b12-339196e45ad3', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:25.682888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0d697605-7a85-4f0b-9b12-339196e45ad3 Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:25.689341 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0d697605-7a85-4f0b-9b12-339196e45ad3 could not be found. Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:25.693698 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:25.697479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:25.708996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c730f00-d9b4-48c6-85e7-5f83059247ae tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:25.708996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c730f00-d9b4-48c6-85e7-5f83059247ae tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "PUT /compute/v2.1/images/0d697605-7a85-4f0b-9b12-339196e45ad3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 11.947859 Aug 25 12:42:25.708996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 722/1558] 10.222.0.60 () {60 vars in 1310 bytes} [Thu Aug 25 12:42:13 2022] PUT /compute/v2.1/images/0d697605-7a85-4f0b-9b12-339196e45ad3/metadata/os_distro => generated 62 bytes in 11963 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:25.727754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:25.728947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:25.758287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:25.759257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:25.760242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:25.762363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:25.763404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:25.764375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:25.926480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ab244ba-d75a-4cb9-8d77-b82f109dcbdc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1432 microversion: 2.1 time: 7.339692 Aug 25 12:42:25.933499 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 837/1559] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:18 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1432 bytes in 7343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:25.938565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a26a30f-9f1c-4ac4-a18f-afbd39fd363a tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2585940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:26.287966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a26a30f-9f1c-4ac4-a18f-afbd39fd363a tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.350199 Aug 25 12:42:26.294678 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 838/1560] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:42:25 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:26.310062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:26.310062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:26.370143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:26.372272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:26.378909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:26.385230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:26.388871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:26.390983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:26.397421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:26.418215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3ee5e4fa-db3d-4064-8c9e-177b8d456234 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.707578 Aug 25 12:42:26.419657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 723/1561] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:25 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:26.430472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:26.432272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:26.448617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:26.450427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:26.451902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:26.453815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:26.455440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:26.456995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:26.890091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:26.934445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b4ab4c5f-5dc5-4527-97c3-794a2d0863f6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1512 microversion: 2.1 time: 0.636490 Aug 25 12:42:26.937122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 839/1562] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:26 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1512 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:26.955266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d331e01e-d961-4a8c-9692-09398c935198", "tag": "d3243244-efb5-429f-8f5e-17f3ece1ceaf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:26.989954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:26.990470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:26.997722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.010404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:27.015133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:27.016625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.018753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32c3d202-45a8-4ab9-8fe9-adbd3af0eb43 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.596600 Aug 25 12:42:27.020351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 724/1563] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:26 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:27.141484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] Creating event network-changed:d3243244-efb5-429f-8f5e-17f3ece1ceaf for instance d331e01e-d961-4a8c-9692-09398c935198 on n-h1-850468-18 Aug 25 12:42:27.168913 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c3c337fb-1782-4565-98f5-fd0d9bf7e2b8 req-4f00b9d0-92f2-4b0e-8003-8c4b5d5e88fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224910 Aug 25 12:42:27.170673 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 840/1564] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:27.201068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3db4c826-22f6-46dc-8657-c22f2fce2ec0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Action: 'create', calling method: .version_select at 0x7fc6c257c160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:27.325702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3db4c826-22f6-46dc-8657-c22f2fce2ec0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] HTTP exception thrown: Image not found. Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3db4c826-22f6-46dc-8657-c22f2fce2ec0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Request method failure captured: Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/images/c98d0c1e-1a84-4993-9f6a-6113fdd0a79e/metadata HTTP/1.1 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 57 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB24gSY_qCgeUKHvSvGwiubOyG1LwCWJ_EgvShLCyJlBck8-1scYNhnCuyMPBRmWHl9z8YJpQ-eoQcnPaT0wM0Q4XWe3oBIUmoN0JsRg-JEO0dz6iJgB4mk_pff-1OJadZqZwZMIQgCAwSPkBzex2CWF_iadLyBxxdrxNGx5UQla4wuM Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:27.332651 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e81c0f8bf78479ab19a56d8d636ffa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6e81c0f8bf78479ab19a56d8d636ffa9 Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-45037856 Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 7dc276ef941344829fdfad5390f1e01a Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-45037856-project Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:27.336086 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'image_id': 'c98d0c1e-1a84-4993-9f6a-6113fdd0a79e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:27.338779 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c98d0c1e-1a84-4993-9f6a-6113fdd0a79e Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:27.341787 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c98d0c1e-1a84-4993-9f6a-6113fdd0a79e could not be found. Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:27.344430 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:27.346998 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:27.356992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3db4c826-22f6-46dc-8657-c22f2fce2ec0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:27.364367 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3db4c826-22f6-46dc-8657-c22f2fce2ec0 tempest-ImagesMetadataNegativeTestJSON-45037856 tempest-ImagesMetadataNegativeTestJSON-45037856-project] 10.222.0.60 "POST /compute/v2.1/images/c98d0c1e-1a84-4993-9f6a-6113fdd0a79e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.190876 Aug 25 12:42:27.366642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 841/1565] 10.222.0.60 () {60 vars in 1281 bytes} [Thu Aug 25 12:42:27 2022] POST /compute/v2.1/images/c98d0c1e-1a84-4993-9f6a-6113fdd0a79e/metadata => generated 62 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:27.394929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-647d397c-27a4-42de-911a-b74aa73ed925 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c257e8b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.518578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-052ce2fe-d193-463d-aa39-369490fb48e5 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c3094dc0>, body: {"keypair": {"name": "tempest-keypair-2052805485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiJ++FCuv+fCOZX7pEp2xXHzbIacLFWJr3EzlBKlPZyHX+dG0WAEOc0xIDsRMX39Ad+URCnSyD26tjFNI2WrXTlCflI0QlZVJ94uWnwo5An1yBRsqC9+G21ef+Z7uJ+Sw=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:27.616992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-052ce2fe-d193-463d-aa39-369490fb48e5 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:27.628047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-647d397c-27a4-42de-911a-b74aa73ed925 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 200 len: 1432 microversion: 2.1 time: 0.252553 Aug 25 12:42:27.630038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-052ce2fe-d193-463d-aa39-369490fb48e5 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:27.638300 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 842/1566] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:27 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 1432 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:27.650574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ad6c2da-8ea3-49fe-91ed-327d657342e6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c269e3a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.722468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-052ce2fe-d193-463d-aa39-369490fb48e5 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699810 Aug 25 12:42:27.737525 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 725/1567] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:27.762416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:27.766416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:27.802544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.809852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.813265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:27.817726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:27.819246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:27.823777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.227075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ad6c2da-8ea3-49fe-91ed-327d657342e6 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?changes-since=2022-08-25T12%3A38%3A23Z" status: 200 len: 7012 microversion: 2.1 time: 0.588800 Aug 25 12:42:28.232163 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 843/1568] 10.222.0.60 () {58 vars in 1220 bytes} [Thu Aug 25 12:42:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-25T12%3A38%3A23Z => generated 7012 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:28.249757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:28.264199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:28.305001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.306425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.314747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:28.316239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:28.317124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:28.317902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.272404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.320274 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a34c69b6-6c46-419b-8228-f3ec490207ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 1.574066 Aug 25 12:42:29.326619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 726/1569] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:27 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:29.371601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4965bf64-7b7a-42ed-912c-8b69eef5843e tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2ec5af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:29.427581 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4965bf64-7b7a-42ed-912c-8b69eef5843e tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-2052805485" status: 200 len: 497 microversion: 2.1 time: 0.096005 Aug 25 12:42:29.439626 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 727/1570] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 12:42:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2052805485 => generated 497 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:29.472691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:29.473960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:29.476680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:29.485977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.486984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.488162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.489892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.490960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.491983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.525967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dfc4a3e5-c2ba-455d-be1b-d595a007579b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1466 microversion: 2.1 time: 1.291782 Aug 25 12:42:29.538794 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 844/1571] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:28 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1466 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:29.568288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:29.574829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:29.607175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.610673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.616441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:29.618626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:29.622728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:29.626439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:30.167500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:30.197500 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e50f8de-e042-4043-84c5-a9f6d1620ab4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1512 microversion: 2.1 time: 0.732506 Aug 25 12:42:30.208637 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 728/1572] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:29 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1512 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:30.222568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8fb6a98-78ec-4608-8595-5a5165c0cf53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2f51940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:30.355267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:30.389841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:30.396286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:30.405291 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ba5a05c-7675-4753-adbd-fea9fd6bb63f tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.857901 Aug 25 12:42:30.406750 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 845/1573] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:29 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:30.425731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36072097-79a3-4d30-a1d6-ff391345be1c tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c25999d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:30.459835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8fb6a98-78ec-4608-8595-5a5165c0cf53 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-23803505" status: 200 len: 663 microversion: 2.1 time: 0.240933 Aug 25 12:42:30.465502 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 729/1574] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:42:30 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-23803505 => generated 663 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:30.493392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4813318-1ee5-41d4-b179-049631b3ba51 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2ec5af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:30.518967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36072097-79a3-4d30-a1d6-ff391345be1c tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052805485" status: 202 len: 0 microversion: 2.1 time: 0.108540 Aug 25 12:42:30.521593 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 846/1575] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:42:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052805485 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:30.557178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:30.558933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:30.580071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:30.581578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:30.582718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:30.584492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:30.586183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:30.587328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:30.695855 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4813318-1ee5-41d4-b179-049631b3ba51 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5" status: 200 len: 784 microversion: 2.1 time: 0.221193 Aug 25 12:42:30.697591 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 730/1576] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:30 2022] GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5 => generated 784 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:30.752283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ba2d0687-7f4f-4b11-8c24-e7ad79247104 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c34b5280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.125554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:31.175416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a7ed3b4-c16d-4e1b-869f-ae7c72311477 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.642953 Aug 25 12:42:31.177219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 847/1577] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:30 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:31.204893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3040220-d411-4c85-9a5e-67672d4594be tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c257cee0>, body: {"keypair": {"name": "tempest-keypair-98052786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN16X4E8c1VIrAbdMaI/bBTrBexsdZ2Bx11VeZGm3KqvSPRUhPrYUQor28oULJX8vl1993vOdVoie+qNYXApsDAoZtys1fCTvFJbFcw41vWWEJ6o36PaM/6+i9uxFVrUOQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:31.216269 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ba2d0687-7f4f-4b11-8c24-e7ad79247104 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1464 microversion: 2.1 time: 0.516335 Aug 25 12:42:31.230827 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 731/1578] 10.222.0.60 () {58 vars in 1338 bytes} [Thu Aug 25 12:42:30 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fv2.1%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1464 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:31.283817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0279a3c7-ccdb-42a3-98d6-09f5348082ab tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.339731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c3040220-d411-4c85-9a5e-67672d4594be tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:31.351092 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0279a3c7-ccdb-42a3-98d6-09f5348082ab tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.116731 Aug 25 12:42:31.354343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c3040220-d411-4c85-9a5e-67672d4594be tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:31.356651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 732/1579] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:31.381969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.387603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:31.419062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.425170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.426766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.429660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:31.431669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:31.433296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:31.452662 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3040220-d411-4c85-9a5e-67672d4594be tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.273188 Aug 25 12:42:31.455721 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 848/1580] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:31.480099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b5c41ae-282f-4963-b5c0-59638b09b970 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25f0700>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:31.738217 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b5c41ae-282f-4963-b5c0-59638b09b970 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1464 microversion: 2.1 time: 0.278916 Aug 25 12:42:31.739322 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 849/1581] 10.222.0.60 () {58 vars in 1324 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.60%2Fcompute%2Fservers%2Fa0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1464 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:31.769524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5770da03-3ba3-407c-be8f-748c2a94e0b5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c28e6040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:32.122273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:32.179084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e382481-b1f1-46b7-90ae-232a2848aa81 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1512 microversion: 2.1 time: 0.807545 Aug 25 12:42:32.201677 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 733/1582] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:31 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1512 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:32.266028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:32.278447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:32.359953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.366268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.379028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.381496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:32.383124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:32.386573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:32.999891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.042468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.045829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:33.048070 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6bd07c79-d68f-4c8d-882c-36f773673cf2 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.830984 Aug 25 12:42:33.060144 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 734/1583] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:32 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:33.082955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ada5041-9c1d-41aa-be67-2152f7473158 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2ec51f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:33.134209 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ada5041-9c1d-41aa-be67-2152f7473158 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98052786" status: 202 len: 0 microversion: 2.1 time: 0.068861 Aug 25 12:42:33.136365 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 735/1584] 10.222.0.60 () {58 vars in 1215 bytes} [Thu Aug 25 12:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98052786 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:33.166299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-421789c4-c78e-4db7-a994-5e31a5c1ecd0 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c30944c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:35.237626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5770da03-3ba3-407c-be8f-748c2a94e0b5 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "DELETE /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 204 len: 0 microversion: 2.1 time: 3.496097 Aug 25 12:42:35.239910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 850/1585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:31 2022] DELETE /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 0 bytes in 3500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:35.254617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:35.256532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:35.282213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.283380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.285463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.287251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.288779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.290871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.297414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-421789c4-c78e-4db7-a994-5e31a5c1ecd0 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7787 microversion: 2.1 time: 2.159048 Aug 25 12:42:35.298488 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 736/1586] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 12:42:33 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7787 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:35.312159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-unplugged", "status": "completed", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:35.333354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.334670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.335876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.365471 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] Creating event network-vif-unplugged:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:42:35.377613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6fe1b3eb-893f-4d22-bed4-abf4ef15c0c5 req-a76b77cd-106b-4d25-b1fe-0b86f748782b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076092 Aug 25 12:42:35.379407 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 737/1587] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:35.392637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b4dfb8c-4ff7-42c0-9bed-f40ec20cce1d tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c26b5dc0>, body: {"keypair": {"name": "tempest-keypair-19480638", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:35.430103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0b4dfb8c-4ff7-42c0-9bed-f40ec20cce1d tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:35.444292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0b4dfb8c-4ff7-42c0-9bed-f40ec20cce1d tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:35.516575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b4dfb8c-4ff7-42c0-9bed-f40ec20cce1d tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.133723 Aug 25 12:42:35.517565 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 738/1588] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:35 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:35.644167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:35.662632 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1d04cec-bae4-446a-bd0c-be0d977910d1 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.414928 Aug 25 12:42:35.664256 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 851/1589] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:35 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:35.673982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:35.675599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:35.687567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.688970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.690095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.691767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:35.692673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:35.693811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:35.864819 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cc0286b-3983-4edc-8371-7bce1b9e30c8 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.344891 Aug 25 12:42:35.867091 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 739/1590] 10.222.0.60 () {58 vars in 1128 bytes} [Thu Aug 25 12:42:35 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:42:36.021140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:36.043089 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dad5b187-324b-4120-a835-e8c1e387bad4 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1489 microversion: 2.1 time: 0.376451 Aug 25 12:42:36.044805 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 852/1591] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:35 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1489 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:36.054814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d62c710-6148-46a7-b680-4bef743ee28e tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2599b80>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.109249 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-8d62c710-6148-46a7-b680-4bef743ee28e tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] HTTP exception thrown: Image not found. Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d62c710-6148-46a7-b680-4bef743ee28e tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Request method failure captured: Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 HTTP/1.1 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB22pF27Mvl-7iwZLCeJBSk50XpKSFDM7WCe5MgPbRWNDQ1bODpPStobgQfdx7OOvGsSznoSV3iIZl7TVg1gdIm-000jIFl63_i3yMolFmCZEnbB6852wcY-VTgmsIqGIDDjVfWSCEA8XeMnQ9A9lE7_ZJ4PF6-SLNqvhpz6ybO70vs8 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:36.114641 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: c293b8d9fbef415dbc73654bf2d2a7ba Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '94821339-7a9c-4ed4-855d-938af019ca13'} Aug 25 12:42:36.118473 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:36.120726 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 94821339-7a9c-4ed4-855d-938af019ca13 Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:36.125115 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94821339-7a9c-4ed4-855d-938af019ca13 could not be found. Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:36.130545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d62c710-6148-46a7-b680-4bef743ee28e tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:36.134291 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d62c710-6148-46a7-b680-4bef743ee28e tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 404 len: 62 microversion: 2.1 time: 0.070928 Aug 25 12:42:36.141371 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 853/1592] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:36 2022] GET /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:36.149000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bccc3a42-83c1-41e3-bef9-dbfa1f8e50eb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2599820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.260000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.263171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:36.280845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.281826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.282603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.283968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.285101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.285657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.291569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bccc3a42-83c1-41e3-bef9-dbfa1f8e50eb tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.151997 Aug 25 12:42:36.293020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 854/1593] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 12:42:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:36.314073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44229325-74cd-4d74-a01e-50289b33d652 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2599ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.352549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44229325-74cd-4d74-a01e-50289b33d652 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19480638" status: 202 len: 0 microversion: 2.1 time: 0.057514 Aug 25 12:42:36.353653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 855/1594] 10.222.0.60 () {58 vars in 1215 bytes} [Thu Aug 25 12:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19480638 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:36.365220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aca2d7e4-20be-4180-84fc-a25d32352eee tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Calling method '.version_select at 0x7fc6c25924c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.426945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-aca2d7e4-20be-4180-84fc-a25d32352eee tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] HTTP exception thrown: Image not found. Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aca2d7e4-20be-4180-84fc-a25d32352eee tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Request method failure captured: Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB244jOE8pJfZchu_pQf4wZ-cpHqSYAEUjT0al5KDhwH6EikBd58ZVlng-SraOw3M5hWJ_cUyl1nucQhhxMQbH7jKOb4gewCnDMXWn_cUJ23Z0tCO5KftqLe3dPkE18C-0-8TjSTpxQsPQEPCZ7Yk6umzAVDJRV6y2QfY-jG1W35APMQ Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:36.433317 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_180118ee4fb245169c236ac12321644d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/180118ee4fb245169c236ac12321644d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6bd7837940f646ad9835421cf35f8528 Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '-1'} Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:36.437625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.440597 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:36.443659 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aca2d7e4-20be-4180-84fc-a25d32352eee tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:36.452984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aca2d7e4-20be-4180-84fc-a25d32352eee tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.094856 Aug 25 12:42:36.456937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 856/1595] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 25 12:42:36 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:36.468529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.470147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:36.486439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.487716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.488764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.490312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.491389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.492348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.556140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:42:36.593438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:36.614612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:36.618502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:36.622163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acdccb58-0252-444e-9a4e-1072622190d5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.754290 Aug 25 12:42:36.623814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 740/1596] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:35 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:36.631618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-803233824"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:36.638149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:36.653348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.654834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.656145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.658322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:36.660321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:36.661383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:36.749932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54eae021-c89a-4c03-a67c-6245ef7f73ba tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 204 len: 0 microversion: 2.1 time: 0.289566 Aug 25 12:42:36.753665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 857/1597] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:36 2022] DELETE /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:36.771503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ed5736e-aacf-4a37-8854-c4bf3b16225a tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c257c3a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:36.874818 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ed5736e-aacf-4a37-8854-c4bf3b16225a tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5" status: 200 len: 784 microversion: 2.1 time: 0.117449 Aug 25 12:42:36.876052 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 858/1598] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:36 2022] GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5 => generated 784 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:36.884092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc9703a8-34a6-471a-ba73-a648c0656312 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c257c1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-248091722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEHeuRxEkg9vqzLT43duv7Af4kmPxTAzTs/8mWeHpnU+mwA+Re+tM9I1TXnd/QTvC2t7gPPNbQ9FU3+XnvgL/DpE8Tsg+rwk099hicsKmZE6VMnU+wb3UFpA9Pfsp7CjQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:36.911797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-dc9703a8-34a6-471a-ba73-a648c0656312 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:36.921735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-dc9703a8-34a6-471a-ba73-a648c0656312 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:36.969294 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc9703a8-34a6-471a-ba73-a648c0656312 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.091347 Aug 25 12:42:36.970769 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 859/1599] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:36.981939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4e86d2c-d340-4210-9e49-c287d02a5bb5 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Calling method '.version_select at 0x7fc6c25850d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.024464 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-f4e86d2c-d340-4210-9e49-c287d02a5bb5 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] HTTP exception thrown: Image not found. Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4e86d2c-d340-4210-9e49-c287d02a5bb5 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Request method failure captured: Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/images/43535455-24f3-4dc1-961f-231d0586a0ej HTTP/1.1 Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB244jOE8pJfZchu_pQf4wZ-cpHqSYAEUjT0al5KDhwH6EikBd58ZVlng-SraOw3M5hWJ_cUyl1nucQhhxMQbH7jKOb4gewCnDMXWn_cUJ23Z0tCO5KftqLe3dPkE18C-0-8TjSTpxQsPQEPCZ7Yk6umzAVDJRV6y2QfY-jG1W35APMQ Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:37.029919 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_180118ee4fb245169c236ac12321644d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/180118ee4fb245169c236ac12321644d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6bd7837940f646ad9835421cf35f8528 Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '43535455-24f3-4dc1-961f-231d0586a0ej'} Aug 25 12:42:37.033009 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43535455-24f3-4dc1-961f-231d0586a0ej to delete Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.036317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43535455-24f3-4dc1-961f-231d0586a0ej could not be found. Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:37.045495 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4e86d2c-d340-4210-9e49-c287d02a5bb5 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:37.049479 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4e86d2c-d340-4210-9e49-c287d02a5bb5 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/43535455-24f3-4dc1-961f-231d0586a0ej" status: 404 len: 62 microversion: 2.1 time: 0.059373 Aug 25 12:42:37.053005 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 860/1600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:36 2022] DELETE /compute/v2.1/images/43535455-24f3-4dc1-961f-231d0586a0ej => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:37.053005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.060576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:37.062174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfded988-055d-46a9-b867-a6bbee67a83d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "POST /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a/action" status: 202 len: 0 microversion: 2.1 time: 0.435561 Aug 25 12:42:37.063627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 741/1601] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:42:36 2022] POST /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:42:37.065615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.066470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.067236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.068591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.069488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.070232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.095470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.096929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:37.111940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.112918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.113798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.115655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.116580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.117393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.407757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:37.413429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:37.423945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b135ed8a-8bc3-415b-9ff4-748639cdb939 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.388871 Aug 25 12:42:37.424936 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 861/1602] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:37.426992 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22d61471-31fa-4724-975f-3d9f7a57bfe2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1495 microversion: 2.1 time: 0.360151 Aug 25 12:42:37.430901 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 742/1603] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:37.434312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6966c5e-3867-426d-ab9b-2bac4f50f701 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2674f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.439548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-68d45b3f-3248-486d-a846-279f06a2f78b tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c304f0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-576481097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWqOOjToZwLMbir/ZlciKDD/7wZfHW6TdFQP2I/dMRmSBL8ivO8vVug9MBAPezwWjImgf9aMm+Ug93Vc53P5h4VbLTyzx1/ZR5GWl8gmnjDf1olDL5D44xNQUQHUiSrbw=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:37.469859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-68d45b3f-3248-486d-a846-279f06a2f78b tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:37.478068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-68d45b3f-3248-486d-a846-279f06a2f78b tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:37.519272 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-68d45b3f-3248-486d-a846-279f06a2f78b tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.088142 Aug 25 12:42:37.520046 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 743/1604] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:37.523588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6966c5e-3867-426d-ab9b-2bac4f50f701 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.096759 Aug 25 12:42:37.531165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 862/1605] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:37.531506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3e237e0-129a-463c-bbab-282c3214da0f tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Calling method '.version_select at 0x7fc6c2aca310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.541945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94a59070-ca1b-4e6f-ab5f-74746c872ddf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2993dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.559448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f3e237e0-129a-463c-bbab-282c3214da0f tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] HTTP exception thrown: Image not found. Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3e237e0-129a-463c-bbab-282c3214da0f tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Request method failure captured: Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/90daca82-bc75-4d98-be87-c6b70210112d1 HTTP/1.1 Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB244jOE8pJfZchu_pQf4wZ-cpHqSYAEUjT0al5KDhwH6EikBd58ZVlng-SraOw3M5hWJ_cUyl1nucQhhxMQbH7jKOb4gewCnDMXWn_cUJ23Z0tCO5KftqLe3dPkE18C-0-8TjSTpxQsPQEPCZ7Yk6umzAVDJRV6y2QfY-jG1W35APMQ Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:37.563818 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_180118ee4fb245169c236ac12321644d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/180118ee4fb245169c236ac12321644d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6bd7837940f646ad9835421cf35f8528 Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '90daca82-bc75-4d98-be87-c6b70210112d1'} Aug 25 12:42:37.566746 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 90daca82-bc75-4d98-be87-c6b70210112d1 to delete Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.568837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90daca82-bc75-4d98-be87-c6b70210112d1 could not be found. Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:37.571600 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3e237e0-129a-463c-bbab-282c3214da0f tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:37.576087 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3e237e0-129a-463c-bbab-282c3214da0f tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/90daca82-bc75-4d98-be87-c6b70210112d1" status: 404 len: 62 microversion: 2.1 time: 0.046547 Aug 25 12:42:37.580695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 744/1606] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:37 2022] DELETE /compute/v2.1/images/90daca82-bc75-4d98-be87-c6b70210112d1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:37.593130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d35dde00-6383-4f3d-b176-f047e3d0c5b9 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Action: 'create', calling method: .version_select at 0x7fc6c30d78b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-487013343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Q2Yh0B8mUkvQNHRXseq0RFeX+tH/9ojsj2sStBBMe8mmXauf+YYAzxRvMzmF9vJwIu6u17Wuody7aM72oj/jde3BC300qiMAOC0Oy3DldejhTv/Q571/Nlf4Rzn6q0A=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:37.613760 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-94a59070-ca1b-4e6f-ab5f-74746c872ddf tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.087182 Aug 25 12:42:37.614741 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 863/1607] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:37.625228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-d35dde00-6383-4f3d-b176-f047e3d0c5b9 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:37.626177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79404474-d2c4-4724-bdfb-55c0cd734584 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25859d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.636942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-d35dde00-6383-4f3d-b176-f047e3d0c5b9 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Getting quotas for user 351f7d7eead846ee940883588f2ca1b2 and project 4030c5b331a644eba4f330dfe9442b25. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:37.676001 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d35dde00-6383-4f3d-b176-f047e3d0c5b9 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.097012 Aug 25 12:42:37.677221 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 745/1608] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:42:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:37.687463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-feca03a0-9e8a-412b-a97f-68741cc8b156 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Calling method '.version_select at 0x7fc6c304fc10>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.735367 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-feca03a0-9e8a-412b-a97f-68741cc8b156 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] HTTP exception thrown: Image not found. Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-feca03a0-9e8a-412b-a97f-68741cc8b156 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Request method failure captured: Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/tempest-invalid-258786683 HTTP/1.1 Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB244jOE8pJfZchu_pQf4wZ-cpHqSYAEUjT0al5KDhwH6EikBd58ZVlng-SraOw3M5hWJ_cUyl1nucQhhxMQbH7jKOb4gewCnDMXWn_cUJ23Z0tCO5KftqLe3dPkE18C-0-8TjSTpxQsPQEPCZ7Yk6umzAVDJRV6y2QfY-jG1W35APMQ Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:37.739267 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_180118ee4fb245169c236ac12321644d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/180118ee4fb245169c236ac12321644d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6bd7837940f646ad9835421cf35f8528 Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'tempest-invalid-258786683'} Aug 25 12:42:37.741283 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-258786683 to delete Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.742355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-258786683 could not be found. Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:37.744316 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-feca03a0-9e8a-412b-a97f-68741cc8b156 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:37.755074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-feca03a0-9e8a-412b-a97f-68741cc8b156 tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/tempest-invalid-258786683" status: 404 len: 62 microversion: 2.1 time: 0.062978 Aug 25 12:42:37.757692 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 746/1609] 10.222.0.60 () {58 vars in 1203 bytes} [Thu Aug 25 12:42:37 2022] DELETE /compute/v2.1/images/tempest-invalid-258786683 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:37.757692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:37.757692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:37.770052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.770831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.771632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:37.772890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:37.773668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:37.774409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.016392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.033648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.037308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:38.039556 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e86f189-f198-4fad-a541-16a087b3225e tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.295031 Aug 25 12:42:38.040440 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 747/1610] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:37 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:38.050558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65291ff0-669d-48d1-a085-920a5facb099 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2ec5e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.056494 n-d-850468-18 devstack@n-api.service[122700]: WARNING oslo_db.sqlalchemy.utils [None req-65291ff0-669d-48d1-a085-920a5facb099 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:42:38.067506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-65291ff0-669d-48d1-a085-920a5facb099 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.025281 Aug 25 12:42:38.078861 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 748/1611] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:42:38 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:38.087962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf367af-f789-4eec-ab64-e21b102ba0cc tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Calling method '.version_select at 0x7fc6c2acaca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.141941 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-dcf367af-f789-4eec-ab64-e21b102ba0cc tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] HTTP exception thrown: Image not found. Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf367af-f789-4eec-ab64-e21b102ba0cc tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Request method failure captured: Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/47246738-b0c5-4d27-9b5e-06a0ee2bb74e HTTP/1.1 Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB244jOE8pJfZchu_pQf4wZ-cpHqSYAEUjT0al5KDhwH6EikBd58ZVlng-SraOw3M5hWJ_cUyl1nucQhhxMQbH7jKOb4gewCnDMXWn_cUJ23Z0tCO5KftqLe3dPkE18C-0-8TjSTpxQsPQEPCZ7Yk6umzAVDJRV6y2QfY-jG1W35APMQ Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:38.145512 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_180118ee4fb245169c236ac12321644d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/180118ee4fb245169c236ac12321644d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/180118ee4fb245169c236ac12321644d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 180118ee4fb245169c236ac12321644d Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391 Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6bd7837940f646ad9835421cf35f8528 Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1083797391-project Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '47246738-b0c5-4d27-9b5e-06a0ee2bb74e'} Aug 25 12:42:38.149118 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47246738-b0c5-4d27-9b5e-06a0ee2bb74e to delete Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:38.150375 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47246738-b0c5-4d27-9b5e-06a0ee2bb74e could not be found. Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:38.152965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcf367af-f789-4eec-ab64-e21b102ba0cc tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:38.156076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dcf367af-f789-4eec-ab64-e21b102ba0cc tempest-ImagesDeleteNegativeTestJSON-1083797391 tempest-ImagesDeleteNegativeTestJSON-1083797391-project] 10.222.0.60 "DELETE /compute/v2.1/images/47246738-b0c5-4d27-9b5e-06a0ee2bb74e" status: 404 len: 62 microversion: 2.1 time: 0.067729 Aug 25 12:42:38.160939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 749/1612] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:38 2022] DELETE /compute/v2.1/images/47246738-b0c5-4d27-9b5e-06a0ee2bb74e => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:38.160939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cff9a5c-d561-4273-b303-1c72d0e67a73 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2aca940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.199427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cff9a5c-d561-4273-b303-1c72d0e67a73 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-487013343" status: 202 len: 0 microversion: 2.1 time: 0.048848 Aug 25 12:42:38.205697 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 750/1613] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-487013343 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:38.221159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b537b58b-132b-4bb3-8bdb-369bcaceef84 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c32e5940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.263616 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b537b58b-132b-4bb3-8bdb-369bcaceef84 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-576481097" status: 202 len: 0 microversion: 2.1 time: 0.053662 Aug 25 12:42:38.273568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 751/1614] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-576481097 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:42:38.291046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c32775c-925f-4241-9ab4-417500f77679 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] Calling method '.version_select at 0x7fc6c2dc3940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.355393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c32775c-925f-4241-9ab4-417500f77679 tempest-KeyPairsV2TestJSON-1906051579 tempest-KeyPairsV2TestJSON-1906051579-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-248091722" status: 202 len: 0 microversion: 2.1 time: 0.076966 Aug 25 12:42:38.357090 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 752/1615] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-248091722 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:42:38.480980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.492205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:38.535724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.540724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.542315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.543954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.545426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.546591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.558705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79404474-d2c4-4724-bdfb-55c0cd734584 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277" status: 204 len: 0 microversion: 2.1 time: 0.942206 Aug 25 12:42:38.564771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 864/1616] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:37 2022] DELETE /compute/v2.1/images/1bf625b1-f64b-4140-9f77-d7ef36579277 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:38.591942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:38.599702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:38.639649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.641516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.642811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:38.644991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:38.646955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:38.649543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:39.147141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:39.173661 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aafa0b46-b647-4372-b27a-76faff3723b0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.711598 Aug 25 12:42:39.189377 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 753/1617] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:38 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:39.214898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bceff797-f564-4832-867a-0df8b3befd9d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2dc3940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:39.241451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:39.292013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5961bad-d4d2-48c1-8e14-1f06f87b766a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 200 len: 1495 microversion: 2.1 time: 0.729308 Aug 25 12:42:39.293090 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 865/1618] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:38 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 1495 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:39.308369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dcf8710-4302-477d-bde3-0c8d99a91ed0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c25854c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:39.459204 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1dcf8710-4302-477d-bde3-0c8d99a91ed0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.163662 Aug 25 12:42:39.461239 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 866/1619] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:39 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:39.480816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:39.480816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:39.493071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.494453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.495420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:39.497256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:39.498318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:39.499522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.023793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.046617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.050060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.053536 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3eafe8f7-9a5b-4162-b526-f6764c79b8a4 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.589770 Aug 25 12:42:40.070517 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 867/1620] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:39 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:40.108502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aedbee79-3926-4601-aa94-f0b5565739bb", "name": "network-vif-deleted", "tag": "7016d95d-df6c-4ffc-91e9-761ee8729826"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:40.143493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.144604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.145475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.201927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] Creating event network-vif-deleted:7016d95d-df6c-4ffc-91e9-761ee8729826 for instance aedbee79-3926-4601-aa94-f0b5565739bb on n-h2-850468-18 Aug 25 12:42:40.215461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-93d60de5-2e19-4c13-8b4d-a0dc422b2788 req-da1f5ee6-e9fc-44dc-a0d2-75015462565f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138099 Aug 25 12:42:40.228489 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 868/1621] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:40.239861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:40.241210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:40.256491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.257179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.258957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.262281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.263630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.265132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.808375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:40.847945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-86fdd33c-56b5-475c-8c29-a20a758f3e65 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.616718 Aug 25 12:42:40.851105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 869/1622] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:40 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:40.871516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:40.873014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:40.913156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.914234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.914630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:40.915633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:40.937443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:40.940373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.005074 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb HTTP/1.1 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:42:41.018556 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:42:41.022074 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'aedbee79-3926-4601-aa94-f0b5565739bb'} Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:41.025589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:42:41.033491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:42:41.036339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:41.036339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb22fcd7-7a8a-4dcb-9220-9055177a964a tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 404 len: 111 microversion: 2.1 time: 0.167928 Aug 25 12:42:41.036339 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 870/1623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:40 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:41.046727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb49812e-b514-416d-b1da-a4c66842d2eb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2592820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:41.148478 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bceff797-f564-4832-867a-0df8b3befd9d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6" status: 204 len: 0 microversion: 2.1 time: 1.956775 Aug 25 12:42:41.157515 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 754/1624] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:39 2022] DELETE /compute/v2.1/images/439d01a0-c1bc-41f5-991e-3c6bf8a254b6 => generated 0 bytes in 1967 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:41.175499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:41.175869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:41.205091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.206773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.208909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.210779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:41.211191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb49812e-b514-416d-b1da-a4c66842d2eb tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.184157 Aug 25 12:42:41.212729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:41.214728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:41.223843 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 871/1625] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:41 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:41.241144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-973124ad-050d-4cec-b766-2f35fce5a202 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2585160>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:41.542517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:41.566477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:41.569444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:41.571697 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0bf40732-4276-429d-b4b8-1bdbae52d0aa tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.411059 Aug 25 12:42:41.573909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 755/1626] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:41 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:41.581688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-783325903", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "39311b05-e426-4fdf-94ed-2558f34baa03"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:41.685727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] validate_networks() for [('39311b05-e426-4fdf-94ed-2558f34baa03', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:43.082403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-973124ad-050d-4cec-b766-2f35fce5a202 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e" status: 204 len: 0 microversion: 2.1 time: 1.856354 Aug 25 12:42:43.084207 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 872/1627] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:41 2022] DELETE /compute/v2.1/images/784f7af6-58e6-4633-8113-e5ac9941522e => generated 0 bytes in 1860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:43.098003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:43.100426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:43.115000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.116533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.118113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.121214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.123329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.125409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.216452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:42:43.217964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:42:43.218758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:42:43.219584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:42:43.220360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:42:43.226388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:43.241498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.242631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.243521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.245814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.246949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.247729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.295449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:43.307957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Getting quotas for user 23e2785f6ce2400896469dab52789ab3 and project 80d8c371cfcc4e59bd3ce4124f12f892. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:43.342033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:42:43.346397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:42:43.449700 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-629ed9b7-49d4-4ee6-864f-f8d207046c97 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873695 Aug 25 12:42:43.451795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 756/1628] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:42:43.462226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2e02ba1-e2fa-4799-8182-b7e9bffc86c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c26f2280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:43.472691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:43.506717 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c0f6240-4c54-46f2-a2df-fe8c96df17e6 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.420297 Aug 25 12:42:43.508605 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 873/1629] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:43.523149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:43.524597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:43.547931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.549277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.550145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.553178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.554545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.558865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.576626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2e02ba1-e2fa-4799-8182-b7e9bffc86c1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.122230 Aug 25 12:42:43.578278 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 757/1630] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:43.589171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:43.590728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:43.606007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.608980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.610094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.611919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:43.613384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:43.614628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:43.692241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:42:43.845216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:43.908432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:43.931440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:43.936588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:43.938705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b214d9f3-dbc1-4ab0-add8-db41270114b6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.424008 Aug 25 12:42:43.952172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 874/1631] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:43.957615 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-492b5b8c-5006-402b-82df-af76c5e5c921 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 204 len: 0 microversion: 2.1 time: 0.366260 Aug 25 12:42:43.957615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 758/1632] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:43 2022] DELETE /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:43.964949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8afae714-0a23-4e54-994c-6f4ab37ae593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:43.967106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8afae714-0a23-4e54-994c-6f4ab37ae593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:44.298299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8afae714-0a23-4e54-994c-6f4ab37ae593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:44.327927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8afae714-0a23-4e54-994c-6f4ab37ae593 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1214 microversion: 2.1 time: 0.375900 Aug 25 12:42:44.336649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 759/1633] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1214 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:44.355178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:44.365536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:44.389622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.403983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.405168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.406852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.408218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.412888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.638215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Calling method '.version_select at 0x7fc6c25925e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:44.684565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.688239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.691561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.697658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.702407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.706808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.778305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22cfac3f-b9ad-459c-a09b-bb57f1030d9b tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] 10.222.0.60 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.834622 Aug 25 12:42:44.798957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 875/1634] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 25 12:42:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:44.825454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:44.827154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:44.879870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.892573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.895064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:44.901150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:44.906908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:44.914717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:45.057586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:45.288730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:45.328013 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cc10081-dccf-458b-9c50-8c06d57fc8ad tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1474 microversion: 2.1 time: 0.987996 Aug 25 12:42:45.329420 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 760/1635] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:44 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1474 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:45.351466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c71ae6e-ab22-4424-b711-caaa19d6fc0d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c26b5670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:45.521929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c71ae6e-ab22-4424-b711-caaa19d6fc0d tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.190463 Aug 25 12:42:45.523787 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 761/1636] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:45 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:45.536177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-83103030", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:45.665224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:42:46.060903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:46.079246 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3dfd839b-9156-4abd-ac45-443160e006a3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 1.277028 Aug 25 12:42:46.081498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 876/1637] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:44 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:46.106479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:46.108728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:46.130533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.131503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.133679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:46.137742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:46.139187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:46.141146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:47.277024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Getting quotas for project 343650ddd13644cd8d47f84ad198c77d. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:42:47.315057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Getting quotas for user 30aa1677295343b1a8ce69d778c2a2c4 and project 343650ddd13644cd8d47f84ad198c77d. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:42:47.344807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Request method failure captured: Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 1750 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB25C80xl7xqRzVJLg4jOflYhxVVh7ZnqxPpGhE0iGgv1h3z8nSHsAcFCa-yIGkHpE0G-dH1dhVSI9axGBmGqhfY8kYrUcxlOmbOBdZ5DYk4prP33zyRWwBlSrYGMvQXu_bAjz-oBPJG95_l89aQEfFYfqLNRVGn52QzqHpMe4-lhdog Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 343650ddd13644cd8d47f84ad198c77d Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-454005874 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_343650ddd13644cd8d47f84ad198c77d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/343650ddd13644cd8d47f84ad198c77d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/343650ddd13644cd8d47f84ad198c77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/343650ddd13644cd8d47f84ad198c77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-454005874 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 343650ddd13644cd8d47f84ad198c77d Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-454005874 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-454005874-project Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 30aa1677295343b1a8ce69d778c2a2c4 Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-454005874-project Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-83103030", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:42:47.350538 n-d-850468-18 devstack@n-api.service[122700]: exception: Maximum number of metadata items exceeds 128 Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-83103030', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:47.356790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 25 12:42:47.363524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:47.368317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:47.371672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-220dc7ba-a835-4754-94ae-713798c3bfe7 tempest-AbsoluteLimitsNegativeTestJSON-454005874 tempest-AbsoluteLimitsNegativeTestJSON-454005874-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.845671 Aug 25 12:42:47.374009 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 762/1638] 10.222.0.60 () {60 vars in 1148 bytes} [Thu Aug 25 12:42:45 2022] POST /compute/v2.1/servers => generated 87 bytes in 1849 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:42:47.390415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:47.392089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:47.410148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:47.411920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:47.413226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:47.415079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:47.416448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:47.418120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.171156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.218076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.221846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.229946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a1b7e69a-6f10-4b33-81e6-81a529d62bd9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 2.144141 Aug 25 12:42:48.236797 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 877/1639] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:46 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:48.295166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:48.296370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:48.321692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.322559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.324285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.325982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.330987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.332282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.455273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.505196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.506573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.507763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.509169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lazy-loading 'fault' on Instance uuid a0a1cadc-61f5-4d92-b04f-0f4cd58729eb {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:42:48.512536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a62c62d2-2207-449b-a63e-1fa45433daac tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1272 microversion: 2.1 time: 1.131017 Aug 25 12:42:48.517045 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 763/1640] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:47 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1272 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:48.560251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3efd0caa-430c-4744-8551-497ed8ada687 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c34b5280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:48.705162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:48.722968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3efd0caa-430c-4744-8551-497ed8ada687 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.198564 Aug 25 12:42:48.729385 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 764/1641] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:48.743469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3dcc6f-b789-4189-a00f-c87af6921f45", "name": "network-vif-unplugged", "status": "completed", "tag": "ffbaa69c-ea08-4665-97ef-e3a08231bc92"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:48.759507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11ceeca7-86cc-4453-bd9e-37bcb5e9ad10 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 200 len: 1308 microversion: 2.1 time: 0.483751 Aug 25 12:42:48.762600 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 878/1642] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:48.779432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:48.781285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:48.786975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.788834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.790359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.817501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.818242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.819865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.825756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.828108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.833994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] Creating event network-vif-unplugged:ffbaa69c-ea08-4665-97ef-e3a08231bc92 for instance bd3dcc6f-b789-4189-a00f-c87af6921f45 on n-h2-850468-18 Aug 25 12:42:48.840021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.864045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-de1cd921-7471-4219-bec1-4c47aa25b447 req-2fb8427c-27f9-4946-9606-532f235ed6e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131222 Aug 25 12:42:48.881311 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 765/1643] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:48.904494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1cadc-61f5-4d92-b04f-0f4cd58729eb", "name": "network-vif-deleted", "tag": "e417e798-1d1c-48b5-90b1-a7665079f1ea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:48.946909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:48.950303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:48.953100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:48.997738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] Creating event network-vif-deleted:e417e798-1d1c-48b5-90b1-a7665079f1ea for instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb on n-h2-850468-18 Aug 25 12:42:49.022426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-07f392ea-b537-455a-9079-2a872e1e861b req-189e7844-8b6e-4f22-bd64-a67ea6f25934 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133871 Aug 25 12:42:49.032829 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 766/1644] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:49.054806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-plugged", "status": "completed", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:49.102488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.107662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.109539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.156278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] Creating event network-vif-plugged:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:42:49.175715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b458d13a-e697-4849-8108-0d18231c04fa req-7abe8139-bd4e-456b-ac8e-cf29e105dbb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135195 Aug 25 12:42:49.180533 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 767/1645] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:49.313570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:49.319670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:49.352351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.359795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.362279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.366137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:49.367664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:49.382747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:49.970628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.048709 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a387c549-b77f-42bc-947c-9209dab4a250 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 1.283493 Aug 25 12:42:50.056107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 879/1646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:48 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:50.119149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.123981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:50.157465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.158304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.159129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.160683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.161343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.162155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.269145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.302656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.310492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.317815 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-232569d9-f4d8-4723-a77d-1052d15fd7d6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 1.031268 Aug 25 12:42:50.319301 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 768/1647] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:49 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:50.353239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf6fcf4a-ba0b-43d3-b36f-0f770e58e4b1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2acaf70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.585721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf6fcf4a-ba0b-43d3-b36f-0f770e58e4b1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.263381 Aug 25 12:42:50.605322 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 769/1648] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:50 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:50.615059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.653848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: a0a1cadc-61f5-4d92-b04f-0f4cd58729eb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:50.687479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.690127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.696004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:50.701920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.704931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.706494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.708049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.746597 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1765573-196a-44fe-b504-2156679c513f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1272 microversion: 2.1 time: 0.680549 Aug 25 12:42:50.747739 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 880/1649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:50 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1272 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:50.780665 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] HTTP exception thrown: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Request method failure captured: Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb HTTP/1.1 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB20_eeGp7RTcROnk1QRSGqLoNecH8wjYXrGOM2AQuWaPrzBLmPmLnQnvhdM4TdyiscW1sdeVgCWq6PHcB7-ZIOiCdnpLZXtAxtgxIPbBFifyx76fSEEgZnCHIua3fPbtrI0P-aJ2lTU37oGyQEWK-I0O9pf3pBM6ovfFjj5bjx4gQ1Y Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ec8a9d2d442e476d88dc76f2d27bbfad Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ec8a9d2d442e476d88dc76f2d27bbfad Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListImageFiltersTestJSON-725674608-project Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a2ea8427596f4ab6b4727f7b0d519177 Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListImageFiltersTestJSON-725674608-project Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a0a1cadc-61f5-4d92-b04f-0f4cd58729eb'} Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:42:50.784905 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. Aug 25 12:42:50.799028 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:42:50.809377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Returning 404 to user: Instance a0a1cadc-61f5-4d92-b04f-0f4cd58729eb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:42:50.811050 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02954a21-354a-4fc0-8836-52abc0199866 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb" status: 404 len: 111 microversion: 2.1 time: 0.203062 Aug 25 12:42:50.812601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 770/1650] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:50 2022] GET /compute/v2.1/servers/a0a1cadc-61f5-4d92-b04f-0f4cd58729eb => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:42:50.828836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:50.832109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:50.861684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.865344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.867574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.877304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.878541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.880759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.902505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3dcc6f-b789-4189-a00f-c87af6921f45", "tag": "ffbaa69c-ea08-4665-97ef-e3a08231bc92"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:50.941392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:50.942615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:50.945157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:50.989152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:42:50.998572 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] Creating event network-changed:ffbaa69c-ea08-4665-97ef-e3a08231bc92 for instance bd3dcc6f-b789-4189-a00f-c87af6921f45 on n-h2-850468-18 Aug 25 12:42:51.012782 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8fc72e65-220a-487f-bfc0-2004eca9c9de req-d091e063-4f99-4c81-8769-13f26e8d56fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117397 Aug 25 12:42:51.014654 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 771/1651] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:51.113289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:51.119513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:51.160890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.161763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.162538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.163807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.166011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.186652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.375945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bcb4a7af-fbae-4d32-b0ab-975e0b1e7edc tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 204 len: 0 microversion: 2.1 time: 0.554718 Aug 25 12:42:51.378118 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 881/1652] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:42:50 2022] DELETE /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:42:51.396303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:51.398810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:51.416136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.419386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.425015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:51.427634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:51.429832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:51.433619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.052850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.082924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f11d4bf-4e66-45d6-92f6-6d501cc19b43 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 0.987172 Aug 25 12:42:52.097490 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 772/1653] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:51 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:52.151232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:52.155775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:52.197159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.222255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.223170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.223978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.231468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.233259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.234157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.242152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.256997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:52.262411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-10e6a38e-679b-4030-a31a-3e01bf1e155b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 0.881515 Aug 25 12:42:52.267670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 882/1654] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:51 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:52.285160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a29437b9-faed-4ad0-982e-4d20b7817fff tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2674550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:52.490210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a29437b9-faed-4ad0-982e-4d20b7817fff tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.216985 Aug 25 12:42:52.492010 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 883/1655] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:52 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:52.516420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:52.518345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:52.534240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:52.540064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.544180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.544180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:52.545156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:52.546794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:52.548225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.000495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:53.039903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d99285c-50bd-4ede-874d-8711c5b8052d tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1474 microversion: 2.1 time: 0.939853 Aug 25 12:42:53.042466 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 773/1656] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:52 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1474 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:53.137892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:53.142822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:53.198792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.207032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.208330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.209901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.215690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.216549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.319456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:53.671685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:53.748320 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79fcda18-32ca-4150-9e7c-4c142f7aec60 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 1.244138 Aug 25 12:42:53.752792 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 884/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:52 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:53.801187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:53.803038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:53.835414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.842279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.845874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:53.848685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:53.850182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:53.852297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.685259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=10 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:54.755479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:54.788778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:54.847303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c86c8be-114b-4e73-8b9f-0b1d0ddbdd97 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 1.717517 Aug 25 12:42:54.848438 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 774/1658] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:53 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:42:54.868646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d331e01e-d961-4a8c-9692-09398c935198", "name": "network-vif-plugged", "status": "completed", "tag": "d3243244-efb5-429f-8f5e-17f3ece1ceaf"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:42:54.914710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:54.918324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:54.922864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:54.985683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] Creating event network-vif-plugged:d3243244-efb5-429f-8f5e-17f3ece1ceaf for instance d331e01e-d961-4a8c-9692-09398c935198 on n-h1-850468-18 Aug 25 12:42:55.036546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b73f3631-d799-4f46-8054-f6f4cd8b06d8 req-89142912-871d-4819-8ff5-15d4de3fade2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178276 Aug 25 12:42:55.038230 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 775/1659] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:42:55.059255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dac19210-b1a1-42ac-b613-aebf97d4b971 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2c73160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:55.249693 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dac19210-b1a1-42ac-b613-aebf97d4b971 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.199120 Aug 25 12:42:55.258535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 776/1660] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:55 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:55.288049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:55.300489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:55.337740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:55.339331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:55.340875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:55.342719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:55.351351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:55.352799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:57.313510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:57.334134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=28 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:42:57.355490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:57.362896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:57.372184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90346093-2666-4168-bd74-49a2328090a3 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 3.609619 Aug 25 12:42:57.388333 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 885/1661] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:42:53 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 3623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:42:57.434981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:57.438013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:57.474034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:57.481280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:57.482922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:57.486837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:57.498378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:57.498378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.621772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:58.650213 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df2478cd-1f39-4fb4-9de1-6fe2cdd355f7 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1474 microversion: 2.1 time: 3.389603 Aug 25 12:42:58.662264 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 777/1662] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:55 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1474 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:58.710288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:42:58.718554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:42:58.800824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.802341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.806928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:58.818673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:42:58.821831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:42:58.826465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:42:59.599026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:42:59.673314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c4cf199-6468-4ba9-8f76-3e3dccdee507 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 2.266264 Aug 25 12:42:59.675997 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 886/1663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:57 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:42:59.725188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-69a31578-95b3-4c52-bed7-2648299d2740 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c257c0d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:00.015006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-69a31578-95b3-4c52-bed7-2648299d2740 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.327371 Aug 25 12:43:00.022769 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 887/1664] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:42:59 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:00.051389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:00.062564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:00.096678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.101249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.106437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.118347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.124619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.129856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.337977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:00.386331 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-24f1b4aa-719c-44f5-a720-0edb41bba2f3 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1372 microversion: 2.1 time: 1.721487 Aug 25 12:43:00.399146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 778/1665] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:42:58 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1372 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:00.445196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:00.456100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:00.523609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.531776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.533967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:00.535808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:00.541646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:00.543132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.725216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:01.766588 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ceab6816-ebcc-431f-a2f7-c08b9bb93025 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1474 microversion: 2.1 time: 1.361317 Aug 25 12:43:01.772783 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 779/1666] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:00 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1474 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:01.799339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:01.801081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:01.844410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.849579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.852877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.858027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:01.861701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:01.867989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:01.914777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:01.960180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:01.973076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:01.977804 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d34b3585-d43f-4f74-9bec-6b223ae96792 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 1.951943 Aug 25 12:43:01.980676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 888/1667] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:00 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:01.991942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f1d0520-28fb-4dd2-9fdc-b66e6006cfb9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c269e040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:02.218821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f1d0520-28fb-4dd2-9fdc-b66e6006cfb9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.230171 Aug 25 12:43:02.246163 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 889/1668] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:01 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:02.286315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:02.290633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:02.329750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.334408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.335649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:02.343752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:02.347942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:02.349243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:03.736511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:03.803462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca5a37c2-c707-45f8-a2d9-3e331ab5019d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 2.009643 Aug 25 12:43:03.814444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 780/1669] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:01 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:03.855881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c45e13-8607-4d91-ab48-0fdf7dde0d82", "tag": "ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:03.882470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:03.959913 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45a06222-58e9-4353-ade4-f747a851823e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1559 microversion: 2.1 time: 1.706445 Aug 25 12:43:03.966968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 890/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:02 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1559 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:03.983964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:03.986276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:03.991128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.002399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.022461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:04.078571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.082817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.084857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] Creating event network-changed:ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3 for instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 on n-h2-850468-18 Aug 25 12:43:04.085693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.088778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.090632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.091932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.110005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-373c63d1-d483-4fac-bd98-412226c51e8c req-b2f31283-7244-4b07-a079-6cb22b3bbc83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292478 Aug 25 12:43:04.114790 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 781/1671] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:04.148632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.153818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:04.213541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.215038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.216755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.221092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.224849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.229638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.355318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.361860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.365300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.374815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lazy-loading 'fault' on Instance uuid 1ee16592-eaac-4545-ab53-b72f5e57f808 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:04.506766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ea8427596f4ab6b4727f7b0d519177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8a9d2d442e476d88dc76f2d27bbfad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:04.547615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d826cf6-867f-4b54-bd2f-7e60aeff21b9 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 200 len: 1308 microversion: 2.1 time: 0.578459 Aug 25 12:43:04.555037 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 891/1672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:03 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:04.574595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61aa2ce4-8524-4e5e-8873-6912de031df3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c6cda1f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.754253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61aa2ce4-8524-4e5e-8873-6912de031df3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.195490 Aug 25 12:43:04.763231 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 892/1673] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:04 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:04.785764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:04.786950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:04.851787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.855004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.856168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:04.857741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:04.858836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:04.863315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.570878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:06.627799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:06.633971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:06.646482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd36c776-3e9c-473b-88bf-8d813f9b9eae tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 2.527816 Aug 25 12:43:06.647761 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 782/1674] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:04 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:06.665819 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a6076917-c0e9-4beb-b9c3-ba27bf92722f tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.899905 Aug 25 12:43:06.671993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:06.673892 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 893/1675] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:43:04 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-interface => generated 285 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:06.683247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:06.699669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:06.705945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] [instance: 1ee16592-eaac-4545-ab53-b72f5e57f808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:06.710321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.711201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.711979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.714146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.715208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.715975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.766897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.776504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.778386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.782658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:06.787741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:06.791036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:06.840472 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] HTTP exception thrown: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Request method failure captured: Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 HTTP/1.1 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB20_eeGp7RTcROnk1QRSGqLoNecH8wjYXrGOM2AQuWaPrzBLmPmLnQnvhdM4TdyiscW1sdeVgCWq6PHcB7-ZIOiCdnpLZXtAxtgxIPbBFifyx76fSEEgZnCHIua3fPbtrI0P-aJ2lTU37oGyQEWK-I0O9pf3pBM6ovfFjj5bjx4gQ1Y Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ec8a9d2d442e476d88dc76f2d27bbfad Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec8a9d2d442e476d88dc76f2d27bbfad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ec8a9d2d442e476d88dc76f2d27bbfad Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-725674608 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListImageFiltersTestJSON-725674608-project Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a2ea8427596f4ab6b4727f7b0d519177 Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListImageFiltersTestJSON-725674608-project Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '1ee16592-eaac-4545-ab53-b72f5e57f808'} Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:06.866507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Returning 404 to user: Instance 1ee16592-eaac-4545-ab53-b72f5e57f808 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9955cab8-62e3-42b5-8229-79bfb3e10c9c tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808" status: 404 len: 111 microversion: 2.1 time: 0.206123 Aug 25 12:43:06.884033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 894/1676] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:06 2022] GET /compute/v2.1/servers/1ee16592-eaac-4545-ab53-b72f5e57f808 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:06.896721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f7594a2-91aa-4bb6-ba1c-9eba12f8d1d9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c269e3a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:07.086023 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f7594a2-91aa-4bb6-ba1c-9eba12f8d1d9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.197598 Aug 25 12:43:07.087371 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 895/1677] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:06 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:07.106651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee16592-eaac-4545-ab53-b72f5e57f808", "name": "network-vif-deleted", "tag": "fec41195-cf02-4a49-9d65-a8528fce5adf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:07.144607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:07.160538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:07.161902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:07.207592 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] Creating event network-vif-deleted:fec41195-cf02-4a49-9d65-a8528fce5adf for instance 1ee16592-eaac-4545-ab53-b72f5e57f808 on n-h2-850468-18 Aug 25 12:43:07.222523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-108d8868-d325-4e15-8ee3-95e7cd29c60f req-ac1f2b73-d571-4303-a2b8-d11be529126c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131010 Aug 25 12:43:07.224043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 896/1678] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:07.241623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3eab97b-4a3f-4445-ba9c-ee6efee13a8e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25943a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:08.489084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3eab97b-4a3f-4445-ba9c-ee6efee13a8e tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94" status: 204 len: 0 microversion: 2.1 time: 1.262578 Aug 25 12:43:08.491498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 897/1679] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:07 2022] DELETE /compute/v2.1/images/aac37c0b-d18c-496e-b22b-dc813a9ead94 => generated 0 bytes in 1267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:08.502937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:08.504957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:08.539377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:08.545000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:08.546939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:08.552665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:08.553966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:08.558203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:08.688134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:09.042044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:09.076483 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d65cc08-eeb3-4985-9a73-4751574f2d72 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 2.426114 Aug 25 12:43:09.082300 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 783/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:06 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:09.108352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c31098fa-241d-4234-9e8c-6ce34833c49b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2e5eaf0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:09.299638 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c31098fa-241d-4234-9e8c-6ce34833c49b tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.212525 Aug 25 12:43:09.303891 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 784/1681] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:09 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:09.770529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:09.825047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:09.844506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:09.847937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41ec57c5-95c2-4375-ae08-8e642e1cde03 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 1.353981 Aug 25 12:43:09.863966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Calling method '.version_select at 0x7fc6c2d68550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:09.869791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 898/1682] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:08 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:09.897621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48743c3a-1b3f-4a78-b010-6b9cf1325477 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c25965e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:09.976719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:43:09.977582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.security_group_api [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Neutron security group 2331bdf5-03a2-4170-be1f-936fb8347533 not found {{(pid=122700) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:43:09.978609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] HTTP exception thrown: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:09.978609 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Request method failure captured: Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-security-groups/2331bdf5-03a2-4170-be1f-936fb8347533 HTTP/1.1 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB25b243efEslBDAC336YaHBQ_KnTR0n82AGoeV9VfX924xLTe4uNp2bLAxvTYrvhU0CnZQpofsJZ4sO6aR8vIH2O9cBrtJA3hzAmdonLcm0WEm9pZP3zSj0jYyKMJrQDHOreruKpWZoF1NiEhz44xdLE5QTNO9vjJYCmxyakOw4_Ux4 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 82080d0f9747437f98f419ec170c3070 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: exception: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '2331bdf5-03a2-4170-be1f-936fb8347533'} Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:43:09.996899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] Aug 25 12:43:10.003737 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:10.011778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Returning 404 to user: Security group 2331bdf5-03a2-4170-be1f-936fb8347533 does not exist Aug 25 12:43:10.011778 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-be959856-2b13-46e7-bd32-6772818753f8'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:10.011778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35a83dc2-86ce-4f26-b8f4-ce84f054cc0e tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/2331bdf5-03a2-4170-be1f-936fb8347533" status: 404 len: 194 microversion: 2.1 time: 0.700983 Aug 25 12:43:10.011778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 785/1683] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:43:09 2022] DELETE /compute/v2.1/os-security-groups/2331bdf5-03a2-4170-be1f-936fb8347533 => generated 194 bytes in 707 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:10.030795 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1901ca4-bacf-49d6-9f1a-38631f119e77 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009321 Aug 25 12:43:10.039241 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 786/1684] 10.222.0.60 () {58 vars in 1164 bytes} [Thu Aug 25 12:43:10 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 12:43:10.053107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-862cf089-a534-457e-b52b-7eeaa99051b6 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Calling method '.version_select at 0x7fc6c304f940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:10.881787 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48743c3a-1b3f-4a78-b010-6b9cf1325477 tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7" status: 204 len: 0 microversion: 2.1 time: 1.007313 Aug 25 12:43:10.885614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 899/1685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:09 2022] DELETE /compute/v2.1/images/646762e1-861d-48d5-9672-b40899b490a7 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:10.911679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:10.919869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:10.938676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.941804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.943225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:10.945295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:10.946898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:10.950072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.596896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:12.636378 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ed72b75-afca-4596-abfe-6b263c821fd2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 1.743246 Aug 25 12:43:12.646253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 900/1686] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:10 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:12.669318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f1c0fca-5164-44fe-8230-db59f7f4fd0a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2594a60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.749974 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-862cf089-a534-457e-b52b-7eeaa99051b6 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.702170 Aug 25 12:43:12.752562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 787/1687] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:43:10 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:43:12.796639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d671d6a-0799-48c2-bcc2-00e91d401c9b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] Calling method '.version_select at 0x7fc6c2c19dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.820362 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f1c0fca-5164-44fe-8230-db59f7f4fd0a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.171271 Aug 25 12:43:12.822360 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 901/1688] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:12 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:12.836927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:12.839561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:12.863992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.865616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.866966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:12.869020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:12.877797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:12.882915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:13.915440 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d671d6a-0799-48c2-bcc2-00e91d401c9b tempest-ListImageFiltersTestJSON-725674608 tempest-ListImageFiltersTestJSON-725674608-project] 10.222.0.60 "DELETE /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca" status: 204 len: 0 microversion: 2.1 time: 1.160474 Aug 25 12:43:13.917927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 788/1689] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:12 2022] DELETE /compute/v2.1/images/9cddd238-69e0-49b8-b7cd-09c2925861ca => generated 0 bytes in 1164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:13.951863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Calling method '.version_select at 0x7fc6c25f6d30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:15.067633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:15.086591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:43:15.090513 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 25 12:43:15.090513 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Request method failure captured: Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-security-groups/71fb783a-1968-4aa6-ae78-0b2fa7fb6b5a HTTP/1.1 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB25b243efEslBDAC336YaHBQ_KnTR0n82AGoeV9VfX924xLTe4uNp2bLAxvTYrvhU0CnZQpofsJZ4sO6aR8vIH2O9cBrtJA3hzAmdonLcm0WEm9pZP3zSj0jYyKMJrQDHOreruKpWZoF1NiEhz44xdLE5QTNO9vjJYCmxyakOw4_Ux4 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 82080d0f9747437f98f419ec170c3070 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: exception: Insufficient rights for removing default security group. Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '71fb783a-1968-4aa6-ae78-0b2fa7fb6b5a'} Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:43:15.095331 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] Aug 25 12:43:15.112530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.141138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 25 12:43:15.141138 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-e2914521-5336-4015-b049-3a82c75222f5'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:15.147258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-831b8799-561b-41bb-9734-dacaae1a9b4f tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/71fb783a-1968-4aa6-ae78-0b2fa7fb6b5a" status: 400 len: 182 microversion: 2.1 time: 1.219746 Aug 25 12:43:15.148979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 789/1690] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:43:13 2022] DELETE /compute/v2.1/os-security-groups/71fb783a-1968-4aa6-ae78-0b2fa7fb6b5a => generated 182 bytes in 1230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:43:15.172477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:15.185286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:15.195438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:15.212839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-104a56b9-768c-4cc7-b2ec-9645c8b49ba9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1486 microversion: 2.25 time: 2.380684 Aug 25 12:43:15.215773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:15.220839 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 902/1691] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:12 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1486 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:15.237159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:15.253073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ded3be2c-e9ed-440c-b141-29b4e61688b8 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c6ceedc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:15.303743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.304636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.312955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.314747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:15.324084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:15.325466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:15.344219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=87 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:15.491795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ded3be2c-e9ed-440c-b141-29b4e61688b8 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.268995 Aug 25 12:43:15.526210 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 903/1692] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:15 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:15.574910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Calling method '.version_select at 0x7fc6c2599670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:15.684445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:43:15.685954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Neutron security group aad72d22-041e-4a97-87a8-38867ebfce4d not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:43:15.687183 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] HTTP exception thrown: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.687183 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Request method failure captured: Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-security-groups/aad72d22-041e-4a97-87a8-38867ebfce4d HTTP/1.1 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB25b243efEslBDAC336YaHBQ_KnTR0n82AGoeV9VfX924xLTe4uNp2bLAxvTYrvhU0CnZQpofsJZ4sO6aR8vIH2O9cBrtJA3hzAmdonLcm0WEm9pZP3zSj0jYyKMJrQDHOreruKpWZoF1NiEhz44xdLE5QTNO9vjJYCmxyakOw4_Ux4 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 82080d0f9747437f98f419ec170c3070 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'aad72d22-041e-4a97-87a8-38867ebfce4d'} Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:43:15.695070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] Aug 25 12:43:15.706216 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:15.721884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Returning 404 to user: Security group aad72d22-041e-4a97-87a8-38867ebfce4d does not exist Aug 25 12:43:15.721884 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-1fd956c0-4298-4d43-b1df-d394d0410e2a'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:15.725753 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-191b628d-cfaf-4342-b577-271413adfa6d tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/aad72d22-041e-4a97-87a8-38867ebfce4d" status: 404 len: 194 microversion: 2.1 time: 0.179467 Aug 25 12:43:15.732732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 904/1693] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:43:15 2022] GET /compute/v2.1/os-security-groups/aad72d22-041e-4a97-87a8-38867ebfce4d => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:15.758948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Action: 'update', calling method: .version_select at 0x7fc6c2592310>, body: {"security_group": {"name": "tempest-sg-1214726596", "description": "tempest-description-1717128386"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:16.054381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:43:16.055777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Neutron security group 9e1509f6-c67c-446d-9736-0f744d2f3682 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:43:16.056934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] HTTP exception thrown: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.056934 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Request method failure captured: Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/os-security-groups/9e1509f6-c67c-446d-9736-0f744d2f3682 HTTP/1.1 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 102 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB25b243efEslBDAC336YaHBQ_KnTR0n82AGoeV9VfX924xLTe4uNp2bLAxvTYrvhU0CnZQpofsJZ4sO6aR8vIH2O9cBrtJA3hzAmdonLcm0WEm9pZP3zSj0jYyKMJrQDHOreruKpWZoF1NiEhz44xdLE5QTNO9vjJYCmxyakOw4_Ux4 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0d1601317d6d46209e33b54eeff5fe8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0d1601317d6d46209e33b54eeff5fe8e Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-759153877 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 82080d0f9747437f98f419ec170c3070 Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-759153877-project Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: {"security_group": {"name": "tempest-sg-1214726596", "description": "tempest-description-1717128386"}} Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9e1509f6-c67c-446d-9736-0f744d2f3682', 'body': {'security_group': {'name': 'tempest-sg-1214726596', 'description': 'tempest-description-1717128386'}}} Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:43:16.063197 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] Returning 404 to user: Security group 9e1509f6-c67c-446d-9736-0f744d2f3682 does not exist Aug 25 12:43:16.080973 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-6c5c72db-4f74-4214-bee8-cf57f2acb669'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:16.098025 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0bc6aa85-3210-4e03-88e4-b47ec2e1ab40 tempest-SecurityGroupsNegativeTestJSON-759153877 tempest-SecurityGroupsNegativeTestJSON-759153877-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/9e1509f6-c67c-446d-9736-0f744d2f3682" status: 404 len: 194 microversion: 2.1 time: 0.342527 Aug 25 12:43:16.098025 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 905/1694] 10.222.0.60 () {60 vars in 1290 bytes} [Thu Aug 25 12:43:15 2022] PUT /compute/v2.1/os-security-groups/9e1509f6-c67c-446d-9736-0f744d2f3682 => generated 194 bytes in 351 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:16.169645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d331e01e-d961-4a8c-9692-09398c935198", "tag": "d3243244-efb5-429f-8f5e-17f3ece1ceaf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:16.257423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.264742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.265702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.348296 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] Creating event network-changed:d3243244-efb5-429f-8f5e-17f3ece1ceaf for instance d331e01e-d961-4a8c-9692-09398c935198 on n-h1-850468-18 Aug 25 12:43:16.387261 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-160ad651-3ca5-4fc5-a4e5-a0a49e261ca3 req-2eb3e6f1-6a41-435a-9405-5626d668d436 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290812 Aug 25 12:43:16.396036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 906/1695] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:16.428321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:16.437785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:16.473942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.477604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.478737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.482922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:16.488228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:16.491303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:16.965584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:17.036296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18ecbc69-e36f-4fb3-a297-5186a003150f tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 1.877712 Aug 25 12:43:17.058101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 790/1696] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:15 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:17.122197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00d123de-8212-404d-a304-32a2cbfc65a7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2acaf70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:17.398629 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00d123de-8212-404d-a304-32a2cbfc65a7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.337017 Aug 25 12:43:17.399733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 791/1697] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:17 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:18.093708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:18.095007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:18.137704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.138642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.139490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:18.140830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:18.141787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:18.147119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:19.212980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:19.293554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:19.308711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:19.312444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c57b936-6d3b-465c-8390-84066ecfcc55 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1476 microversion: 2.25 time: 2.913379 Aug 25 12:43:19.327269 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 907/1698] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:16 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1476 bytes in 2930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:19.356479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c45e13-8607-4d91-ab48-0fdf7dde0d82", "name": "network-vif-plugged", "status": "completed", "tag": "ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:19.455042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:19.465119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:19.473134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:19.589482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] Creating event network-vif-plugged:ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3 for instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 on n-h2-850468-18 Aug 25 12:43:19.639299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bf26f099-e3da-4750-9e70-fdaea117641f req-5736a7bf-3ef2-4de4-8133-b80b262ad6dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309074 Aug 25 12:43:19.640339 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 908/1699] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:19.701209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b394aca-bb20-43f0-84b7-e0e8d30fddb9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c6cda310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:19.974647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b394aca-bb20-43f0-84b7-e0e8d30fddb9 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.315310 Aug 25 12:43:19.980838 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 909/1700] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:19 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:20.025480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd2b9a01-cbeb-4a3f-9366-8f6193745215 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '.version_select at 0x7fc6c25d6310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:20.045004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd2b9a01-cbeb-4a3f-9366-8f6193745215 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.045961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd2b9a01-cbeb-4a3f-9366-8f6193745215 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.046774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd2b9a01-cbeb-4a3f-9366-8f6193745215 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.099181 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd2b9a01-cbeb-4a3f-9366-8f6193745215 tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 2804 microversion: 2.25 time: 0.105947 Aug 25 12:43:20.108244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 910/1701] 10.222.0.60 () {60 vars in 1184 bytes} [Thu Aug 25 12:43:19 2022] GET /compute/v2.1/os-migrations => generated 2804 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:20.141335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:20.143031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:20.199558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.200328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.211691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:20.213920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:20.219843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:20.222820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:21.503286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:21.520999 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8bcf0028-7f41-441d-850a-7076a549bb16 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1314 microversion: 2.1 time: 3.440300 Aug 25 12:43:21.527166 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 792/1702] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:18 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1314 bytes in 3448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:21.550106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-863f4dde-73fd-4009-8dec-2906a1e3bb15 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2aca280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:21.667639 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-863f4dde-73fd-4009-8dec-2906a1e3bb15 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.137235 Aug 25 12:43:21.670401 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 793/1703] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:22.220653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbd60108-32c9-4658-bc0c-efed024bc89a tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] Calling method '.version_select at 0x7fc6c25f6ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:22.422748 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbd60108-32c9-4658-bc0c-efed024bc89a tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] 10.222.0.60 "GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5" status: 200 len: 784 microversion: 2.1 time: 0.686871 Aug 25 12:43:22.424015 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 794/1704] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:21 2022] GET /compute/v2.1/images/3f4244a5-c143-4666-878e-6ff8b102f5a5 => generated 784 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:43:22.498004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] Lazy-loading 'services' on Instance uuid bd3dcc6f-b789-4189-a00f-c87af6921f45 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:22.542199 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-630a89b0-e3c5-40d6-b04c-d3299a70d15a tempest-LiveAutoBlockMigrationV225Test-897552404 tempest-LiveAutoBlockMigrationV225Test-897552404-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1970 microversion: 2.25 time: 2.408853 Aug 25 12:43:22.543917 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 911/1705] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:20 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1970 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:43:22.555383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22905d0e-8d27-4867-a3c5-2c0a3f65b15b tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] Calling method '.version_select at 0x7fc6c257c4c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:22.946098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22905d0e-8d27-4867-a3c5-2c0a3f65b15b tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] 10.222.0.60 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.399467 Aug 25 12:43:22.952101 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 912/1706] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 25 12:43:22 2022] GET /compute/v2.1/images => generated 871 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:22.968205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:22.968205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:23.018374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.019207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.020027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.021432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.022329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.023149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.323853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7ae24fd-892a-46e5-8c7e-11f2432e84de tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Action: 'create', calling method: .version_select at 0x7fc6c2594e50>, body: {"keypair": {"name": "tempest-keypair-1629960193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD9cDX00Yv4anuo6bkvAgLJ5IK0EmXbdZNR2q/6eNM5qu/PFGT60KCn8Wd5gb0XCu6tTJTi0zHeFB10c/YczXiqm5ViiUle3SNtqd7GAV7JULOnGztvNwHdZJwb1xNBpA=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:23.395933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:23.451638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e7ae24fd-892a-46e5-8c7e-11f2432e84de tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for project 2c520e65f6964fb79c8a415685db20d8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:23.500797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e7ae24fd-892a-46e5-8c7e-11f2432e84de tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for user 2c530eca6b6141eb81c0b0f2ddfbc925 and project 2c520e65f6964fb79c8a415685db20d8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:23.644970 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7ae24fd-892a-46e5-8c7e-11f2432e84de tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.658011 Aug 25 12:43:23.647025 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 913/1707] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:23.674044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:23.675197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:23.722402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.726442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.728944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:23.733572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:23.736650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:23.740895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.754298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:24.786797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c15f3ef-3522-42a4-be21-fb31a54682c6 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1502 microversion: 2.1 time: 1.135226 Aug 25 12:43:24.796362 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 914/1708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:23 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1502 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:24.815422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:24.821954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:24.859348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.860941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.866469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.868265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c04f8fbe-3bce-4c3f-a65d-1ebad4f84e93 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1814 microversion: 2.1 time: 2.440929 Aug 25 12:43:24.880318 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 795/1709] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:22 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1814 bytes in 2454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:24.894203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:24.895987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:24.897486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:24.901908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c7faa85-dbc2-4ee1-ae37-f4325ea7b258 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2ec5160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:25.008030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:43:25.143911 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c7faa85-dbc2-4ee1-ae37-f4325ea7b258 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.261614 Aug 25 12:43:25.152497 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 796/1710] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:24 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:25.163965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3aefe656-c005-4199-9872-e49f6d0c1213 tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] Calling method '.version_select at 0x7fc6c28be280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:25.400512 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3aefe656-c005-4199-9872-e49f6d0c1213 tempest-ListImagesTestJSON-1807953868 tempest-ListImagesTestJSON-1807953868-project] 10.222.0.60 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.244890 Aug 25 12:43:25.427567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 797/1711] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:43:25 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:25.427567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:25.457312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:25.551209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.561351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.572925 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b2dc135-a206-4852-bb5e-b24a5f40c4bf tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 204 len: 0 microversion: 2.25 time: 0.772928 Aug 25 12:43:25.572925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 915/1712] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:43:24 2022] DELETE /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:43:25.581974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.591135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.592644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.598027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:25.600214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.617339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.623097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.624212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.633944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.638958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.639725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.768731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lazy-loading 'flavor' on Instance uuid 85c45e13-8607-4d91-ab48-0fdf7dde0d82 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:25.818101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73e000cf-2050-45e5-bba1-9929889c03db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.245961 Aug 25 12:43:25.832762 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 916/1713] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:43:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:25.856501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:25.858260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:25.903849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.909272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.917558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:25.919365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:25.923976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:25.933521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.349771 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f214fa3-b752-4ab6-9b7b-69dd3abb8d21 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "POST /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82/action" status: 202 len: 0 microversion: 2.1 time: 0.938209 Aug 25 12:43:26.351002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 798/1714] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:43:25 2022] POST /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82/action => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:26.389450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e8e3582-5519-429e-b55c-b54aef968820 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2dc3b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:26.673379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e8e3582-5519-429e-b55c-b54aef968820 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.317704 Aug 25 12:43:26.686640 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 799/1715] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:26 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:26.706706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:26.708359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:26.743291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.752883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.755294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.757187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:26.762316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:26.763596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:26.874652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.953743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.959762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:26.970732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3799f9ea-7b6b-4b29-bb22-4befcf254ee5 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1482 microversion: 2.25 time: 1.135734 Aug 25 12:43:26.992625 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 917/1716] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:25 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1482 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:27.719210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f773083f-0d4a-428f-8ef7-f48a45474295 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c257c550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:27.939793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f773083f-0d4a-428f-8ef7-f48a45474295 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.233773 Aug 25 12:43:27.945406 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 918/1717] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:27 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:43:28.033912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:28.034564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:28.035374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:28.060285 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f38ad44-2cfa-44b6-80cc-dcc8ea900aa1 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1510 microversion: 2.1 time: 1.371444 Aug 25 12:43:28.074010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 800/1718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:26 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1510 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:28.099521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.101542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.103114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.122547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:28.123983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:28.125697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:28.974843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fed9935-b2ee-42ef-b325-6cc2706f5c62 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c25a7ee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.272468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fed9935-b2ee-42ef-b325-6cc2706f5c62 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.308799 Aug 25 12:43:29.290801 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 801/1719] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:28 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:43:29.359951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:29.361212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:29.386643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.398592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.404641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:29.407894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:29.409774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:29.410968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.378924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.425939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37cd06ab-2c63-4a22-88c6-a8868a5ed5da tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1493 microversion: 2.1 time: 2.126366 Aug 25 12:43:31.433695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 802/1720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:29 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1493 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:31.459054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32bca095-ae4e-4a5b-8443-e52396480f8f tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c28bee50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.550989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.601814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.622718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:31.644519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40644860-c0de-4581-9f36-d122534d1304 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1482 microversion: 2.25 time: 3.612209 Aug 25 12:43:31.676460 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 919/1721] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:28 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1482 bytes in 3651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:43:31.719798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:31.737847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:31.739018 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32bca095-ae4e-4a5b-8443-e52396480f8f tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.299264 Aug 25 12:43:31.743343 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 803/1722] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:31 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:31.817027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.820237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.829077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:31.843959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:31.859354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:31.860897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.101942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:43:32.471342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11cca7a2-2bd7-47c9-8cd6-550028ebd740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 204 len: 0 microversion: 2.1 time: 0.783794 Aug 25 12:43:32.473615 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 920/1723] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:31 2022] DELETE /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:32.491553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:32.506028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:32.552579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.565861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.569248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.570952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.571788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.581890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.707865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:32.709545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:32.749994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.752482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.754022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:32.760874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:32.785439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:32.791754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:33.553600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:33.632688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:33.670478 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10196ac7-12c4-4975-b7a7-03ee71e81885 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1499 microversion: 2.1 time: 1.189263 Aug 25 12:43:33.711718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 804/1724] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:32 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1499 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:33.768489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fdc37329-d06a-4ac3-b322-823483fea993 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2f51ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:33.969658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:34.038408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:34.047764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:34.055416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-703d17dc-4eec-4aa9-8f8b-18ddb4203db6 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1482 microversion: 2.25 time: 1.357793 Aug 25 12:43:34.056531 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fdc37329-d06a-4ac3-b322-823483fea993 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1428 microversion: 2.1 time: 0.322967 Aug 25 12:43:34.059534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 921/1725] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:32 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1482 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:34.107997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b166eef-99d7-4e89-b8e1-8a4916c04078", "device": "/dev/xvdb"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:34.109340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 805/1726] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:33 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1428 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:34.136238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:34.170812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:34.173663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:34.177606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:34.184974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:34.191590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:34.195579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.041810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1123d864-091c-4a42-af9c-b7d8555d34e0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c26f2ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkfUvU8orwMLISerPDCEyioRlfhL3CyJM1Bid/OcPDgMZVdM86zmOvXPkOWff2xqS+DYlWdgPYlf5PexT5+0S8LZ++hQ1b+suEMZ/0M+B45p8x2RH7IGmXmEaWayjsznA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:35.079124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1123d864-091c-4a42-af9c-b7d8555d34e0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 257 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkfUvU8orwMLISerPDCEyioRlfhL3CyJM1Bid/OcPDgMZVdM86zmOvXPkOWff2xqS+DYlWdgPYlf5PexT5+0S8LZ++hQ1b+suEMZ/0M+B45p8x2RH7IGmXmEaWayjsznA=="}} Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkfUvU8orwMLISerPDCEyioRlfhL3CyJM1Bid/OcPDgMZVdM86zmOvXPkOWff2xqS+DYlWdgPYlf5PexT5+0S8LZ++hQ1b+suEMZ/0M+B45p8x2RH7IGmXmEaWayjsznA=='}}} Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 25 12:43:35.105889 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 25 12:43:35.117702 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:35.132290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1123d864-091c-4a42-af9c-b7d8555d34e0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:35.134277 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1123d864-091c-4a42-af9c-b7d8555d34e0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 1.016244 Aug 25 12:43:35.144485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 806/1727] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 1029 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:43:35.158813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.159997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.207770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.209034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.210140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.211755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.213480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.214534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.701043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:35.795105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:35.795956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7fd77fc6-68d9-4566-b0bc-bd527e68ffdf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.723996 Aug 25 12:43:35.797269 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 922/1728] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:43:34 2022] POST /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 194 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:35.834206 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-485c5d4a-9454-4539-8371-b2ebc399e79d tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1499 microversion: 2.1 time: 0.682924 Aug 25 12:43:35.839096 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 807/1729] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1499 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:35.850234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3dcc6f-b789-4189-a00f-c87af6921f45", "name": "network-vif-deleted", "tag": "ffbaa69c-ea08-4665-97ef-e3a08231bc92"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:35.858316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:35.865522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:35.906862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.909733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.914463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.960570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.980071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.980071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.980071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:35.980071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:35.980071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:35.997347 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] Creating event network-vif-deleted:ffbaa69c-ea08-4665-97ef-e3a08231bc92 for instance bd3dcc6f-b789-4189-a00f-c87af6921f45 on n-h1-850468-18 Aug 25 12:43:36.027029 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d90e61ab-540b-4e1e-ba51-9802407ee5a7 req-a4a3d603-74b1-44b9-ae25-5e6408e639b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214823 Aug 25 12:43:36.038013 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 923/1730] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:36.060676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe095301-af11-47e0-a1a1-423cb93e3f92 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c25874c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:36.582909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:36.618743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:36.645867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:36.660708 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c8f11fe-842b-4e35-8dc4-727995ce2bf7 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.817585 Aug 25 12:43:36.667351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 808/1731] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:35 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:36.745936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c28bea60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-716287591", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:36.856419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:36.887306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for user ef47d5f54a0749dba0e486069f696e45 and project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:36.970846 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 2166 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-716287591", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:36.991328 n-d-850468-18 devstack@n-api.service[122700]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-716287591', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:36.996950 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a0409a2-639e-46cc-a68f-5607058b4e6a tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.287191 Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 809/1732] 10.222.0.60 () {60 vars in 1160 bytes} [Thu Aug 25 12:43:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:43:37.011992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:37.021415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:37.088821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.089976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.090674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:37.102932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:37.104591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:37.105711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:37.806257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23e2785f6ce2400896469dab52789ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d8c371cfcc4e59bd3ce4124f12f892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:37.872399 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-89576cc8-91bb-4139-a791-879cc35ca664 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 200 len: 1457 microversion: 2.1 time: 0.876071 Aug 25 12:43:37.877026 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 810/1733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:36 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 1457 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:37.888788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae18fc0e-0560-43bd-a213-1257a1bdee10 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c25f6550>, body: {"keypair": {"name": "tempest-keypair-1129461397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM/gbV97tDHGUYomukxAsO5OAgrTOgmVvLMkwn+ZnhcBqaf/7iKmgOqQA7ZnlOfuR3cxa4WdNLvHc9gi3pXOsIx/EOf/1/idhNlkyna28y3sfnOZCYcSBE4hIqX6C5pvg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:38.053991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ae18fc0e-0560-43bd-a213-1257a1bdee10 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:38.111316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ae18fc0e-0560-43bd-a213-1257a1bdee10 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for user ef47d5f54a0749dba0e486069f696e45 and project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:38.264589 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae18fc0e-0560-43bd-a213-1257a1bdee10 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376062 Aug 25 12:43:38.267926 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 811/1734] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:38.331569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:38.334683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:38.393451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.396849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.398525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.408086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.414310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.416070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:38.726426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.779966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.790472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:38.813477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b128daa9-9bfc-4b9f-947c-587a7a69d7d0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.533808 Aug 25 12:43:38.823349 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 812/1735] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:38 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:38.857121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c45e13-8607-4d91-ab48-0fdf7dde0d82", "name": "network-vif-deleted", "tag": "ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:38.909692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:38.915645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:38.933180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.041775 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] Creating event network-vif-deleted:ffa35fd0-7d94-4b80-8ab8-bb0a67ded5b3 for instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 on n-h2-850468-18 Aug 25 12:43:39.102630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-be3cd79e-b8af-4dad-a5ca-dae7286de4c2 req-a91bbb35-f9ec-4a5b-b853-9ab82201c00b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275595 Aug 25 12:43:39.106846 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 813/1736] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:39.164460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c26f2280>, body: {"keypair": {"name": "tempest-keypair-1129461397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbPPBXjndryAU6HHH57PSsstquWGbDKBtezRyLNUNPjTF3cSH5PFo7tPsFUzXqy41I9EG0Jy5eC12x+jhMYyQrprK2oIACvCEaE82FuBq2C7ppEQr/bTiaYVcF91cvhAg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:39.275566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:39.301121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for user ef47d5f54a0749dba0e486069f696e45 and project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:39.420028 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] HTTP exception thrown: Key pair 'tempest-keypair-1129461397' already exists. Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 273 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "tempest-keypair-1129461397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbPPBXjndryAU6HHH57PSsstquWGbDKBtezRyLNUNPjTF3cSH5PFo7tPsFUzXqy41I9EG0Jy5eC12x+jhMYyQrprK2oIACvCEaE82FuBq2C7ppEQr/bTiaYVcF91cvhAg=="}} Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: exception: Key pair 'tempest-keypair-1129461397' already exists. Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1129461397', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbPPBXjndryAU6HHH57PSsstquWGbDKBtezRyLNUNPjTF3cSH5PFo7tPsFUzXqy41I9EG0Jy5eC12x+jhMYyQrprK2oIACvCEaE82FuBq2C7ppEQr/bTiaYVcF91cvhAg=='}}} Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ef47d5f54a0749dba0e486069f696e45-tempest-keypair-1129461397' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 25 12:43:39.448393 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi session.flush() Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result.read() Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 25 12:43:39.458616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ef47d5f54a0749dba0e486069f696e45-tempest-keypair-1129461397' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 25, 12, 43, 39, 399447), 'updated_at': None, 'name': 'tempest-keypair-1129461397', 'user_id': 'ef47d5f54a0749dba0e486069f696e45', 'fingerprint': '87:fa:07:c4:9c:ce:89:9b:85:7f:47:3f:49:57:b6:37', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbPPBXjndryAU6HHH57PSsstquWGbDKBtezRyLNUNPjTF3cSH5PFo7tPsFUzXqy41I9EG0Jy5eC12x+jhMYyQrprK2oIACvCEaE82FuBq2C7ppEQr/bTiaYVcF91cvhAg==', 'type': 'ssh'}] Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair.create() Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._create() Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1129461397' already exists. Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 25 12:43:39.481144 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1129461397' already exists. Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1129461397' already exists. Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 409 to user: Key pair 'tempest-keypair-1129461397' already exists. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c14ac38-d393-43ca-800f-7601534898e2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.329231 Aug 25 12:43:39.498092 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 814/1737] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:39 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 347 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:43:39.503970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:39.514198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:39.560501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.561768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.562616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.564020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.565135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.565982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.664614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 HTTP/1.1 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85c45e13-8607-4d91-ab48-0fdf7dde0d82'} Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.685726 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.696344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:39.703461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5817584e-ce50-4d26-bc21-b5e6ee6513f7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 404 len: 111 microversion: 2.1 time: 0.219900 Aug 25 12:43:39.704945 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 815/1738] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:39 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:39.727601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-326bb6ea-430e-47a1-8d5f-d57755e6acdf tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Calling method '.version_select at 0x7fc6c2d68f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:39.797950 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-326bb6ea-430e-47a1-8d5f-d57755e6acdf tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129461397" status: 202 len: 0 microversion: 2.1 time: 0.091325 Aug 25 12:43:39.811199 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 816/1739] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:43:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129461397 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:43:39.836925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:39.847520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:39.908960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.909500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.910281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.916584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:39.925654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:39.928421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:39.981221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 HTTP/1.1 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85c45e13-8607-4d91-ab48-0fdf7dde0d82'} Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:39.983379 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:39.990335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:39.994204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:39.995953 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e982c46-1139-41e4-b902-ce9e24ed0bb5 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 404 len: 111 microversion: 2.1 time: 0.193948 Aug 25 12:43:39.997675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 817/1740] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:39 2022] DELETE /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:40.021103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b427a82-7d27-472b-b1ed-27507a292ea8 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c32e5940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2He9l7OlNLWAu6q7hcjFtoSPovM5BjpAvY/gw/e2OAogaihvRkyOy5ckn72hFv0tEyX1UyVjpN6vOrtWb8IAoMrczqCkpQJQNech0GhOqaWrHPgr5ZczPvrOmD9L50jw=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b427a82-7d27-472b-b1ed-27507a292ea8 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 247 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2He9l7OlNLWAu6q7hcjFtoSPovM5BjpAvY/gw/e2OAogaihvRkyOy5ckn72hFv0tEyX1UyVjpN6vOrtWb8IAoMrczqCkpQJQNech0GhOqaWrHPgr5ZczPvrOmD9L50jw=="}} Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2He9l7OlNLWAu6q7hcjFtoSPovM5BjpAvY/gw/e2OAogaihvRkyOy5ckn72hFv0tEyX1UyVjpN6vOrtWb8IAoMrczqCkpQJQNech0GhOqaWrHPgr5ZczPvrOmD9L50jw=='}}} Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '' Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:43:40.032518 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 12:43:40.039151 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.053689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b427a82-7d27-472b-b1ed-27507a292ea8 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:40.056199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b427a82-7d27-472b-b1ed-27507a292ea8 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.051940 Aug 25 12:43:40.058207 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 818/1741] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:43:40.074421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:40.078485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:40.138414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.141803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.144445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.147659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.150952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.152930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.527711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:40.567654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:40.571151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:40.599333 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a825881-8ebc-4f99-9746-9edd3e6eeeb0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.539235 Aug 25 12:43:40.600465 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 819/1742] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:40 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:40.674435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:40.675713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 85c45e13-8607-4d91-ab48-0fdf7dde0d82] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:40.708844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.710338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.711468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.714887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:40.715950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:40.720543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:40.809584 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 HTTP/1.1 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85c45e13-8607-4d91-ab48-0fdf7dde0d82'} Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:40.816249 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. Aug 25 12:43:40.831227 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:40.834274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 85c45e13-8607-4d91-ab48-0fdf7dde0d82 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:40.836739 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22d11ed8-9271-48a9-a41f-0576808ae740 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82" status: 404 len: 111 microversion: 2.1 time: 0.234360 Aug 25 12:43:40.843662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 820/1743] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:40 2022] GET /compute/v2.1/servers/85c45e13-8607-4d91-ab48-0fdf7dde0d82 => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:40.885907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c2dc9b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508241705", "public_key": " "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:40.957077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:41.016454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for user ef47d5f54a0749dba0e486069f696e45 and project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:41.093592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 94 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508241705", "public_key": " "}} Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-508241705', 'public_key': ' '}}} Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.098616 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.113654 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a90810c8-8705-48b4-835c-49796597a600 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.251554 Aug 25 12:43:41.125430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 821/1744] 10.222.0.60 () {60 vars in 1158 bytes} [Thu Aug 25 12:43:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:43:41.141872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.158557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.194635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.197148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.201832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.203588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.205148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.232376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.253134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb HTTP/1.1 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'aedbee79-3926-4601-aa94-f0b5565739bb'} Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:41.267513 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e79aeaa9-a3d8-40eb-9a7c-a1cc0198c744 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 404 len: 111 microversion: 2.1 time: 0.129644 Aug 25 12:43:41.279059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 822/1745] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:41 2022] DELETE /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:41.282877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59117ce2-652f-47cb-b31a-80bd0b3438a2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c2ec54c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOpxTipOrL3AIWC769euxflnA7RLGxyhILha4D4tgMD98rWMzL9JnmBoKYxzKmdWjcBh/mSrLdx99whd7oZlKJMEmWAFkYz7K3nWPgRbaixoVfHCAdpjYslO4iF6eSZ1Q=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59117ce2-652f-47cb-b31a-80bd0b3438a2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 507 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOpxTipOrL3AIWC769euxflnA7RLGxyhILha4D4tgMD98rWMzL9JnmBoKYxzKmdWjcBh/mSrLdx99whd7oZlKJMEmWAFkYz7K3nWPgRbaixoVfHCAdpjYslO4iF6eSZ1Q=="}} Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOpxTipOrL3AIWC769euxflnA7RLGxyhILha4D4tgMD98rWMzL9JnmBoKYxzKmdWjcBh/mSrLdx99whd7oZlKJMEmWAFkYz7K3nWPgRbaixoVfHCAdpjYslO4iF6eSZ1Q=='}}} Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 25 12:43:41.295520 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59117ce2-652f-47cb-b31a-80bd0b3438a2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.301543 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59117ce2-652f-47cb-b31a-80bd0b3438a2 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.038410 Aug 25 12:43:41.314801 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 823/1746] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:43:41.314801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.314801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: aedbee79-3926-4601-aa94-f0b5565739bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.346010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.354097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.355142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.359646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.359958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.360534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.419853 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb HTTP/1.1 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'aedbee79-3926-4601-aa94-f0b5565739bb'} Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.423257 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance aedbee79-3926-4601-aa94-f0b5565739bb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.446295 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9c39330-0b0b-4e06-9034-aaedd79c37d7 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb" status: 404 len: 111 microversion: 2.1 time: 0.128992 Aug 25 12:43:41.479996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 824/1747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:41 2022] GET /compute/v2.1/servers/aedbee79-3926-4601-aa94-f0b5565739bb => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:41.506834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Action: 'create', calling method: .version_select at 0x7fc6c2dc9c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-756345144", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:41.581702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:43:41.616956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Getting quotas for user ef47d5f54a0749dba0e486069f696e45 and project bdf79cc8c1304810a672e9a18da6cfc0. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:43:41.686621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 117 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-756345144", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: exception: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-756345144', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 25 12:43:41.694027 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 25 12:43:41.709306 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.724263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.727492 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6237a398-2d41-4ee3-9825-7223c6e95bf0 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.251371 Aug 25 12:43:41.740770 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 825/1748] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:43:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:43:41.756482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.757617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.771896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.778021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.779659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.780918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.781788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.782681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.803791 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d HTTP/1.1 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9caf7045-0a3e-4e9a-9d5b-e2fef28f458d'} Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:41.806167 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:41.815851 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:41.820990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:41.823416 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2fe7df10-245c-436e-8b8a-ee72e5219335 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 404 len: 111 microversion: 2.1 time: 0.079558 Aug 25 12:43:41.828348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 826/1749] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:41 2022] DELETE /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:41.836860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:41.837906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:41.860073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.866327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.867155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.872944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:41.873846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:41.874784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:41.989960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:41.992892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:42.004713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:42.010467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:42.013979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1db3a603-7267-4248-86d3-2109c1a9c1d1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.183022 Aug 25 12:43:42.015172 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 827/1750] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:41 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:42.037836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c200a2d2-e477-44c0-b0c4-8fb3039c02b1 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Calling method '.version_select at 0x7fc6c2c30280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.074904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c200a2d2-e477-44c0-b0c4-8fb3039c02b1 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c200a2d2-e477-44c0-b0c4-8fb3039c02b1 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Request method failure captured: Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2059316936 HTTP/1.1 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB250GKWhvrLO9FwlhLUBflPUIKt5PauoZGRDOwKn5DZcUJDr90CP6Cgm6GEn9Aj2pVxXFAcwuraRw6OCcEtggwN8YkKK8MMHtTqG5HPwNdNOdAFGUtL_LXKBqHBw-XzNFt-rAnRcgU-D7dANBWy3Njc4QJNkltgZKdUhkqmwgK3KPP0 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdf79cc8c1304810a672e9a18da6cfc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bdf79cc8c1304810a672e9a18da6cfc0 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-239292251 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-KeyPairsNegativeTestJSON-239292251-project Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: exception: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'tempest-keypair-non-existent-2059316936'} Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise self.value Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.077855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 Aug 25 12:43:42.084628 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.088458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c200a2d2-e477-44c0-b0c4-8fb3039c02b1 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2059316936 not found for user ef47d5f54a0749dba0e486069f696e45 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.089572 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c200a2d2-e477-44c0-b0c4-8fb3039c02b1 tempest-KeyPairsNegativeTestJSON-239292251 tempest-KeyPairsNegativeTestJSON-239292251-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2059316936" status: 404 len: 145 microversion: 2.1 time: 0.073034 Aug 25 12:43:42.090663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 828/1751] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 12:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2059316936 => generated 145 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:42.095957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.097743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.104296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:42.126095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.127032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.127899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.130768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.133097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.134339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.171561 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d HTTP/1.1 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9caf7045-0a3e-4e9a-9d5b-e2fef28f458d'} Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.176094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 9caf7045-0a3e-4e9a-9d5b-e2fef28f458d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be045877-e4d4-4158-9da3-7fa0c9fe38f2 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d" status: 404 len: 111 microversion: 2.1 time: 0.086799 Aug 25 12:43:42.186435 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 829/1752] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/servers/9caf7045-0a3e-4e9a-9d5b-e2fef28f458d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:42.197410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.198392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.214345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.215281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.216547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.218411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.219414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.220260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.281330 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf HTTP/1.1 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf'} Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:42.284581 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66663e03-6e01-49ec-99dd-19bad59ab558 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 404 len: 111 microversion: 2.1 time: 0.099721 Aug 25 12:43:42.293781 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 830/1753] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:42 2022] DELETE /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:42.302531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.307380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.327366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.328824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.329705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.341667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.342690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.346337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.436781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf HTTP/1.1 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf'} Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.446372 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37c5318c-5420-46d0-9034-2f8d30dae68e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf" status: 404 len: 111 microversion: 2.1 time: 0.158072 Aug 25 12:43:42.454849 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 831/1754] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/servers/019d9ff5-50c2-4b90-b6a2-b66a0fb2cbdf => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:42.495365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.496754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.565529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.566363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.567070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.589576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.593250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.594360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.663775 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d HTTP/1.1 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f768c272-274f-41ca-a85e-52f4cba3560d'} Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:42.668960 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-75745f89-5e5b-49b4-b78f-b2ff3de2b2f8 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 404 len: 111 microversion: 2.1 time: 0.197388 Aug 25 12:43:42.679927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 832/1755] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:42 2022] DELETE /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:42.686736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:42.687139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: f768c272-274f-41ca-a85e-52f4cba3560d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:42.714402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.716343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.717352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.719295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:42.720505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:42.722273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:42.811198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d HTTP/1.1 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f768c272-274f-41ca-a85e-52f4cba3560d'} Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:42.820421 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance f768c272-274f-41ca-a85e-52f4cba3560d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d89fa837-f505-44b3-b9df-7f9dab43172e tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d" status: 404 len: 111 microversion: 2.1 time: 0.144845 Aug 25 12:43:42.837231 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 833/1756] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:42 2022] GET /compute/v2.1/servers/f768c272-274f-41ca-a85e-52f4cba3560d => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:43:43.062554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:43.064776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:43.129557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.132581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.138164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.142746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.143987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.149773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.469067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe095301-af11-47e0-a1a1-423cb93e3f92 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1437 microversion: 2.1 time: 7.426460 Aug 25 12:43:43.476570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 924/1757] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:36 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1437 bytes in 7432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:43.487298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:43.491197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5fbffca-8969-4219-8144-ee57c6945822 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c6c948b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:43.527419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:43.542028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:43.545068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1f7ce27-48d0-41bf-8779-20354bb2adda tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.502099 Aug 25 12:43:43.551045 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 834/1758] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:43 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:43.592973 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5fbffca-8969-4219-8144-ee57c6945822 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 200 len: 1437 microversion: 2.1 time: 0.108395 Aug 25 12:43:43.605164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 925/1759] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:43:43 2022] GET /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:43.627811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:43.633473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:43.660198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.663821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.666426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:43.668699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:43.669904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:43.671081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.053309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:44.076583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-208d8f97-0f96-4b2f-94ac-65f8bd378ad1 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1479 microversion: 2.1 time: 0.464886 Aug 25 12:43:44.078340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 835/1760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:43 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1479 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:44.603139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:44.617173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:44.638199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:44.639113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:44.639830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.641114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:44.642087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:44.642793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:44.779784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:44.797252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:44.800998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:44.803362 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6aa6a441-fb1e-4718-b48a-342dee87e123 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.209822 Aug 25 12:43:44.808591 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 926/1761] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:44 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:45.138118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:45.141236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:45.158534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.161288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.163037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.165190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:45.167533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:45.169344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:45.580804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:45.619649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41eec38b-853f-4065-b3cd-d0ecf8c709e7 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1466 microversion: 2.1 time: 0.498137 Aug 25 12:43:45.621471 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 836/1762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:45 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1466 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:45.677077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-77f7d229-136d-4be8-9c1d-ae4a3121b962 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2599670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:46.436526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:46.441664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.444248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.445816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.448745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.450531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.454087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.521867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7885cc0a-7ec2-44bc-aa37-674f087109b8 tempest-AZV2TestJSON-353914608 tempest-AZV2TestJSON-353914608-project] 10.222.0.60 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.753526 Aug 25 12:43:46.523564 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 837/1763] 10.222.0.60 () {58 vars in 1164 bytes} [Thu Aug 25 12:43:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:43:46.536148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:46.537643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:46.553402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.555032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.556483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.559831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:46.563959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:46.565877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:46.759178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:46.799853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:46.810806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:46.814461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-854364f1-580f-4dbb-a2f8-8f46bb690233 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.289192 Aug 25 12:43:46.826976 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 838/1764] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:46 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:47.580796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-77f7d229-136d-4be8-9c1d-ae4a3121b962 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "DELETE /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5" status: 204 len: 0 microversion: 2.1 time: 1.910263 Aug 25 12:43:47.581951 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 927/1765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:45 2022] DELETE /compute/v2.1/images/8644dd82-3fc7-4e55-86b6-3f9ce1a0a7d5 => generated 0 bytes in 1916 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:47.600574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7369829-9502-4dca-8386-015c0e45173a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '.version_select at 0x7fc6c2943040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:47.706550 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c7369829-9502-4dca-8386-015c0e45173a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] HTTP exception thrown: Image not found. Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7369829-9502-4dca-8386-015c0e45173a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Request method failure captured: Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 HTTP/1.1 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB22pF27Mvl-7iwZLCeJBSk50XpKSFDM7WCe5MgPbRWNDQ1bODpPStobgQfdx7OOvGsSznoSV3iIZl7TVg1gdIm-000jIFl63_i3yMolFmCZEnbB6852wcY-VTgmsIqGIDDjVfWSCEA8XeMnQ9A9lE7_ZJ4PF6-SLNqvhpz6ybO70vs8 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: c293b8d9fbef415dbc73654bf2d2a7ba Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '94821339-7a9c-4ed4-855d-938af019ca13'} Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 94821339-7a9c-4ed4-855d-938af019ca13 to delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94821339-7a9c-4ed4-855d-938af019ca13 could not be found. Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.712274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7369829-9502-4dca-8386-015c0e45173a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:47.730119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7369829-9502-4dca-8386-015c0e45173a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "DELETE /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13" status: 404 len: 62 microversion: 2.1 time: 0.136435 Aug 25 12:43:47.741603 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 839/1766] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:47 2022] DELETE /compute/v2.1/images/94821339-7a9c-4ed4-855d-938af019ca13 => generated 62 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 12:43:47.759218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:47.764584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:47.810619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.814711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.816382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.819652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.824372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.827946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.851475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-unplugged", "status": "completed", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:47.917323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:47.919035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:47.922153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:47.971596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] Creating event network-vif-unplugged:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:43:47.981698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:43:48.001696 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bea9b3f8-a2a8-446f-a946-a306d66467cd req-0bac5259-fab0-4760-a0d6-9eac89fa7da2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159053 Aug 25 12:43:48.007002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 840/1767] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:48.033959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:48.038780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:48.072845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.074492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.075091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.078934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.081133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.083126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.342799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.398762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f5d5e33-014c-4050-8c3b-aa2d985102c0 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 204 len: 0 microversion: 2.1 time: 0.645184 Aug 25 12:43:48.417992 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 928/1768] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:43:47 2022] DELETE /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:43:48.462311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.473738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:48.478814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:48.484514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:48.484875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b256c863-0fb9-43bd-a571-9d8bca508808 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.471626 Aug 25 12:43:48.488920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 841/1769] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:48 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:48.502821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.504301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.505497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:48.507729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:48.509110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:48.510950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:49.071415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:49.132237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c79b69d9-832e-43e2-b3c8-ae3f00f846cc tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1472 microversion: 2.1 time: 0.694335 Aug 25 12:43:49.151745 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 929/1770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:48 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1472 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:49.540108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:49.542906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:49.558899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:49.560681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:49.561792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:49.563780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:49.564932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:49.566282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:49.827468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:49.865194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:49.880391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:49.890065 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-921174bb-f33f-427f-bbcf-bdfa0593fced tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1265 microversion: 2.25 time: 0.357467 Aug 25 12:43:49.890977 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 842/1771] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:49 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:43:50.194595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:50.197536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:50.237808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:50.239145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:50.240596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:50.242638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:50.244715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:50.250713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:50.939586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:50.941496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:50.969363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:50.972768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:50.976434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:50.977518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:50.979830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:50.981393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:50.982531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:51.016842 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb72c92d-34ad-425e-903f-57fdf9ebd87c tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1472 microversion: 2.1 time: 0.819556 Aug 25 12:43:51.018405 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 930/1772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:50 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1472 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:51.101500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:51.102918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:51.104410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:51.105304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lazy-loading 'fault' on Instance uuid bd3dcc6f-b789-4189-a00f-c87af6921f45 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:51.397529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:51.508918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:51.524288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:51.527670 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-893599a6-5ea9-4f29-9222-8d88715827e0 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 200 len: 1270 microversion: 2.25 time: 0.598015 Aug 25 12:43:51.536271 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 843/1773] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:50 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 1270 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:43:52.072518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.076045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:52.097369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.098806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.100541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.104200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.105774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.107268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.580993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:52.582599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: bd3dcc6f-b789-4189-a00f-c87af6921f45] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:52.597951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=20 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:52.649996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.667774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.667774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.667774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:52.670669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:52.680090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:52.735648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] HTTP exception thrown: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Request method failure captured: Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 HTTP/1.1 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vQP-pzvlaGKVe7QZHNKqUnzS3xDYxxWBxU9ZemYb2y96mIkVu_WOrzMyajgQQycndQ6xYsmRfxkNaAEujL8SUnEdCpHts4Cd81hxdkFUe8vCq_-YygipGJvQS3Wtv9SzDY0WKWmLferw1MNc_Yo2uZxtddM5raEaekSKUFBNEc9GI Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3f41f5c8cf9e4d78b4fb62eac79b093e Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bd3dcc6f-b789-4189-a00f-c87af6921f45'} Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. Aug 25 12:43:52.738751 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. Aug 25 12:43:52.748279 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:52.751855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Returning 404 to user: Instance bd3dcc6f-b789-4189-a00f-c87af6921f45 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:52.755258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40aaa920-6274-4ed5-9025-b480eb842b42 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45" status: 404 len: 111 microversion: 2.25 time: 0.183915 Aug 25 12:43:52.763726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 844/1774] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/bd3dcc6f-b789-4189-a00f-c87af6921f45 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:43:52.968139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:53.033671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39ebe814-e5a1-47df-9b28-5a15d341f456 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1472 microversion: 2.1 time: 0.974269 Aug 25 12:43:53.072801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 931/1775] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:52 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1472 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:53.725278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4735672c-9c5c-414d-8f0d-a912ed7e028a", "name": "network-vif-deleted", "tag": "8746cc2d-d1d6-4a4a-aa99-bf13a806f31a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:43:53.765394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:53.766197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:53.766933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:53.812493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] Creating event network-vif-deleted:8746cc2d-d1d6-4a4a-aa99-bf13a806f31a for instance 4735672c-9c5c-414d-8f0d-a912ed7e028a on n-h1-850468-18 Aug 25 12:43:53.831414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-08d7a582-e9cf-466a-a27d-53bb0641384b req-a4f09ddd-9cfc-46e3-ba11-5dc0111c7900 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115126 Aug 25 12:43:53.834763 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 845/1776] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:43:54.106443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:54.112855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:54.127555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:43:54.145747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.151076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.152380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.157158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.158688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.160610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.295056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:54.296606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:54.297823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:54.304347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lazy-loading 'fault' on Instance uuid 4735672c-9c5c-414d-8f0d-a912ed7e028a {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:43:54.488255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c293b8d9fbef415dbc73654bf2d2a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4c7847d95af4a5dbb8b469099b37bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:43:54.539185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8374ac1a-38e6-458d-b6cd-aa4777d724c3 tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 200 len: 1307 microversion: 2.1 time: 0.421795 Aug 25 12:43:54.540270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 932/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:54 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:43:55.582765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:43:55.593882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] [instance: 4735672c-9c5c-414d-8f0d-a912ed7e028a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:43:55.618164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.621307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.626133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.627981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:43:55.630968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:43:55.632107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:43:55.691773 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] HTTP exception thrown: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Request method failure captured: Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a HTTP/1.1 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB22pF27Mvl-7iwZLCeJBSk50XpKSFDM7WCe5MgPbRWNDQ1bODpPStobgQfdx7OOvGsSznoSV3iIZl7TVg1gdIm-000jIFl63_i3yMolFmCZEnbB6852wcY-VTgmsIqGIDDjVfWSCEA8XeMnQ9A9lE7_ZJ4PF6-SLNqvhpz6ybO70vs8 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d4c7847d95af4a5dbb8b469099b37bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d4c7847d95af4a5dbb8b469099b37bba Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1749667610 Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: c293b8d9fbef415dbc73654bf2d2a7ba Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerTestJSON-1749667610-project Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4735672c-9c5c-414d-8f0d-a912ed7e028a'} Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:43:55.694584 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] Returning 404 to user: Instance 4735672c-9c5c-414d-8f0d-a912ed7e028a could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:43:55.708765 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b956041e-bff0-4965-8e7a-538078a0b27a tempest-ImagesOneServerTestJSON-1749667610 tempest-ImagesOneServerTestJSON-1749667610-project] 10.222.0.60 "GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a" status: 404 len: 111 microversion: 2.1 time: 0.133257 Aug 25 12:43:55.710447 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 846/1778] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:43:55 2022] GET /compute/v2.1/servers/4735672c-9c5c-414d-8f0d-a912ed7e028a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:04.018304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5763b64-97ef-4673-aa6b-afd66ba48b6d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c3107310>, body: {"keypair": {"name": "tempest-keypair-2061038049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRIHjM+QH9hjYRhwmUT88a/lQ08qB99UGrhHvfrHNPtf/Kdjig9HCA4mNnYLN1pQmraP43w2rIQWTn4GIBBsZRO7+13gGe9rQOT2Ymfqt2uQNc6M9pMZ+j+lNrLwXqX5A=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:04.132189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e5763b64-97ef-4673-aa6b-afd66ba48b6d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:04.196405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e5763b64-97ef-4673-aa6b-afd66ba48b6d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:04.344741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5763b64-97ef-4673-aa6b-afd66ba48b6d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 1.085279 Aug 25 12:44:04.349352 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 933/1779] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1092 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:04.375804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e4a719b-ac5f-41df-905b-cf8b1356761e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c25a7e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:04.464816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:04.500630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e4a719b-ac5f-41df-905b-cf8b1356761e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-2061038049" status: 200 len: 513 microversion: 2.2 time: 0.131625 Aug 25 12:44:04.505839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 847/1780] 10.222.0.60 () {60 vars in 1258 bytes} [Thu Aug 25 12:44:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2061038049 => generated 513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:04.534374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8937eb0e-2b7b-4f6c-8f19-4fed70e069d3 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c6d10c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:04.567440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:04.662156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8937eb0e-2b7b-4f6c-8f19-4fed70e069d3 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061038049" status: 204 len: 0 microversion: 2.2 time: 0.143392 Aug 25 12:44:04.663312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 934/1781] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Aug 25 12:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061038049 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:04.692016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b685ff7-8289-40c8-b399-1bb3b91cddc5 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c28be430>, body: {"keypair": {"name": "tempest-keypair-856632705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+M2fhqA8PvtWeXZqPGZwb/npsUiFvPW3Ed/+S2G6sRvlaYk6K8qDmN05OEqIf/ATDsc/pY0Fl0k4CSmh2aZo+nY+W4SBwQgRYpYaCkGxwOG/MZEjJ5qgOKDiBMft9+A=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:04.803421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8b685ff7-8289-40c8-b399-1bb3b91cddc5 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:04.838182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8b685ff7-8289-40c8-b399-1bb3b91cddc5 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:04.996144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b685ff7-8289-40c8-b399-1bb3b91cddc5 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.319337 Aug 25 12:44:04.998056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 848/1782] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 323 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:05.037627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-876f1f00-dd8b-4a6f-9fd5-86f101938430 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c2585ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:05.294718 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-876f1f00-dd8b-4a6f-9fd5-86f101938430 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856632705" status: 204 len: 0 microversion: 2.2 time: 0.281913 Aug 25 12:44:05.297996 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 935/1783] 10.222.0.60 () {60 vars in 1258 bytes} [Thu Aug 25 12:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856632705 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:44:05.347796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c08789e-cb6c-4a17-ac5b-22ced2a3f6dc tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c2dc3310>, body: {"keypair": {"name": "tempest-keypair-1577649335", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:05.461754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3c08789e-cb6c-4a17-ac5b-22ced2a3f6dc tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:05.501255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3c08789e-cb6c-4a17-ac5b-22ced2a3f6dc tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:05.693302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=65 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:05.752898 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c08789e-cb6c-4a17-ac5b-22ced2a3f6dc tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.432180 Aug 25 12:44:05.767683 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 849/1784] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:05 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:05.800022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72869513-f67f-45fe-b828-edc48b6f90bf tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c6cee940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:05.889643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72869513-f67f-45fe-b828-edc48b6f90bf tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577649335" status: 204 len: 0 microversion: 2.2 time: 0.106347 Aug 25 12:44:05.894249 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 936/1785] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Aug 25 12:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577649335 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:05.919033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4921686f-6b96-46a5-b412-7f0a4ee19d2d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c2943dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1430197509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhnrtMutHj0/6kjxyZDyrRg0lhhD6cBHr7nKLeGhplBTN3bMuc15wGbs4/+o/cFpb+RUgW+eTIzfsmp1ULX88aCgfyuozTdBlvsquVGphKNZHxneiFhKDXdLy6bSBvHnA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:06.021090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4921686f-6b96-46a5-b412-7f0a4ee19d2d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:06.063656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4921686f-6b96-46a5-b412-7f0a4ee19d2d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:06.231509 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4921686f-6b96-46a5-b412-7f0a4ee19d2d tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.322775 Aug 25 12:44:06.233650 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 850/1786] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 328 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:06.262635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54a105cd-951d-4ce3-a449-e88a8797a114 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c269eb80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1657588995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwfrBhWUkPrDIVJDcYEVLLdLhokckezpYGeoJwrRguw0o6jLGDD+CNwpYw8Fol0Gf2p1WJ6Zd1E+sYKRutzwCtKvHoohbZpTBE02zpzfh45xCproJogWpVxT9Z7A3h6mA=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:06.407175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-54a105cd-951d-4ce3-a449-e88a8797a114 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:06.451689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-54a105cd-951d-4ce3-a449-e88a8797a114 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:06.649476 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54a105cd-951d-4ce3-a449-e88a8797a114 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.395212 Aug 25 12:44:06.659101 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 937/1787] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:06.692949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3371c927-5cbd-4da6-9ca0-5a6530c926f1 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c265fca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2014975382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6uHsmo6LSW8Ml2hh6KNMF86/1uO5rv6w8MVSNOorP/ezRaTVhnAWQzyhuhGDGpsy+XqtAPRtQ+Dbf7w9xAsMJenicFqx+VaPoRC0jEuraC+W68NHw/EQX1V16sutHYvg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:06.831016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3371c927-5cbd-4da6-9ca0-5a6530c926f1 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:06.889279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3371c927-5cbd-4da6-9ca0-5a6530c926f1 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:07.067196 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3371c927-5cbd-4da6-9ca0-5a6530c926f1 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.389748 Aug 25 12:44:07.078538 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 851/1788] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 403 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:07.115559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db9a1706-59ea-4c0b-9fbf-c2b34daf4f34 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c2585ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:07.207792 n-d-850468-18 devstack@n-api.service[122701]: WARNING oslo_db.sqlalchemy.utils [None req-db9a1706-59ea-4c0b-9fbf-c2b34daf4f34 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:44:07.295861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db9a1706-59ea-4c0b-9fbf-c2b34daf4f34 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.199839 Aug 25 12:44:07.310158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 938/1789] 10.222.0.60 () {60 vars in 1177 bytes} [Thu Aug 25 12:44:07 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:07.366598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a352dfbd-7f1e-40f8-b601-154e231c6496 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c25f6430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:07.552843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a352dfbd-7f1e-40f8-b601-154e231c6496 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2014975382" status: 204 len: 0 microversion: 2.2 time: 0.218813 Aug 25 12:44:07.560575 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 852/1790] 10.222.0.60 () {60 vars in 1321 bytes} [Thu Aug 25 12:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2014975382 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:07.576080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c34964c2-9430-4981-a6f2-a5b032daed1c tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c6d06c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:07.710766 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c34964c2-9430-4981-a6f2-a5b032daed1c tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1657588995" status: 204 len: 0 microversion: 2.2 time: 0.143735 Aug 25 12:44:07.719935 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 939/1791] 10.222.0.60 () {60 vars in 1321 bytes} [Thu Aug 25 12:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1657588995 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:44:07.738598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a49a0da-7eb0-445c-a205-e24167ded3cd tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c26d0040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:07.862466 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a49a0da-7eb0-445c-a205-e24167ded3cd tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1430197509" status: 204 len: 0 microversion: 2.2 time: 0.132187 Aug 25 12:44:07.878908 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 853/1792] 10.222.0.60 () {60 vars in 1321 bytes} [Thu Aug 25 12:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1430197509 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:07.889110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ad92514-699f-46db-93ab-40ca57810470 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c6d10d30>, body: {"keypair": {"name": "tempest-keypair-1768699972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwAF2SSYeu6kHI4wiJC++RwZgD2nQpEQg04oljwFLHIVcNkcEiaF5RyMxCm3DF38v6paxxQhgbSTKR9XLYbIbChL6TBsclUY0K9lAk1Rj2moBiN3qqKQnEVH+bEmNp3mg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:08.035928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5ad92514-699f-46db-93ab-40ca57810470 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:08.077100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5ad92514-699f-46db-93ab-40ca57810470 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:08.235560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ad92514-699f-46db-93ab-40ca57810470 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.350696 Aug 25 12:44:08.250929 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 940/1793] 10.222.0.60 () {62 vars in 1199 bytes} [Thu Aug 25 12:44:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 364 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:44:08.278658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-82290570-b517-4ef7-ae26-2f3fae804198 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c265fc10>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:08.376171 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-82290570-b517-4ef7-ae26-2f3fae804198 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1768699972" status: 200 len: 513 microversion: 2.2 time: 0.120762 Aug 25 12:44:08.378237 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 854/1794] 10.222.0.60 () {60 vars in 1258 bytes} [Thu Aug 25 12:44:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1768699972 => generated 513 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:08.409053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5da8e83b-1d09-4341-bb68-6afec2b8f1a9 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c2674430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:08.461195 n-d-850468-18 devstack@n-api.service[122701]: WARNING oslo_db.sqlalchemy.utils [None req-5da8e83b-1d09-4341-bb68-6afec2b8f1a9 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:44:08.500241 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5da8e83b-1d09-4341-bb68-6afec2b8f1a9 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.108280 Aug 25 12:44:08.511790 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 941/1795] 10.222.0.60 () {60 vars in 1177 bytes} [Thu Aug 25 12:44:08 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:08.540221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9328ac7a-9c34-4a11-8cc1-79ae6706f7a2 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c25961f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:08.676671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9328ac7a-9c34-4a11-8cc1-79ae6706f7a2 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768699972" status: 204 len: 0 microversion: 2.2 time: 0.162995 Aug 25 12:44:08.690202 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 942/1796] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Aug 25 12:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768699972 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:08.732948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Action: 'create', calling method: .version_select at 0x7fc6c25a2ee0>, body: {"keypair": {"name": "tempest-keypair-1991733612", "type": "x509"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:08.770944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-580028137", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9becd9c2-2917-439a-ae59-9a15d64c959c"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:08.914597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:08.955647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:09.106243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.processutils [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnjvqi8iw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnjvqi8iw/temp.key -subj /CN=1033991f01774c3989e27f424088042e -extensions v3_req_client {{(pid=122701) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 25 12:44:09.140402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] validate_networks() for [('9becd9c2-2917-439a-ae59-9a15d64c959c', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:44:10.669048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.processutils [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnjvqi8iw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnjvqi8iw/temp.key -subj /CN=1033991f01774c3989e27f424088042e -extensions v3_req_client" returned: 0 in 1.575s {{(pid=122701) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 25 12:44:10.673778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.processutils [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnjvqi8iw/temp.key -password pass: {{(pid=122701) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 25 12:44:10.778261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.processutils [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnjvqi8iw/temp.key -password pass:" returned: 0 in 0.102s {{(pid=122701) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 25 12:44:10.997513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:11.058244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Getting quotas for user 1033991f01774c3989e27f424088042e and project bd3bebf8f0f540c7901fa7a3122daa72. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:11.269881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b69c67dc-abc1-418c-85fb-eefe5de8e20e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 2.549422 Aug 25 12:44:11.281320 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 943/1797] 10.222.0.60 () {62 vars in 1198 bytes} [Thu Aug 25 12:44:08 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 2580 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:11.323329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5477ce24-4646-4ab0-b1e6-e416419d1a76 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c25923a0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:11.414535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5477ce24-4646-4ab0-b1e6-e416419d1a76 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs/tempest-keypair-1991733612" status: 200 len: 1534 microversion: 2.2 time: 0.117399 Aug 25 12:44:11.432157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 944/1798] 10.222.0.60 () {60 vars in 1258 bytes} [Thu Aug 25 12:44:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1991733612 => generated 1534 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:11.444179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff721dc5-26d8-4b4f-b0ee-21348b77cc3e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c2674820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:11.467673 n-d-850468-18 devstack@n-api.service[122701]: WARNING oslo_db.sqlalchemy.utils [None req-ff721dc5-26d8-4b4f-b0ee-21348b77cc3e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:44:11.497305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff721dc5-26d8-4b4f-b0ee-21348b77cc3e tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.061620 Aug 25 12:44:11.511515 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 945/1799] 10.222.0.60 () {60 vars in 1177 bytes} [Thu Aug 25 12:44:11 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:11.535827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2d5695d-556a-460d-934b-9c0b27e492a2 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] Calling method '.version_select at 0x7fc6c6cee820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:11.639939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d2d5695d-556a-460d-934b-9c0b27e492a2 tempest-KeyPairsV22TestJSON-474726162 tempest-KeyPairsV22TestJSON-474726162-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991733612" status: 204 len: 0 microversion: 2.2 time: 0.122831 Aug 25 12:44:11.671919 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 946/1800] 10.222.0.60 () {60 vars in 1261 bytes} [Thu Aug 25 12:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991733612 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:44:15.535844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:15.545741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:15.633664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:15.639529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:15.640745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:15.683724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.684084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:15.691943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:15.693448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.694740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.717244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:15.717601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.718189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.726856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.757179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.758982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.762232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.764292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:15.765757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:15.768992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:15.974657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff HTTP/1.1 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e72649d3-a6c6-4f73-9888-c0474abfedff'} Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:15.985227 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.001702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:16.011226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3ed344f-def2-4f11-bd8b-feb55bf7eead tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 404 len: 111 microversion: 2.1 time: 0.474309 Aug 25 12:44:16.022849 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 947/1801] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:44:15 2022] DELETE /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 111 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:44:16.025724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Getting quotas for project 72e55826cfe54661b3f6868941c03c80. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:16.064705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:16.067391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: e72649d3-a6c6-4f73-9888-c0474abfedff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.067780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Getting quotas for user 49806f7cfdde411093826853cf371e54 and project 72e55826cfe54661b3f6868941c03c80. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:16.151262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.151262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.162948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.177463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.178518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.179344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.244633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Going to run 2 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:44:16.281330 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.285731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: fa92b280-b754-479a-93fb-029a60750ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff HTTP/1.1 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e72649d3-a6c6-4f73-9888-c0474abfedff'} Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.294277 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. Aug 25 12:44:16.303711 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.307443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance e72649d3-a6c6-4f73-9888-c0474abfedff could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:16.322258 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1fc7fb8e-9712-4e19-b03f-39999bf206e9 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff" status: 404 len: 111 microversion: 2.1 time: 0.292921 Aug 25 12:44:16.365129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 948/1802] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:16 2022] GET /compute/v2.1/servers/e72649d3-a6c6-4f73-9888-c0474abfedff => generated 111 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:16.421388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:16.422478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.511780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.512722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.513554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.514890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.515774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.534251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.641860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=fa92b280-b754-479a-93fb-029a60750ae6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:16.646968 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 HTTP/1.1 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '8c6b6e57-a376-4a96-8320-528d7d73e598'} Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:16.662729 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.672185 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.682383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:16.690326 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cbe8a8c8-8979-4257-a9d2-cf4306fee433 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 404 len: 111 microversion: 2.1 time: 0.320072 Aug 25 12:44:16.699447 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 949/1803] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:44:16 2022] DELETE /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 111 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:16.728416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:16.730256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] [instance: 8c6b6e57-a376-4a96-8320-528d7d73e598] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:16.740527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:16.763659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.765933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.772159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.780477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:16.781944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:16.822040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:16.935130 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] HTTP exception thrown: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Request method failure captured: Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 HTTP/1.1 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2wsUn1k6mjQXWyCAk6GAWNiGydkiEAUdYDCsZ-PFIdzh_l3VoYvOEzr34uAyLV7Pq3WQlmj8CgwRCKFwqo-SB5aSutFshLhXJY6aiHvkBBjRxsrxusEt-O9ZM6tlrv_IjAujpVWKj4tItPVEVaqdraRzMOeW7YC7JftHR9YIbEIN5g Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/80d8c371cfcc4e59bd3ce4124f12f892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 80d8c371cfcc4e59bd3ce4124f12f892 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-1999475184 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 23e2785f6ce2400896469dab52789ab3 Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-1999475184-project Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '8c6b6e57-a376-4a96-8320-528d7d73e598'} Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:16.945007 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. Aug 25 12:44:16.955161 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:16.957743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] Returning 404 to user: Instance 8c6b6e57-a376-4a96-8320-528d7d73e598 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:16.960332 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f79cba8-b5ec-4da8-b399-04f10a78e139 tempest-DeleteServersTestJSON-1999475184 tempest-DeleteServersTestJSON-1999475184-project] 10.222.0.60 "GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598" status: 404 len: 111 microversion: 2.1 time: 0.250365 Aug 25 12:44:16.962867 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 950/1804] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:16 2022] GET /compute/v2.1/servers/8c6b6e57-a376-4a96-8320-528d7d73e598 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:44:17.138914 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-839999fc-71bb-4091-bb2b-ef2fceb7712c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.725616 Aug 25 12:44:17.155394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 855/1805] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 8744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:44:17.181286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.219650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:17.241683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Searching by: {'deleted': False, 'project_id': '72e55826cfe54661b3f6868941c03c80'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:44:17.402689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.403520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.417960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.418795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:17.419573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:17.420486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:17.624732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a51ff65b-2e73-4ceb-bdd4-13c2db7f05f0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.456800 Aug 25 12:44:17.625834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 951/1806] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:44:17 2022] GET /compute/v2.1/servers => generated 675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:17.668520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af65249c-7a60-42e8-b4af-e049a253c054 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:17.674174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af65249c-7a60-42e8-b4af-e049a253c054 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:18.227225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-af65249c-7a60-42e8-b4af-e049a253c054 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:18.299459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af65249c-7a60-42e8-b4af-e049a253c054 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1219 microversion: 2.1 time: 0.649835 Aug 25 12:44:18.341654 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 856/1807] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:17 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1219 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:19.351539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95333ce1-63d0-4072-8fee-9d7cca84fdcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:19.361394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95333ce1-63d0-4072-8fee-9d7cca84fdcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:19.886324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-95333ce1-63d0-4072-8fee-9d7cca84fdcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:19.927823 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95333ce1-63d0-4072-8fee-9d7cca84fdcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1219 microversion: 2.1 time: 0.581064 Aug 25 12:44:19.930524 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 952/1808] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:19 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1219 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:20.980374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d57bacf-642c-4c33-85ae-d2f8f81ee10e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:20.980374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d57bacf-642c-4c33-85ae-d2f8f81ee10e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:21.803801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d57bacf-642c-4c33-85ae-d2f8f81ee10e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:21.865561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d57bacf-642c-4c33-85ae-d2f8f81ee10e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1219 microversion: 2.1 time: 0.900136 Aug 25 12:44:21.872267 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 953/1809] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:20 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1219 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:21.906046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:21.919444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:21.948385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-882b9cde-c7f9-4d67-bfb7-e8263910b617 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Action: 'create', calling method: .version_select at 0x7fc6c6cc5ee0>, body: {"keypair": {"name": "tempest-keypair-1870849217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVh0cnm7JnZ+PvfsaIUY5CWuxS+CFtn25j5rWPxxCeVH1JApEFBRIvkcNAHIJryTWibKPT1f5Daw/cWmZRmQuJUH8gC/41LDKeWpMtneKTmPZsuxJZAeZjCFgJtIjGgaQ=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:21.974350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:21.979974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:21.982792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:21.987761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:21.991036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:21.993292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.124667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-882b9cde-c7f9-4d67-bfb7-e8263910b617 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Getting quotas for project e4d3afcb61cd4de7a865af7b9581d764. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:22.165564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-882b9cde-c7f9-4d67-bfb7-e8263910b617 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Getting quotas for user a1c0e075a4714489a7c04b785b4766fa and project e4d3afcb61cd4de7a865af7b9581d764. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:22.191061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:22.318485 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-882b9cde-c7f9-4d67-bfb7-e8263910b617 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.624103 Aug 25 12:44:22.320202 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 857/1810] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:44:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:22.753136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e687d9b-6f67-469b-b8a5-8102a5a4ac4b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 204 len: 0 microversion: 2.25 time: 0.874274 Aug 25 12:44:22.754624 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 954/1811] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:44:21 2022] DELETE /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 0 bytes in 881 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:44:22.772638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:22.794263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:22.856571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.861268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.864100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.871691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:22.876934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:22.881394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:22.940368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2142ecd1-f1c1-46f7-b2c1-9877f5513f29 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:22.949200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2142ecd1-f1c1-46f7-b2c1-9877f5513f29 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:23.339784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2142ecd1-f1c1-46f7-b2c1-9877f5513f29 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:23.400448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2142ecd1-f1c1-46f7-b2c1-9877f5513f29 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1219 microversion: 2.1 time: 0.469443 Aug 25 12:44:23.424446 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 955/1812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:22 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1219 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:24.456693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:24.463579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:24.553869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.557707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.564295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:24.577965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:24.581924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:24.586811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:25.911821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:26.038237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:26.096543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc2e35a9-4cd3-4b39-a85d-87cba3c0376b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1215 microversion: 2.1 time: 1.650380 Aug 25 12:44:26.116884 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 956/1813] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:24 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1215 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:27.145407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:27.149640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:27.200096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.205779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.206729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:27.216993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:27.219336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:27.220863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:27.522429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:28.374980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:28.386548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:28.435830 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-37ac0cf1-d2a5-4e73-8544-f18f85e40e45 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1277 microversion: 2.1 time: 1.296619 Aug 25 12:44:28.460888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:28.471287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:28.482843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab544da6-79ee-4d9d-b5cf-b055154d97c1 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1733 microversion: 2.25 time: 5.720058 Aug 25 12:44:28.485709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 957/1814] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:27 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1277 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:28.490776 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 858/1815] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:22 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1733 bytes in 5729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:44:29.513660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:29.530934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:29.552353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:29.553654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:29.589110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.590606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.592005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:29.593664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.598229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.599619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.599886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.600934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:29.601104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:29.607083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:29.610815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:29.615756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:31.163420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:31.276351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-033b3842-67cb-4ef0-817d-b684c5eac390 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1277 microversion: 2.1 time: 1.772456 Aug 25 12:44:31.287796 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 958/1816] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:29 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1277 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:31.579888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:31.648726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:31.668992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:31.671798 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17fa2160-34f4-426e-aec2-5d6c3c67ea2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1733 microversion: 2.25 time: 2.134182 Aug 25 12:44:31.701851 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 859/1817] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:29 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1733 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:32.333725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:32.341652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:32.390219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.393732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.396990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.405406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.409967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.412167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.730371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:32.734812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:32.749234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=28 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:32.804278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.806651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.810457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:32.813997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:32.815053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:32.820277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:33.391863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=26 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:34.376204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.436650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.454698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d0d5f54-27c9-45c0-857a-60bf607d27a5 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1277 microversion: 2.1 time: 2.129043 Aug 25 12:44:34.459299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 959/1818] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1277 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:34.514208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.516954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:34.520051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:34.525737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:34.543991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4aceec14-53d9-4b52-9a47-5a7863f30cc8 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1665 microversion: 2.25 time: 1.817491 Aug 25 12:44:34.571051 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 860/1819] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:32 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1665 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:34.601705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.606412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c889f9ac-7208-4c2f-aaaf-44ff1f9e12a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:34.609563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.610949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.614321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.621359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.627576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.630093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:34.670916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.682835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.685989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:34.688979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:34.699992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:34.701465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.723456 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-271fb9c3-2ef9-43ee-a658-5bb6547d8435 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "POST /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.148505 Aug 25 12:44:35.724725 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 861/1820] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:44:34 2022] POST /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments => generated 194 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:35.772811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:35.773576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:35.818979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.819821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.827202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.828672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:35.829565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:35.840426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:35.974009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:36.151071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6148e593-f49e-45e9-8e8e-8b809a2570bd tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1860 microversion: 2.1 time: 1.689617 Aug 25 12:44:36.157366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 960/1821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:34 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1860 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:36.198518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:36.203754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:36.238552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.246000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.250206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.252174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.253952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.257503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.342507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:36.382084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-655a2cce-827a-4f9c-82dd-26f82b5e30a4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1277 microversion: 2.1 time: 0.655052 Aug 25 12:44:36.400825 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 862/1822] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:35 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1277 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:36.449925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-18", "block_migration": true, "disk_over_commit": false}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:36.454796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:36.507355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.512839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.514157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:36.520453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:36.526124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:36.531613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.518396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lazy-loading 'flavor' on Instance uuid 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:44:37.525011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.572271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.574920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Going to try to live migrate instance to n-h2-850468-18 {{(pid=122700) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:44:37.589141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:37.597520 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-244d2aeb-77a7-4279-8c60-5cde6e98bb8c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 200 len: 1665 microversion: 2.25 time: 1.436444 Aug 25 12:44:37.605445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 961/1823] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:36 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 1665 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:44:37.644977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:37.646874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:37.690853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.692137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.692975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:37.694379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:37.695206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:37.695988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:40.011040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:40.056427 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47ecbec2-625b-4aa6-9c10-534c3bd1c8ab tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 2.444099 Aug 25 12:44:40.057748 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 962/1824] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:37 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:40.091363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e2821-945e-4304-b2fc-0d04ec5f23fe", "name": "network-vif-deleted", "tag": "7b842574-fc39-4e11-ab77-21ef7bd27782"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:40.147736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:40.149295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:40.152387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:40.222293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] Creating event network-vif-deleted:7b842574-fc39-4e11-ab77-21ef7bd27782 for instance 013e2821-945e-4304-b2fc-0d04ec5f23fe on n-h1-850468-18 Aug 25 12:44:40.266616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-94e1da18-377e-4347-b832-3f88860470cd req-c9420e42-4945-4818-a38e-73114d852aaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203041 Aug 25 12:44:40.280465 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 963/1825] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:40.313178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:40.322044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 013e2821-945e-4304-b2fc-0d04ec5f23fe] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:40.353172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:40.356067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:40.357616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:40.362146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:40.369202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:40.379551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:40.420279 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] HTTP exception thrown: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Request method failure captured: Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe HTTP/1.1 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vQP-pzvlaGKVe7QZHNKqUnzS3xDYxxWBxU9ZemYb2y96mIkVu_WOrzMyajgQQycndQ6xYsmRfxkNaAEujL8SUnEdCpHts4Cd81hxdkFUe8vCq_-YygipGJvQS3Wtv9SzDY0WKWmLferw1MNc_Yo2uZxtddM5raEaekSKUFBNEc9GI Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3f41f5c8cf9e4d78b4fb62eac79b093e Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '013e2821-945e-4304-b2fc-0d04ec5f23fe'} Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. Aug 25 12:44:40.426410 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. Aug 25 12:44:40.432440 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:44:40.445884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Returning 404 to user: Instance 013e2821-945e-4304-b2fc-0d04ec5f23fe could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:44:40.448701 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a49052e-f945-4cee-b372-1e7d27f9bc2b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe" status: 404 len: 111 microversion: 2.25 time: 0.165492 Aug 25 12:44:40.454000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 964/1826] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:40 2022] GET /compute/v2.1/servers/013e2821-945e-4304-b2fc-0d04ec5f23fe => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:44:40.482182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0f3b759-0022-46a8-9597-151bde62a504 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '.version_select at 0x7fc6c6d0e700>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:40.573540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0f3b759-0022-46a8-9597-151bde62a504 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457490615" status: 204 len: 0 microversion: 2.25 time: 0.112352 Aug 25 12:44:40.580776 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 965/1827] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457490615 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:44:41.107119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:41.107936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:41.144546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.145380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.161065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:41.166796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:41.167826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:41.168652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:45.277717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:45.302617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8643878d-cf92-4b0d-a9d3-4b175846401d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 4.205634 Aug 25 12:44:45.304529 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 966/1828] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:41 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 4209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:46.356556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:46.371142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:46.409082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.411459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.412543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.414053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:46.414864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:46.415559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:46.432965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:47.509342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:47.542966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a0166f1-578f-40f7-9acf-df3cc60d6e24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 1.194566 Aug 25 12:44:47.544602 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 967/1829] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:46 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:44:47.566226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1302025896", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6b68b12e-3748-4f04-8d9e-0754b8be090b"}], "security_groups": [{"name": "tempest-securitygroup--1755935500"}], "key_name": "tempest-keypair-1629960193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "46ff987c-09c9-43ae-92ec-c29370cef238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:47.619016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:47.626410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=7 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:47.830200 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96fcaccb-fa2d-4926-8e0b-aa0b23a73e5d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/action" status: 202 len: 0 microversion: 2.1 time: 11.426633 Aug 25 12:44:47.834055 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 863/1830] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:44:36 2022] POST /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/action => generated 0 bytes in 11434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:44:47.859999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b5c2e0e9-2683-41cf-9078-5b89c6df6ab9"}], "security_groups": [{"name": "tempest-securitygroup--937898212"}], "key_name": "tempest-keypair-1870849217", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:47.933959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:44:48.477990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] validate_networks() for [('b5c2e0e9-2683-41cf-9078-5b89c6df6ab9', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:44:48.910243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] validate_networks() for [('6b68b12e-3748-4f04-8d9e-0754b8be090b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:44:52.761578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:52.762445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:52.763293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:52.764203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:52.764986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:52.786499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.787829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.788999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.791777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:52.793051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:52.794081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:52.837472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Getting quotas for project e4d3afcb61cd4de7a865af7b9581d764. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:52.849554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Getting quotas for user a1c0e075a4714489a7c04b785b4766fa and project e4d3afcb61cd4de7a865af7b9581d764. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:52.880454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:44:52.886218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:52.989584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for project 2c520e65f6964fb79c8a415685db20d8. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:53.015359 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf7ee537-ab1a-45b6-b30f-a3330ca48b65 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.178796 Aug 25 12:44:53.017034 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 864/1831] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:44:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 5182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:44:53.031185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for user 2c530eca6b6141eb81c0b0f2ddfbc925 and project 2c520e65f6964fb79c8a415685db20d8. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:53.034474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:53.045400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:53.068107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.069658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.070901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.073076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.074528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.089882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.103234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:44:53.104076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:44:53.105096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:44:53.111234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:44:53.112615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:44:53.156211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.161966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.162800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.168178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.172740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.173297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.262494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for project 2c520e65f6964fb79c8a415685db20d8. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:44:53.288060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Getting quotas for user 2c530eca6b6141eb81c0b0f2ddfbc925 and project 2c520e65f6964fb79c8a415685db20d8. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:44:53.444240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:44:53.450697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46ff987c-09c9-43ae-92ec-c29370cef238',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:44:53.828687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:53.860528 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad8f2c19-68d4-4dc8-b5c0-95aa0a9b1ed8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 0.836137 Aug 25 12:44:53.866862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 865/1832] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:53 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:53.883147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa92b280-b754-479a-93fb-029a60750ae6", "tag": "473451ac-5ae9-42ce-a418-0cc0ee0c859b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:53.923998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:53.933388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:53.935832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:53.988532 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 12:44:53.998419 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] Creating event network-changed:473451ac-5ae9-42ce-a418-0cc0ee0c859b for instance fa92b280-b754-479a-93fb-029a60750ae6 on n-h2-850468-18 Aug 25 12:44:54.008631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-900fbcbe-162d-4a98-8637-226d54696e75 req-14e38619-b720-40f9-a98e-2900f7c2c80a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135042 Aug 25 12:44:54.011504 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 866/1833] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:54.046774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:54.048873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:54.069458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.070743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.071883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.073599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:54.074834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:54.075870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:54.919570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:54.954345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c35defa-fec1-4835-b20e-a41671702bcc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 0.936657 Aug 25 12:44:54.955490 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 867/1834] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:54 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:54.998778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14568e19-4af8-4b2b-9545-1e489061abe3", "tag": "4cc8d4fc-c2a3-43fc-890a-1aea277b466c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:44:55.003991 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54230. Aug 25 12:44:55.012276 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b18f6af-f20e-430c-9db7-cd45a4489ec2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 7.465401 Aug 25 12:44:55.028965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 968/1835] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:44:47 2022] POST /compute/v2.1/servers => generated 407 bytes in 7483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:44:55.047586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.049432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:55.052315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.053164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.060512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.095617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.096559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.097382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.098732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.099612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.111135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.149049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] Creating event network-changed:4cc8d4fc-c2a3-43fc-890a-1aea277b466c for instance 14568e19-4af8-4b2b-9545-1e489061abe3 on n-h1-850468-18 Aug 25 12:44:55.183248 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e8c78e51-84af-4d24-8979-c178d4a55067 req-03296a51-8d3c-43ed-b2d4-436de8b0877a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206253 Aug 25 12:44:55.186659 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 868/1836] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:44:55.214026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.225443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:55.254961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:44:55.260810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.265367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.276866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.279879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.281822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.282943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.589243 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12367caf-26a2-4640-99fe-9c62b38ced9b tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 204 len: 0 microversion: 2.25 time: 0.557681 Aug 25 12:44:55.591778 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 969/1837] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:44:55 2022] DELETE /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:44:55.614778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:55.617265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:55.657251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.658159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.667885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.671730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:55.673753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:55.678813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:55.978875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:56.022881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4620d63e-60e9-4215-b11a-f69b7f486b88 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1222 microversion: 2.1 time: 0.831473 Aug 25 12:44:56.024072 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 869/1838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1222 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:56.057665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-598fa0e5-98a2-4d9f-afe5-b881bb815888 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:56.058769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-598fa0e5-98a2-4d9f-afe5-b881bb815888 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.308928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-598fa0e5-98a2-4d9f-afe5-b881bb815888 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:57.348412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-598fa0e5-98a2-4d9f-afe5-b881bb815888 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1122 microversion: 2.1 time: 1.312773 Aug 25 12:44:57.349532 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 870/1839] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:56 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1122 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:57.371549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:57.381186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:57.413454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.414374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.425894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:57.427328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:57.428368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:57.429054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.628840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:44:59.677928 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-510e338c-02fe-4289-bbf9-bc516f7c6396 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 4.083484 Aug 25 12:44:59.691784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 970/1840] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:55 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 4097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:44:59.707605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:44:59.715560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:44:59.748709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.750114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.753435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:44:59.755589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:44:59.759972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:44:59.763380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:00.972360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.011285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.034548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.044390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3cffa859-6344-40ac-b27c-ef4709d5206c tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1549 microversion: 2.25 time: 3.691196 Aug 25 12:45:01.050545 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 871/1841] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:44:57 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1549 bytes in 3699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:01.076333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:01.089636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:01.128297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.129970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:01.140517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.141907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.143908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.145874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.151565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.168038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23440280-2152-4d06-8fc1-56f6da272924 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 1.473531 Aug 25 12:45:01.187082 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 971/1842] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:44:59 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:01.216855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa92b280-b754-479a-93fb-029a60750ae6", "name": "network-vif-plugged", "status": "completed", "tag": "473451ac-5ae9-42ce-a418-0cc0ee0c859b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:01.294989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.296341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.297451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.378862 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] Creating event network-vif-plugged:473451ac-5ae9-42ce-a418-0cc0ee0c859b for instance fa92b280-b754-479a-93fb-029a60750ae6 on n-h2-850468-18 Aug 25 12:45:01.413079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-09dd50a0-6037-433d-9c3c-c0c75e69b63c req-47b15c87-2ffc-4dc1-9401-314db8f9b438 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223120 Aug 25 12:45:01.423041 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 972/1843] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:01.473866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:01.480929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:01.503444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.509312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.511165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:01.512989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:01.514309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:01.515617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.510216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:02.552057 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0112af9d-7415-4d1d-8892-2df2bfd8cc75 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1238 microversion: 2.1 time: 1.115031 Aug 25 12:45:02.553805 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 973/1844] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:01 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1238 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:02.613042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:02.622880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:02.654802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.675415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.677262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.679713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.681200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.700065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.820281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:02.853350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0832f5c3-c754-4e5f-afb8-a6b1c600b363 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.286136 Aug 25 12:45:02.865065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 974/1845] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:45:02 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:02.892824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:02.896856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:02.929757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.931545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.941858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:02.949535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:02.950952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:02.954013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.236998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:03.311297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=10 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:03.622247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:03.655954 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d7804de-e924-49d5-ab8a-8399aeae1c41 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1284 microversion: 2.1 time: 2.602834 Aug 25 12:45:03.670153 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 872/1846] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:01 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1284 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:03.695038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:03.699446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:03.747952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.748974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.749748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:03.751082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:03.766092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:03.767390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.202498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.250489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.257764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.261171 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-397a3a07-a529-43fb-aa08-8f67fd403155 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 200 len: 1507 microversion: 2.25 time: 1.588684 Aug 25 12:45:05.300075 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 873/1847] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:03 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 1507 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:05.315792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:05.317423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:05.333602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.335084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.336310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.338474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.339590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.340612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.690988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:05.735335 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c62bf005-7560-439a-9545-2f5deced79ff tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 2.861208 Aug 25 12:45:05.739771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 975/1848] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:02 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:05.763750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:05.764749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:05.786580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.787693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.788616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:05.790625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:05.791929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:05.793501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:06.982989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:07.032870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-673c126a-4e5a-4095-9e07-641562fe1506 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 1.730254 Aug 25 12:45:07.053621 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 874/1849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:05 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:07.076022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:07.082428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:07.111033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.112351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.113391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.115347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.117387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.125597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.338379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:07.737903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:07.766520 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ca56ecc-1169-48fb-b8d0-906cfe1c999f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1238 microversion: 2.1 time: 0.705652 Aug 25 12:45:07.772766 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 875/1850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:07 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1238 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:07.796397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:07.798187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:07.817765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.820009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.822845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:07.824786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:07.825968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:07.827033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:08.855993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:08.914258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8dbadd3a-0bac-4a56-893d-a03958cdb1df tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1284 microversion: 2.1 time: 1.138526 Aug 25 12:45:08.932662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 876/1851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:07 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1284 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:08.953806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2e7d65-45b4-4a82-8d30-a015e2af5447", "name": "network-vif-deleted", "tag": "b291c31b-93f0-4216-ad65-33712305c4b9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:08.974086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:08.975653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:08.976874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.019007 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] Creating event network-vif-deleted:b291c31b-93f0-4216-ad65-33712305c4b9 for instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 on n-h1-850468-18 Aug 25 12:45:09.041614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-28285dc5-77fb-4fed-90c0-5717101b53e5 req-f2a79b0d-461b-431a-8ef0-f9f6fd09ff3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105836 Aug 25 12:45:09.044156 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 877/1852] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:09.089583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:09.091704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: ae2e7d65-45b4-4a82-8d30-a015e2af5447] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:09.130300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.132971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.134410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.137136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.140728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.143152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.201370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] HTTP exception thrown: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Request method failure captured: Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 HTTP/1.1 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2vQP-pzvlaGKVe7QZHNKqUnzS3xDYxxWBxU9ZemYb2y96mIkVu_WOrzMyajgQQycndQ6xYsmRfxkNaAEujL8SUnEdCpHts4Cd81hxdkFUe8vCq_-YygipGJvQS3Wtv9SzDY0WKWmLferw1MNc_Yo2uZxtddM5raEaekSKUFBNEc9GI Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3f41f5c8cf9e4d78b4fb62eac79b093e Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ae2e7d65-45b4-4a82-8d30-a015e2af5447'} Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. Aug 25 12:45:09.205051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. Aug 25 12:45:09.213591 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:45:09.216326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Returning 404 to user: Instance ae2e7d65-45b4-4a82-8d30-a015e2af5447 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:45:09.219441 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc5d879d-3b33-4a7c-8cef-9a6ec8fcd471 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447" status: 404 len: 111 microversion: 2.25 time: 0.171638 Aug 25 12:45:09.221085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 878/1853] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:09 2022] GET /compute/v2.1/servers/ae2e7d65-45b4-4a82-8d30-a015e2af5447 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:45:09.232967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:09.234580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:09.287147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.291340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.292232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:09.297117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:09.299325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:09.300891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.736162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:10.753482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a728ba0-4cd5-4e69-8ac7-e5a798f837db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.530586 Aug 25 12:45:10.754239 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 879/1854] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:09 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:10.795815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:10.799092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:10.823977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.825707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.827358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:10.830803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:10.832871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:10.834712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:12.021487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:12.041535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6dae0002-3201-40d0-9f26-22abc49fd18f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1319 microversion: 2.1 time: 1.270392 Aug 25 12:45:12.051839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 880/1855] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:10 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1319 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:12.069326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14568e19-4af8-4b2b-9545-1e489061abe3", "name": "network-vif-plugged", "status": "completed", "tag": "4cc8d4fc-c2a3-43fc-890a-1aea277b466c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:12.092886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:12.094044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:12.095237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:12.128228 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] Creating event network-vif-plugged:4cc8d4fc-c2a3-43fc-890a-1aea277b466c for instance 14568e19-4af8-4b2b-9545-1e489061abe3 on n-h1-850468-18 Aug 25 12:45:12.141187 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9c952694-ebb1-4906-9ec6-3d6c55d84517 req-9d11fce3-d5aa-4590-8a95-de53ec546c6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085336 Aug 25 12:45:12.143694 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 881/1856] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:12.157288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:12.158941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:12.174226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:12.175864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:12.178534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:12.195841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:12.197986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:12.204847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:13.545274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:13.562155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71852ef9-3ca3-4ba3-8c12-b36cd00761c2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1306 microversion: 2.1 time: 1.415546 Aug 25 12:45:13.577021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 882/1857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:12 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1306 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:13.857000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-968654542", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "f37983f0-e53d-4911-8228-c9c76340bab0"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:13.999275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] validate_networks() for [('f37983f0-e53d-4911-8228-c9c76340bab0', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:45:15.785643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:15.859111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:17.307896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lazy-loading 'services' on Instance uuid d331e01e-d961-4a8c-9692-09398c935198 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:45:17.618989 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a339d146-4ad0-49c5-8e51-e940da5c4069 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments/c889f9ac-7208-4c2f-aaaf-44ff1f9e12a5" status: 202 len: 0 microversion: 2.1 time: 11.875407 Aug 25 12:45:17.620675 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 976/1858] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 12:45:05 2022] DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments/c889f9ac-7208-4c2f-aaaf-44ff1f9e12a5 => generated 0 bytes in 11880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:45:17.643145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:17.647754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:17.666007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.668679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.669980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.671639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.672867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.673989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.767822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:17.827975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:45:17.831513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:45:17.833238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:45:17.834335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:45:17.842957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:45:17.857727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:17.917627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.920739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.926487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:17.935620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:17.936932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:17.940412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.040609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Getting quotas for project b1b939a6b3254c378ccb17f94122d7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:45:18.071714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Getting quotas for user 2e1e46f25b7848d2b936f7c7509ff8f9 and project b1b939a6b3254c378ccb17f94122d7ee. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:45:18.157386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:45:18.184231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:18.238212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22017d42-005b-4a84-8124-54b85622c0db tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 204 len: 0 microversion: 2.25 time: 0.615049 Aug 25 12:45:18.241725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 977/1859] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:45:17 2022] DELETE /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:45:18.284404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:18.287075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:18.312036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.312753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.313320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.314698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.315549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.316380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.405243 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f60a3ae2-76a4-4719-99b6-8d321951816f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.825882 Aug 25 12:45:18.414889 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 883/1860] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:45:18.432775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:18.438058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:18.469404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.481262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.482698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.485028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:18.490986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:18.491800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:18.512046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=87 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:20.114877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:20.152394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:20.173681 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1189e095-95c5-4df4-a35b-8001318187b0 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1351 microversion: 2.1 time: 1.917284 Aug 25 12:45:20.177440 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 978/1861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:18 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1351 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:20.198249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9ac30e1-511c-4d5b-8e95-f9ba2c2aa50b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.777751 Aug 25 12:45:20.201744 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 884/1862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:18 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:20.235934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:20.238866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:20.265022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:20.271523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:20.293953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.303967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.306279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.313959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.316396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.323309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.333317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.341973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.347603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:20.352516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:20.361542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:20.364265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.390129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:21.418954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:21.427432 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-576b8a2b-e056-4b9d-8653-f8c5f2f769b5 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1306 microversion: 2.1 time: 1.220617 Aug 25 12:45:21.449620 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 885/1863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:20 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1306 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:21.456460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa814225-0f6c-428a-a222-77f3d6a1a8bc tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 200 len: 1507 microversion: 2.1 time: 1.263002 Aug 25 12:45:21.469150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654", "tag": "2d0cf4ba-7af9-42a5-aba9-fb7d1a984494"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:21.471341 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 979/1864] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:20 2022] GET /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 1507 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:21.499897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:21.503729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:21.504747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.512445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:21.518636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:21.546336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:21.547609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:21.548897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.550344 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] Creating event network-changed:2d0cf4ba-7af9-42a5-aba9-fb7d1a984494 for instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 on n-h1-850468-18 Aug 25 12:45:21.551048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:21.552691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:21.553986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.575955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c81b7b86-c81c-4db5-bb3b-3de78e4ad0e4 req-a1bff41e-1b35-4d67-bd4e-39b6fcd282cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120976 Aug 25 12:45:21.578103 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 886/1865] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:21.593206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:21.595039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:21.611254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:21.613584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:21.618640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.623879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:21.626028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:21.631141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:21.897190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:21.941062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:21.955629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f41f5c8cf9e4d78b4fb62eac79b093e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f998a63a08d4ddfa853e64c12b2f64a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:21.959460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24aea528-b403-408d-8233-289d9adb02f9 tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 200 len: 1522 microversion: 2.25 time: 0.475213 Aug 25 12:45:21.984691 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 980/1866] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:21 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:45:22.006605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4c57fc-07ea-4210-8211-f4fcbc2c6a62", "name": "network-vif-deleted", "tag": "6fbd848b-4761-489b-af7c-e2c1399d1bda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:22.040835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.042279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.043679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:22.048323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:22.072756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] Creating event network-vif-deleted:6fbd848b-4761-489b-af7c-e2c1399d1bda for instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 on n-h2-850468-18 Aug 25 12:45:22.083495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1e6bbf47-4c8c-4576-b6fa-47be3bce5758 req-dfe85b67-d506-46a5-8013-e8b68d90007c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093295 Aug 25 12:45:22.092852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 981/1867] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:22.095167 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d18193c-1360-41f5-94e5-923c9d6aa4c0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1268 microversion: 2.1 time: 0.514144 Aug 25 12:45:22.104511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 887/1868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:21 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1268 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:22.107001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:22.108739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:22.138355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:22.140961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.141211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:22.143819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.151732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:22.153667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.157476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.160320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:22.177931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.197109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.199651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:22.202948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:22.207305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:22.208548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:23.582770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:23.611730 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70365ca4-204c-4cf2-b508-7af43d4d285d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1351 microversion: 2.1 time: 1.516232 Aug 25 12:45:23.617720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 982/1869] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:22 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1351 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:23.635490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:23.637870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: fa92b280-b754-479a-93fb-029a60750ae6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:23.658842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:23.673534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:23.674566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:23.676017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:23.677024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:23.678056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:23.815438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:23.843660 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b005ca9-1f96-4bd1-94cd-4f517f9ee00e tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.735784 Aug 25 12:45:23.845185 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 888/1870] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:22 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:23.861574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:23.862551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:23.882878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:23.883917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:23.884411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:23.885172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:23.885995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:23.886651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.441942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:25.496058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f54e065a-6ca9-4ebd-80a6-978674b1fda3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/fa92b280-b754-479a-93fb-029a60750ae6" status: 200 len: 1507 microversion: 2.1 time: 1.873705 Aug 25 12:45:25.499872 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 983/1871] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:23 2022] GET /compute/v2.1/servers/fa92b280-b754-479a-93fb-029a60750ae6 => generated 1507 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:25.527108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:25.530056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] [instance: 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:25.573263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.576540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.577741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.582256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.585624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.590562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.661116 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] HTTP exception thrown: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Request method failure captured: Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 HTTP/1.1 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2vQP-pzvlaGKVe7QZHNKqUnzS3xDYxxWBxU9ZemYb2y96mIkVu_WOrzMyajgQQycndQ6xYsmRfxkNaAEujL8SUnEdCpHts4Cd81hxdkFUe8vCq_-YygipGJvQS3Wtv9SzDY0WKWmLferw1MNc_Yo2uZxtddM5raEaekSKUFBNEc9GI Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.25 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5f998a63a08d4ddfa853e64c12b2f64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 5f998a63a08d4ddfa853e64c12b2f64a Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-859742997 Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3f41f5c8cf9e4d78b4fb62eac79b093e Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-859742997-project Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0c4c57fc-07ea-4210-8211-f4fcbc2c6a62'} Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. Aug 25 12:45:25.667839 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. Aug 25 12:45:25.677958 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:45:25.680964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] Returning 404 to user: Instance 0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:45:25.683230 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1dc78836-6209-41d6-9c81-075e9c877e8d tempest-LiveAutoBlockMigrationV225Test-859742997 tempest-LiveAutoBlockMigrationV225Test-859742997-project] 10.222.0.60 "GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62" status: 404 len: 111 microversion: 2.25 time: 0.180972 Aug 25 12:45:25.697808 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 984/1872] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:45:25 2022] GET /compute/v2.1/servers/0c4c57fc-07ea-4210-8211-f4fcbc2c6a62 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:45:25.724829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:25.726713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:25.749794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.751057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.752087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:25.753720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:25.754905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:25.755922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:26.079989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:26.109741 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c1d9614-2208-4f96-b3d5-43c95289eea2 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1294 microversion: 2.1 time: 2.258150 Aug 25 12:45:26.111012 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 889/1873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:23 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1294 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:26.146931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f012d530-7780-4cee-b0a6-c45d87e87b69", "tag": "18fbc23b-9074-448d-9f68-2a9debb68123"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:26.198692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:26.200285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:26.201421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:26.236057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] Creating event network-changed:18fbc23b-9074-448d-9f68-2a9debb68123 for instance f012d530-7780-4cee-b0a6-c45d87e87b69 on n-h2-850468-18 Aug 25 12:45:26.255321 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ff792f88-1917-476d-99ea-9f3ccb83bddc req-01e900cf-6015-45bb-85c9-a55323fba2b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135325 Aug 25 12:45:26.257501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 890/1874] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:26.285503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:26.287342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:26.303333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:26.304817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:26.306773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:26.308664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:26.310047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:26.311806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:27.075741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:27.106738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a756bc18-f1f1-4d48-8f56-7ae72c3f4e9d tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1274 microversion: 2.1 time: 1.406494 Aug 25 12:45:27.107998 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 985/1875] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:25 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1274 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:27.151572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "name": "network-vif-unplugged", "status": "completed", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:27.216684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:27.218194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:27.222247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:27.311253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] Creating event network-vif-unplugged:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h1-850468-18 Aug 25 12:45:27.331487 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-71507cb5-726b-4938-a308-bec8f6f755bb req-ca883523-9187-4e79-a2d8-f342653f8b6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.217599 Aug 25 12:45:27.336922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 986/1876] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:27.370529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:27.382979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:27.408192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:27.413518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:27.414934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:27.417754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:27.425991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:27.427247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:27.996966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:28.104008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:29.009699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.044807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b416c84-4bb5-466a-a93b-7d089db028aa tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.702765 Aug 25 12:45:29.056824 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 987/1877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:27 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.069549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.074660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.078124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: fa92b280-b754-479a-93fb-029a60750ae6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.096446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.098151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.098353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4bc400f1-1169-44b2-ab50-aee455f00f67 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1351 microversion: 2.1 time: 2.821648 Aug 25 12:45:29.099571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.101352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.103247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.104527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.104755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 891/1878] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:26 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1351 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.118845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.129001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.160325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.161683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.162790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.168811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: fa92b280-b754-479a-93fb-029a60750ae6] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:29.169461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.170561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.171438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.460923 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb5cb874-7086-4fd6-88f3-73d85885f0c3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa92b280-b754-479a-93fb-029a60750ae6" status: 204 len: 0 microversion: 2.1 time: 0.400761 Aug 25 12:45:29.463295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 988/1879] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:29 2022] DELETE /compute/v2.1/servers/fa92b280-b754-479a-93fb-029a60750ae6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:29.498083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.499588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.532105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.534710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.535964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.538206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.539197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.540285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.760393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.782665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-182a978f-33ed-461f-94b3-85e93fd5a1ae tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1274 microversion: 2.1 time: 0.315080 Aug 25 12:45:29.793016 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 989/1880] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:29 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.811077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012d530-7780-4cee-b0a6-c45d87e87b69", "name": "network-vif-plugged", "status": "completed", "tag": "18fbc23b-9074-448d-9f68-2a9debb68123"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:29.845515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:29.846489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:29.847391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:29.910614 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] Creating event network-vif-plugged:18fbc23b-9074-448d-9f68-2a9debb68123 for instance f012d530-7780-4cee-b0a6-c45d87e87b69 on n-h2-850468-18 Aug 25 12:45:29.928724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:29.934840 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-20b5d666-59cb-4ffc-9886-710db97e61c1 req-1c0b4455-a42a-44f7-87a6-70ab7d507a98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133661 Aug 25 12:45:29.940777 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 990/1881] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:29.959217 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8def4faa-0011-4161-adfb-fb865151ccf9 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1294 microversion: 2.1 time: 0.851423 Aug 25 12:45:29.960800 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 892/1882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:29 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1294 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:29.980805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:29.982288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:29.988784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:30.006952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.007960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.009796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.012412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.013715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.015938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.036834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.043691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.044759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.096043 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] Creating event network-changed:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h1-850468-18 Aug 25 12:45:30.118809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: 14568e19-4af8-4b2b-9545-1e489061abe3] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:30.120175 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0f7b5eb0-7a99-4e32-b313-f8085ed52121 req-f5ff7ca5-d7e7-4cc0-8a21-2e6a3b6f6807 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138518 Aug 25 12:45:30.124916 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 893/1883] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:30.137535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:30.146992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:30.153343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:30.192270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.193567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.197928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.200171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.205439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.206639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.373178 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e2e6714-bfcc-4183-8bf5-ebf21c926d24 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3" status: 204 len: 0 microversion: 2.1 time: 0.418344 Aug 25 12:45:30.384172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 991/1884] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:29 2022] DELETE /compute/v2.1/servers/14568e19-4af8-4b2b-9545-1e489061abe3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:30.392194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:30.395090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:30.412436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.413765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.418010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:30.419482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:30.421091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:30.422817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.173691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:31.222733 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ec8e7bf-2fed-4e30-9c09-0a5b88c1e96b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.095015 Aug 25 12:45:31.224858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 894/1885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:30 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:31.243886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:31.257177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:31.287101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.289259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.291394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.293346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:31.295261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:31.295981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:31.558617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:31.607535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f505e53-576f-402c-a6eb-7e31e3deb9dc tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1351 microversion: 2.1 time: 1.228134 Aug 25 12:45:31.608983 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 992/1886] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:30 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1351 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:31.619552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2138420824", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9becd9c2-2917-439a-ae59-9a15d64c959c"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:31.838717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] validate_networks() for [('9becd9c2-2917-439a-ae59-9a15d64c959c', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:45:32.836165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:32.912605 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-caa6d940-c14e-4014-a622-e7eae105f10f tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.684086 Aug 25 12:45:32.915430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 895/1887] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:31 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:32.935085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:32.936376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:32.966194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:32.967100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:32.967865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:32.969240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:32.997850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:32.999151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:35.335190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:35.386493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7981706-0228-4c79-9e99-d3bb2086fdd3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1294 microversion: 2.1 time: 2.468973 Aug 25 12:45:35.400681 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 896/1888] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:32 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1294 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:35.424765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:35.425977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:35.483484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:35.484433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:35.485617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:35.487274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:35.490531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:35.498261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:36.755067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:36.802909 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ade9b0d4-57a0-4701-a16c-5b7d23f527fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.399692 Aug 25 12:45:36.816757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 897/1889] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:35 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:36.841267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:36.843216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:36.897219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:36.898171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:36.913198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:36.914460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:36.916538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:36.917343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.459719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:38.498283 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00b2c55f-e91d-4ac5-a6a6-20dce3d601f9 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1541 microversion: 2.1 time: 1.679479 Aug 25 12:45:38.499345 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 898/1890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:36 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1541 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:38.532829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:38.538387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:38.577400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.582607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.583937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.585703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.587924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.595389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.926147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:45:38.928389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:45:38.934774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:45:38.938643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:45:38.939948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:45:38.968733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.971574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.973400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:38.975473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:38.977633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:38.979432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.035094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Getting quotas for project 72e55826cfe54661b3f6868941c03c80. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:45:39.075195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Getting quotas for user 49806f7cfdde411093826853cf371e54 and project 72e55826cfe54661b3f6868941c03c80. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:45:39.137867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Going to run 2 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:45:39.145028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:39.333904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=be99e5dd-05c0-4234-9337-c5595c8bdec1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:45:39.657679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7c70c6a-d69e-49cb-a4c1-65ab4398296f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 8.042283 Aug 25 12:45:39.660688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 993/1891] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:45:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 8051 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 25 12:45:39.694717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:39.706081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:39.734102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.735422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.736441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.740379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.741494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.742621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.822540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:39.865893 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-afd63a6b-508d-467f-82df-5664ac9f708c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201815 Aug 25 12:45:39.867425 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 994/1892] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:45:39 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:45:39.883620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:39.886168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:39.889307 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-057f56dc-0735-41fb-b207-7332c58f040b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.376499 Aug 25 12:45:39.897270 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 899/1893] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:38 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:39.902154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.903349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.903974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.905454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:39.907748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:39.908880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:39.926561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa92b280-b754-479a-93fb-029a60750ae6", "name": "network-vif-deleted", "tag": "473451ac-5ae9-42ce-a418-0cc0ee0c859b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:39.998875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.000351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.001395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.079072 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] Creating event network-vif-deleted:473451ac-5ae9-42ce-a418-0cc0ee0c859b for instance fa92b280-b754-479a-93fb-029a60750ae6 on n-h2-850468-18 Aug 25 12:45:40.117768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0c8654c6-5b8e-490c-b22c-c4b7379d2ca2 req-369006a6-651a-4363-a329-6ba5f9aee93d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204556 Aug 25 12:45:40.123699 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 900/1894] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:40.148275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654", "name": "network-vif-plugged", "status": "completed", "tag": "2d0cf4ba-7af9-42a5-aba9-fb7d1a984494"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:40.207696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.211526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.212903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.310956 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] Creating event network-vif-plugged:2d0cf4ba-7af9-42a5-aba9-fb7d1a984494 for instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 on n-h1-850468-18 Aug 25 12:45:40.333765 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0e98017f-58da-42ce-820c-e02c23fcb6a3 req-8bf0df6b-cd36-4e02-ad30-a350207f749a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206292 Aug 25 12:45:40.340088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 901/1895] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:40.421793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:40.425886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:40.484846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.486329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.487452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:40.489133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:40.490401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:40.492084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.109410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:42.139633 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68ca5145-f7b1-49ed-8c92-1e205fba13cd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1294 microversion: 2.1 time: 2.269311 Aug 25 12:45:42.143627 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 995/1896] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:39 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1294 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:42.187865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.191781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:42.216161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.223057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.228696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.230885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.232286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.235796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.280309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:42.316664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36178e17-d51f-44b5-81e2-bbfd3031a60a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 1.973698 Aug 25 12:45:42.321951 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 902/1897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:40 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:42.343529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.371477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:42.377123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Searching by: {'deleted': False, 'project_id': '72e55826cfe54661b3f6868941c03c80'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:45:42.437084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.441281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.444017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.450494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.451793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.452783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.625579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Listed batch of 2 results from cell out of 999 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:45:42.729525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:42.737861 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d358d1a8-abb0-4c1f-9eec-5057b5174a2c tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.412132 Aug 25 12:45:42.751409 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 903/1898] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers => generated 673 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:42.768537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.778343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:42.806541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.809476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.810791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.812660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.814423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.815557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.849134 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-edb2250e-77e5-44d3-8f9a-2d64c018c172 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.703039 Aug 25 12:45:42.850876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 996/1899] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69/os-interface => generated 284 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:42.869410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:42.872318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:42.905398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.905398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.907856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:42.915811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:42.915811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:42.922588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.009338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d38b933d-7fb0-4810-96c7-b0fbdb9bb5b7 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.262309 Aug 25 12:45:43.014070 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 904/1900] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198/os-volume_attachments => generated 25 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:45:43.037288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14568e19-4af8-4b2b-9545-1e489061abe3", "name": "network-vif-deleted", "tag": "4cc8d4fc-c2a3-43fc-890a-1aea277b466c"}, {"name": "network-changed", "server_uuid": "e6180833-6a10-494c-bf89-3d33c6975e73", "tag": "7121fe1d-d0af-473a-beec-b5b4ae1d7905"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:43.084636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.088457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.092864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.150512 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Creating event network-vif-deleted:4cc8d4fc-c2a3-43fc-890a-1aea277b466c for instance 14568e19-4af8-4b2b-9545-1e489061abe3 on n-h1-850468-18 Aug 25 12:45:43.151892 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] Creating event network-changed:7121fe1d-d0af-473a-beec-b5b4ae1d7905 for instance e6180833-6a10-494c-bf89-3d33c6975e73 on n-h2-850468-18 Aug 25 12:45:43.204543 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f28debda-4e8d-41bb-a36f-764caaebaaef req-0f3520b1-8e4b-4ba1-abe5-db568f80fa69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.184985 Aug 25 12:45:43.209204 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 905/1901] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:43.241707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:43.246363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:43.280612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.282125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.283191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.285111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.286205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.288539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.576746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:43.640658 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a9552e4-5aff-47ec-990e-494f6d08ca23 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1222 microversion: 2.1 time: 0.423149 Aug 25 12:45:43.643656 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 906/1902] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:43 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1222 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:43.671036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:43.675418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:43.724295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.729621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.733517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:43.743508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:43.747215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:43.750258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:44.243941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:44.290481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-033f1627-6e1d-4f63-81d5-8657f528a994 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.436346 Aug 25 12:45:44.291920 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 997/1903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:42 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:44.311697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:44.312871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:44.342133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:44.343363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:44.344575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:44.346277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:44.352164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:44.353385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:44.449362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:45:44.812824 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4f5d050-39d2-4823-9216-116bb37f8697 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 204 len: 0 microversion: 2.1 time: 0.517757 Aug 25 12:45:44.814930 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 998/1904] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:45:44 2022] DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:45:44.840543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:44.843248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:44.891576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:44.892401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:44.893573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:44.895244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:44.898580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:44.901806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:46.037329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:46.066742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77c7bb7a-c18c-477b-bf9b-99ec781192b6 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1294 microversion: 2.1 time: 2.419388 Aug 25 12:45:46.091369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 907/1905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:43 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1294 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:46.127090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:46.128863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:46.150977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:46.153019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:46.155928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:46.158318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:46.159540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:46.160691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:47.179666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:47.215357 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b06f1d6-8abd-4095-9168-157f6bb88884 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1288 microversion: 2.1 time: 1.121763 Aug 25 12:45:47.217016 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 908/1906] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:46 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1288 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:47.229024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:47.230600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:47.253362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.257178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.275260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:47.277434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.280141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.281789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:47.348740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:47.386690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57161c9e-5473-427d-a5fc-74f822165de5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 2.552924 Aug 25 12:45:47.388778 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 999/1907] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:44 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 2573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:47.402198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:47.407131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:47.413288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:47.426861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.427666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.428761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:47.430963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:47.432424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:47.433523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:48.719860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:48.738885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:48.752414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-49aebb33-8f60-4102-84cb-5a8c302d8f3d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1683 microversion: 2.1 time: 1.532744 Aug 25 12:45:48.780718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 909/1908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:47 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1683 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:48.782037 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45f3c782-ce8c-4edd-a51c-9b00780b0e68 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.389911 Aug 25 12:45:48.784840 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1000/1909] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:47 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:48.797849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:48.800215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:48.800215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:48.803367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:48.811397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:48.815851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:48.816939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:48.818127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:48.822275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:48.824816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:48.826098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:48.826453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:48.837277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:48.838623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:48.842123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:48.844266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:48.846095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.006877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:49.110495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:49.127157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:49.147090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-409202d7-8fcd-49f0-8d51-34a088e27c95 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1276 microversion: 2.1 time: 0.359416 Aug 25 12:45:49.152801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1001/1910] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:48 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:49.165590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:49.167355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:49.199638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.201192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.209640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.212277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.213678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.214610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.717939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:49.742125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b37d5a6-c8d2-4313-932d-ef405f4d8478 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1486 microversion: 2.1 time: 0.958477 Aug 25 12:45:49.744798 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 910/1911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:48 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1486 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:49.790852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:49.791670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:49.804354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.805639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.806927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:49.808419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:49.809381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:49.810193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.022625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:50.044138 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df7ddd47-948b-4871-9902-9ce038baa489 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 0.887724 Aug 25 12:45:50.045313 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1002/1912] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:49 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:50.057751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:50.059796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:50.075484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.077396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.078899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.080913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.083141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.084242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.205639 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e2ebe638-5d13-4cb9-b1d4-00e7e6366a8e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.422660 Aug 25 12:45:50.218435 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 911/1913] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:45:49 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654/os-interface => generated 285 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:45:50.220437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:50.221498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:50.235488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.236541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.237619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.239496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:50.240541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:50.241798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:50.956743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:50.975474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:51.018936 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f0997a9-6c59-44cc-91a0-8e736dd3f736 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 0.803675 Aug 25 12:45:51.023958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d98bb3db-7b24-4286-9440-1df760802cc8 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1683 microversion: 2.1 time: 0.973011 Aug 25 12:45:51.024806 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 912/1914] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:50 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:51.031702 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1003/1915] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:50 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1683 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:51.048434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:51.050826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:51.074000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.078320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.081505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.102760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:51.106425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.107805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.109541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:51.126085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.129989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.130872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.131694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.133680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.145954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.147056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.639757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:51.682237 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f8b16a4-97cf-492a-95b3-24f45dd88f4d tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1276 microversion: 2.1 time: 0.651097 Aug 25 12:45:51.704856 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 913/1916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:51 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1276 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:51.750646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f012d530-7780-4cee-b0a6-c45d87e87b69", "tag": "18fbc23b-9074-448d-9f68-2a9debb68123"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:51.790787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:51.791632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:51.793679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:51.840687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] Creating event network-changed:18fbc23b-9074-448d-9f68-2a9debb68123 for instance f012d530-7780-4cee-b0a6-c45d87e87b69 on n-h2-850468-18 Aug 25 12:45:51.852477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f79a35ba-6741-449a-bbc4-202a9acdf08c req-0ef57dc7-c0dc-42a7-8cfe-db052ca27929 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109796 Aug 25 12:45:51.854301 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 914/1917] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:52.081523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:52.084464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:52.117217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.118593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.119754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:52.121493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:52.122786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:52.126898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:52.541952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:53.061224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:53.098228 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cedd5faf-fc09-4de1-811e-0d03aa379a5b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 2.011800 Aug 25 12:45:53.120277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1004/1918] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:51 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:53.140942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:53.142479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:53.158099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.159091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.160262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.161678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.162611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.163422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.729513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:53.749245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f2d5c4ca-8f46-467e-9e36-e53da0dfe31c tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1615 microversion: 2.1 time: 0.626478 Aug 25 12:45:53.749919 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1005/1919] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:53 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1615 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:53.784655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d331e01e-d961-4a8c-9692-09398c935198", "name": "network-vif-unplugged", "status": "completed", "tag": "d3243244-efb5-429f-8f5e-17f3ece1ceaf"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:53.847455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.848384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.855526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.872295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:45:53.919630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] Creating event network-vif-unplugged:d3243244-efb5-429f-8f5e-17f3ece1ceaf for instance d331e01e-d961-4a8c-9692-09398c935198 on n-h1-850468-18 Aug 25 12:45:53.942481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7b25f885-3bc6-4eed-8a06-11ed384293c5 req-1c0ba4c3-6961-4965-9d6e-13a6b49c291b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190323 Aug 25 12:45:53.944381 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1006/1920] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:53.957280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:53.958874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:53.982628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.983827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.989130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:53.989639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:53.991801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:53.996344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:53.997382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.020272 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d99a34e3-15ba-41da-ae5b-0ed5abca474e tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.956984 Aug 25 12:45:54.025973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 915/1921] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:52 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:54.162104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:54.163842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:54.179509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.181577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.182681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.184352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.185355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.186231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.385420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:54.405751 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce0ab63d-c60c-42bb-9d5c-132fee419847 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1276 microversion: 2.1 time: 0.457467 Aug 25 12:45:54.408410 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1007/1922] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:53 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1276 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:54.813109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:54.815018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:54.841975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.843464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.844713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:54.862390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:54.866483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:54.874443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:55.421643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:55.464282 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1198c325-cfa5-48c7-8178-36a43fba7ae0 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1615 microversion: 2.1 time: 0.665555 Aug 25 12:45:55.467856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1008/1923] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:54 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1615 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:55.486642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:55.491876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:55.520539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:55.525840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:55.527466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:55.531745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:55.534728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:55.537742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.589704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:56.631738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b828cd26-9914-46e5-af19-9f74236dcf24 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 1.161427 Aug 25 12:45:56.636850 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1009/1924] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:55 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:56.663469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:56.669580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:56.688424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:56.690131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:56.691630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.694704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:56.697712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:56.701586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.810094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:56.850807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db817335-2a31-4e76-8f13-49eb8801c8a7 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 2.707293 Aug 25 12:45:56.852398 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 916/1925] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:54 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:45:56.860313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6180833-6a10-494c-bf89-3d33c6975e73", "name": "network-vif-plugged", "status": "completed", "tag": "7121fe1d-d0af-473a-beec-b5b4ae1d7905"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:45:56.910123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:56.915736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:56.916719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:56.966527 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] Creating event network-vif-plugged:7121fe1d-d0af-473a-beec-b5b4ae1d7905 for instance e6180833-6a10-494c-bf89-3d33c6975e73 on n-h2-850468-18 Aug 25 12:45:56.990287 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3d3bcb1f-ae24-46bd-b927-33315f960f03 req-ca5bf48d-41bd-4610-afbd-587dbcf07f3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131240 Aug 25 12:45:56.993494 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 917/1926] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:45:57.006524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:57.011320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:57.037429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.042564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.044795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:57.046461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:57.050889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:57.055766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:58.264223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c22ede4a9de4abc9606e234a210d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb85d78d22495b99ddd9a1c4efff22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:58.316675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-353ab24c-473b-4ccf-8876-cab952280520 tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 200 len: 1615 microversion: 2.1 time: 1.317864 Aug 25 12:45:58.317990 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 918/1927] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:56 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 1615 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:58.346666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:58.350457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:58.372942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:58.374242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:58.375616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:58.378386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:58.380105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:58.381711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:58.738474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:45:58.805188 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac1f5e3d-f46f-4278-bc2e-a00650ea4823 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 2.165782 Aug 25 12:45:58.806278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1010/1928] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:56 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:45:58.833069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:45:58.835759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:45:58.891016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:58.891913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:58.901271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:45:58.902540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:45:58.912200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:45:58.912200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:00.546434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:00.624525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d628579e-4e4f-4f82-9e3f-5343de3bd63b tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1316 microversion: 2.1 time: 2.297395 Aug 25 12:46:00.625819 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 919/1929] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:58 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1316 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:00.678570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d331e01e-d961-4a8c-9692-09398c935198", "name": "network-vif-deleted", "tag": "d3243244-efb5-429f-8f5e-17f3ece1ceaf"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:00.731492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:00.738861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:00.739789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:00.809208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] Creating event network-vif-deleted:d3243244-efb5-429f-8f5e-17f3ece1ceaf for instance d331e01e-d961-4a8c-9692-09398c935198 on n-h1-850468-18 Aug 25 12:46:00.840015 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-017db100-36b3-4e78-8681-44462b1c4ae2 req-b573cd43-0570-4ff2-9067-89d76a92fec0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204364 Aug 25 12:46:00.845444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 920/1930] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:00.875319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:00.877817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:00.919358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:00.921338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:00.922735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:00.927593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:00.928973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:00.931989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.008917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] HTTP exception thrown: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Request method failure captured: Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 HTTP/1.1 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB23WxEJU2sZUC7wzq9O5aMMg2KYmp6VDTJJoCfZbVnAo-mVEkIWVgIbkn952fQidKs1AZQj_z6SOwuGUt2YLg1fXSLtPZD8bqU3Rpc_MP-jxsSxbheH6pfQNaDlL6SrnlMZrY4cw_RZkU0KJ9k89r32InYLfyjmWtO4idqXTcC_IPtE Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0c22ede4a9de4abc9606e234a210d8a1 Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd331e01e-d961-4a8c-9692-09398c935198'} Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:01.029074 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:01.037944 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:01.041166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Returning 404 to user: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:01.048198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-90141e23-ea6c-43f0-a947-be1be09d231d tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 404 len: 111 microversion: 2.1 time: 0.199814 Aug 25 12:46:01.053260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 921/1931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:00 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:01.075599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:01.089470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:01.111531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.115969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.120702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.122561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.126772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.128224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.650157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:01.716261 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2972d699-d151-4dc4-a1d5-29e7649da0a4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1717 microversion: 2.1 time: 2.883117 Aug 25 12:46:01.718252 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1011/1932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:45:58 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1717 bytes in 2908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:01.750920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:01.764576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:01.821700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.823394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.830769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:01.844003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:01.845450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:01.848762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.080693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:03.107857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53584391-995e-4bb3-865d-4d3b529c328e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1486 microversion: 2.1 time: 2.049066 Aug 25 12:46:03.108930 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 922/1933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:01 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1486 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:03.135283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08fa4e48-03c5-4fc0-8f8a-c9fae0ecd85e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '.version_select at 0x7fc6c29aae50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:03.222802 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08fa4e48-03c5-4fc0-8f8a-c9fae0ecd85e tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048163009" status: 202 len: 0 microversion: 2.1 time: 0.111016 Aug 25 12:46:03.224593 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 923/1934] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048163009 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:03.238696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:03.239742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:03.272771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.287493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.291261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.294973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.300172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.306968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.515662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:03.567340 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6645cd31-e4c6-4443-bd48-8741d726b006 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 1.845644 Aug 25 12:46:03.569742 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1012/1935] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:01 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:03.584639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:03.588269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:03.642085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.643856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.650690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:03.652988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:03.654125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:03.656877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:04.506239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:04.541181 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-308288c9-9d94-4829-9310-61ca4e810fdb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1504 microversion: 2.1 time: 1.309980 Aug 25 12:46:04.557770 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 924/1936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:03 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1504 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:04.600070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654", "tag": "2d0cf4ba-7af9-42a5-aba9-fb7d1a984494"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:04.662047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:04.674416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:04.685920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:04.723472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:04.752840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] Creating event network-changed:2d0cf4ba-7af9-42a5-aba9-fb7d1a984494 for instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 on n-h1-850468-18 Aug 25 12:46:04.779392 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-961e553f-5efc-4f13-a6a7-f4357344b680 req-3ed1bb44-a221-46fc-bce5-2f0d93e5af36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212698 Aug 25 12:46:04.787408 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 925/1937] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:04.865425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be99e5dd-05c0-4234-9337-c5595c8bdec1", "tag": "388cd75a-459d-413c-bf11-34804b2df32d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:04.937339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:04.938709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:04.939804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:04.988674 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] Creating event network-changed:388cd75a-459d-413c-bf11-34804b2df32d for instance be99e5dd-05c0-4234-9337-c5595c8bdec1 on n-h2-850468-18 Aug 25 12:46:05.015131 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7640bfe0-dac9-4986-ab09-a606e3e60783 req-19e73179-2585-433d-9471-7c5186051433 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217739 Aug 25 12:46:05.018745 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 926/1938] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:05.038358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:05.043208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:05.083049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.086974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.088422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.092854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.097839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.099484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.190226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:05.224310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5a09e6a4-a895-47ae-89b5-9a6061bc1bb5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1707 microversion: 2.1 time: 1.649382 Aug 25 12:46:05.230909 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1013/1939] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:03 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1707 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:05.253860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:05.271443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:05.303129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.305389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.310788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.312863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.318309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.319832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.351941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:05.360061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a765571-e23b-471a-ae55-5f632faf3de0 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/os-instance-actions/req-f60a3ae2-76a4-4719-99b6-8d321951816f" status: 200 len: 313 microversion: 2.1 time: 0.337787 Aug 25 12:46:05.371627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 927/1940] 10.222.0.60 () {58 vars in 1419 bytes} [Thu Aug 25 12:46:05 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/os-instance-actions/req-f60a3ae2-76a4-4719-99b6-8d321951816f => generated 313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:05.427715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae1a4442-289e-48b2-8de1-125c2d14368b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '.version_select at 0x7fc6c2929ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:05.463269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae1a4442-289e-48b2-8de1-125c2d14368b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.466542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae1a4442-289e-48b2-8de1-125c2d14368b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.472676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae1a4442-289e-48b2-8de1-125c2d14368b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.540417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae1a4442-289e-48b2-8de1-125c2d14368b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.154684 Aug 25 12:46:05.543152 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 928/1941] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:46:05 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:05.556276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:05.594444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:05.644014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.647266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.653458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:05.657282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:05.668024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:05.672682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:06.172047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8c8aa5da-a98e-4dda-882e-908ec6c23ef7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "POST /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/action" status: 202 len: 0 microversion: 2.1 time: 0.614445 Aug 25 12:46:06.191931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 929/1942] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:46:05 2022] POST /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:06.251409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:06.258729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:06.326582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:06.328851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:06.338062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:06.339763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:06.359302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:06.362685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:07.531877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:07.594417 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-164e0a9d-74c1-4da8-b242-bac19d1a70e3 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 2.360519 Aug 25 12:46:07.596776 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1014/1943] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:05 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:07.609675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:07.611765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:07.629003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:07.632020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:07.669295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:07.671282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:07.672371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:07.678767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:07.997184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6403e34d-8411-4c96-8ec9-459bcbffe383 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1860 microversion: 2.1 time: 1.792810 Aug 25 12:46:07.998597 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 930/1944] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:06 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1860 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:08.016699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5e1077-0a3f-47bc-851d-06ca51c48122", "tag": "ede81b48-6873-482e-b683-00d3b9e41a58"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:08.043868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:08.045570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:08.046920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:08.092252 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] Creating event network-changed:ede81b48-6873-482e-b683-00d3b9e41a58 for instance cf5e1077-0a3f-47bc-851d-06ca51c48122 on n-h1-850468-18 Aug 25 12:46:08.111832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ad892b99-5368-49b5-b506-536373eb3ab1 req-5d8621e4-d619-43eb-bd75-1764021c5a77 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111179 Aug 25 12:46:08.122184 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 931/1945] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:08.145594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:08.150167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:08.186796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:08.189245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:08.191187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:08.193060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:08.194601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:08.196018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.483116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:09.529325 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1da11ec0-a314-4211-a37f-fb130c7dd452 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1506 microversion: 2.1 time: 1.928527 Aug 25 12:46:09.530631 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1015/1946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:07 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1506 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:09.559342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:09.560890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:09.580047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.581534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.582810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.585187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.587209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.590557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.644515 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b343582f-da07-4669-bd12-193cb023ccd6 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1860 microversion: 2.1 time: 1.513322 Aug 25 12:46:09.648919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 932/1947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:08 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1860 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:09.675560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:09.677451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:09.714779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.717413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.718931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.721273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:09.723961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:09.726713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:09.746459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:10.127847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f9c9d3e-1b0c-41e5-b5ab-ff370d487cd2 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 204 len: 0 microversion: 2.1 time: 0.587320 Aug 25 12:46:10.131348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1016/1948] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:09 2022] DELETE /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:10.159503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:10.162509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:10.198277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.201209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.205150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.208241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.214438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.215761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.674150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lazy-loading 'services' on Instance uuid 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:10.794177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:10.841303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7c3eb660-a362-4e3b-9bf3-372c32110b98 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 1.182872 Aug 25 12:46:10.883521 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 933/1949] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:09 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:10.904199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:10.907261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:10.928384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.931106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.932673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.934681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:10.936190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:10.938009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:10.959998 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c92f153-4c53-4acf-be96-896a1b9b87f2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments/2b166eef-99d7-4e89-b8e1-8a4916c04078" status: 202 len: 0 microversion: 2.1 time: 0.804437 Aug 25 12:46:10.963109 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1017/1950] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 12:46:10 2022] DELETE /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments/2b166eef-99d7-4e89-b8e1-8a4916c04078 => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:10.985663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:10.986623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:11.005039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:11.006356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:11.008265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:11.019813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:11.022019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:11.023336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.215927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:12.250575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b2a7a9a-5629-47be-b9a1-e22c0f2053e7 tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1664 microversion: 2.1 time: 1.357789 Aug 25 12:46:12.264776 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 934/1951] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:10 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1664 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:12.275109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:12.291229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:12.318123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.323091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.324015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.325456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.326335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.333411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.525442 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1508a975-5efb-425d-9412-92767d1bf00d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.263000 Aug 25 12:46:12.538427 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 935/1952] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:12 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:12.581404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:12.604795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:12.606116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:12.647202 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5be2a3f6-641f-42fd-baf4-2a8028c46d80 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1506 microversion: 2.1 time: 1.673794 Aug 25 12:46:12.662098 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1018/1953] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:10 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1506 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:12.673730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.700220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.710736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:12.716156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:12.717171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:12.717836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:13.322056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:13.323205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:13.392262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:13.393130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:13.393908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:13.395280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:13.396052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:13.417742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.146841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:14.207518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aef1c56c-23d4-41af-9251-1edb511c455f tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1664 microversion: 2.1 time: 0.904245 Aug 25 12:46:14.222086 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1019/1954] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:13 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1664 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:14.276936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:14.295765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:14.349837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.352678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.357445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.361501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.364276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.369060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.553546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1fba6df6-4479-4b64-878e-63be7347820f tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.310436 Aug 25 12:46:14.568514 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1020/1955] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:14 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:14.592024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:14.598561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:14.653924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.659615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.662984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.676380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:14.682184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:14.683772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:14.697227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:15.649788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:15.694745 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00f4fd9c-381a-4076-8db1-e15eb372205e tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 3.153718 Aug 25 12:46:15.705396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 936/1956] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:12 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:15.769773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be99e5dd-05c0-4234-9337-c5595c8bdec1", "name": "network-vif-plugged", "status": "completed", "tag": "388cd75a-459d-413c-bf11-34804b2df32d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:15.814113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:15.814622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:15.820368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:15.888062 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] Creating event network-vif-plugged:388cd75a-459d-413c-bf11-34804b2df32d for instance be99e5dd-05c0-4234-9337-c5595c8bdec1 on n-h2-850468-18 Aug 25 12:46:15.945047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-19cb0b39-da85-4b47-a444-a4e79118c6a9 req-e401aa2e-677e-447b-96f8-29ba222dad66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196393 Aug 25 12:46:15.947479 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 937/1957] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:15.978849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:15.984757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:16.026024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:16.044703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:16.046114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:16.049759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:16.058534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:16.062442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:17.342600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:17.385245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-beb1d2b1-c15c-4f16-882e-132433656ecb tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1506 microversion: 2.1 time: 2.820574 Aug 25 12:46:17.404712 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1021/1958] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:14 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1506 bytes in 2841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:17.458701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:17.482664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:17.539521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:17.562228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:17.563192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:17.564295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:17.568948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:17.574473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:17.575292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:17.701506 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39a1b0ad-ddb4-4165-ad3b-a318ec6693ac tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.293782 Aug 25 12:46:17.708442 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1022/1959] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:17 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:17.729477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:17.733477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:17.769224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:17.770696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:17.773981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:17.779107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:17.784044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:17.785182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:18.811403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c0e075a4714489a7c04b785b4766fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d3afcb61cd4de7a865af7b9581d764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:18.860313 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aadb8a01-7a48-4823-b8bc-e32683f0155d tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 200 len: 1597 microversion: 2.1 time: 2.906031 Aug 25 12:46:18.864653 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 938/1960] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:15 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 1597 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:18.892905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f012d530-7780-4cee-b0a6-c45d87e87b69", "name": "network-vif-deleted", "tag": "18fbc23b-9074-448d-9f68-2a9debb68123"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:18.961644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:18.981816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:18.988214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:18.992774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.094326 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] Creating event network-vif-deleted:18fbc23b-9074-448d-9f68-2a9debb68123 for instance f012d530-7780-4cee-b0a6-c45d87e87b69 on n-h2-850468-18 Aug 25 12:46:19.140556 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-533d8a0e-d939-4214-a747-9f46137a3cfa req-dcdbc1d5-88a1-4358-b058-d606e9a28566 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268147 Aug 25 12:46:19.145795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 939/1961] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:19.164806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:19.166896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:19.180215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:19.181719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:19.183145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.184853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:19.186097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:19.187425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.767168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:19.827665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce770136-3eec-4704-8520-6975e32c3a94 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 2.114865 Aug 25 12:46:19.829560 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1023/1962] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:17 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:19.847118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5e1077-0a3f-47bc-851d-06ca51c48122", "name": "network-vif-plugged", "status": "completed", "tag": "ede81b48-6873-482e-b683-00d3b9e41a58"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:19.891164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:19.892844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:19.894154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:19.928459 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] Creating event network-vif-plugged:ede81b48-6873-482e-b683-00d3b9e41a58 for instance cf5e1077-0a3f-47bc-851d-06ca51c48122 on n-h1-850468-18 Aug 25 12:46:19.942768 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-96a0ebc7-ff6d-4c37-8ce4-9362fa3e699f req-447b2eeb-dae2-458c-8cd6-6a46548f5ebc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109765 Aug 25 12:46:19.964701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:19.971588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1024/1963] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:20.006849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.009712 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a68cb7d-7592-4c8c-a767-4bbe8aa54ac7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1504 microversion: 2.1 time: 0.857450 Aug 25 12:46:20.010676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 940/1964] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:19 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1504 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:20.013117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.049311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.050227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.051077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.052593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.053462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.057638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.063038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] [instance: f012d530-7780-4cee-b0a6-c45d87e87b69] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.075994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.088950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.108564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.109153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.127160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.128095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.129083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.236168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e304ef84-4af3-4213-a344-9c61ef380b81 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261248 Aug 25 12:46:20.238324 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1025/1965] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:19 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:20.242348 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] HTTP exception thrown: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. Aug 25 12:46:20.249859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '.version_select at 0x7fc6c6c9a5e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.251518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.269860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.271204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.272419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Request method failure captured: Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 HTTP/1.1 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB26jUrxQWKuxvCFQWppqQveYjbtE4GpTAU4437Ziu5vM6fXqv2mx-8NePV8DL61Z_mm1qDdkbXPfPqDKsVkm5-jfRDoEUt55sIhIjFWFpm-sMLePo2abHIqNo_4ja7G_DuUVy-_ogotGdz5z8hotNOhuNbCS95d4tp9AVTBTr5TBFTQ Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e4d3afcb61cd4de7a865af7b9581d764 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestFqdnHostnames-2137694767 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4d3afcb61cd4de7a865af7b9581d764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4d3afcb61cd4de7a865af7b9581d764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4d3afcb61cd4de7a865af7b9581d764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4d3afcb61cd4de7a865af7b9581d764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestFqdnHostnames-2137694767 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e4d3afcb61cd4de7a865af7b9581d764 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2137694767 Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestFqdnHostnames-2137694767-project Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a1c0e075a4714489a7c04b785b4766fa Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestFqdnHostnames-2137694767-project Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'f012d530-7780-4cee-b0a6-c45d87e87b69'} Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:20.276914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Returning 404 to user: Instance f012d530-7780-4cee-b0a6-c45d87e87b69 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:20.283908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d4809e4b-dd7e-4421-9557-e7d7386dbebd tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69" status: 404 len: 111 microversion: 2.1 time: 0.261181 Aug 25 12:46:20.297729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.299657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.301303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.317979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 941/1966] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:20 2022] GET /compute/v2.1/servers/f012d530-7780-4cee-b0a6-c45d87e87b69 => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:20.351472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-417dc887-16c6-4fd2-a187-34839c3b65cf tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] Calling method '.version_select at 0x7fc6c6c475e0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.434535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-417dc887-16c6-4fd2-a187-34839c3b65cf tempest-ServersTestFqdnHostnames-2137694767 tempest-ServersTestFqdnHostnames-2137694767-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870849217" status: 202 len: 0 microversion: 2.1 time: 0.113786 Aug 25 12:46:20.448917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 942/1967] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870849217 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:46:20.487078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-88cfba75-c2b4-4086-ab0e-bea654c0d79a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.245867 Aug 25 12:46:20.495910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1026/1968] 10.222.0.60 () {58 vars in 1296 bytes} [Thu Aug 25 12:46:20 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73/os-instance-actions => generated 611 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:20.526724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.532669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.616014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.620805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.629476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.641333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.642346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.649515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.807243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:20.880717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:20.883491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:20.917811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.923571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.925398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:20.927448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:20.933170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:20.935623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.269193 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b807d32-b9ed-4210-b575-1db0edec51a4 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 204 len: 0 microversion: 2.1 time: 0.745505 Aug 25 12:46:21.275409 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 943/1969] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:20 2022] DELETE /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:46:21.308782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:21.317987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:21.348265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:21.355607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:21.356717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.358323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:21.359147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:21.363851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.462515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:21.484983 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-afa495d5-42b1-4843-8590-a61a9489ba0d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205416 Aug 25 12:46:21.487405 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 944/1970] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:21 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:21.497994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:21.499131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:21.515642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:21.517323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:21.519361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.521978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:21.523315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:21.525427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:21.933244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:21.949330 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d96db8f6-b40a-4bbf-953e-768f3ac59391 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1318 microversion: 2.1 time: 1.079496 Aug 25 12:46:21.950449 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1027/1971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:20 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:22.239791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:22.309027 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f1bd550-b30b-4b2e-bd61-fd15ce2765d7 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1510 microversion: 2.1 time: 0.817832 Aug 25 12:46:22.315909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 945/1972] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:21 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1510 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:22.517934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:22.541768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:22.595797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:22.604197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:22.606705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:22.619331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:22.622704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:22.629678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:22.799535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64d59f1f-868b-4eb1-b9a7-2d1ddd75b2a8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.297524 Aug 25 12:46:22.801919 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1028/1973] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:22 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:23.007095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:23.008917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:23.039456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.045519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.046378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:23.053116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.057460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.058709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:23.364192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:23.365796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:23.379144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.380283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.381150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:23.383188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:23.384238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:23.395208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.359125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:24.378169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:24.425049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-676e2156-c375-4573-ae01-b12ef3d7956f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1507 microversion: 2.1 time: 1.426960 Aug 25 12:46:24.427086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 946/1974] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:22 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1507 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:24.455498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:24.461869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d69c6f7a-65f6-4470-8c81-bac7751c253a tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1510 microversion: 2.1 time: 1.116920 Aug 25 12:46:24.463436 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1029/1975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:23 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1510 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:24.468000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:24.484799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:24.501154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:24.501659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:24.502857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:24.505506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.507232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:24.508531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:24.509557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.535765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:24.536804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:24.537695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.545199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:24.556553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:24.557786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:24.622930 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1883a9b-795d-4640-a748-a4a49748ad73 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192742 Aug 25 12:46:24.627805 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 947/1976] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:24 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:25.520486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:25.528201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:25.581505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.584542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.587610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:25.593086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:25.595552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:25.599917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.227890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:26.298900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b4706ac-68a7-4d35-b7b8-64f1cfdfb282 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 200 len: 1507 microversion: 2.1 time: 1.825860 Aug 25 12:46:26.300212 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1030/1977] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:24 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 1507 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:26.367286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:26.371354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:26.453964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:26.456607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:26.456607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.457727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:26.458462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:26.477922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:26.648684 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3beed982-b412-494f-be6b-da72aeadd653 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.334985 Aug 25 12:46:26.666767 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1031/1978] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:26 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 197 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:27.005500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:27.048659 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bec75657-05ad-47b3-9436-168deb14d2a2 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1510 microversion: 2.1 time: 1.545151 Aug 25 12:46:27.060561 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 948/1979] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:25 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1510 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:27.099984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:27.109230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:27.145246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.154153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.155817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.156899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.157991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.159343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.322075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:27.487153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6180833-6a10-494c-bf89-3d33c6975e73", "name": "network-vif-unplugged", "status": "completed", "tag": "7121fe1d-d0af-473a-beec-b5b4ae1d7905"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:27.533949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.540350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.541912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.579151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] Creating event network-vif-unplugged:7121fe1d-d0af-473a-beec-b5b4ae1d7905 for instance e6180833-6a10-494c-bf89-3d33c6975e73 on n-h2-850468-18 Aug 25 12:46:27.593449 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8a97b6e9-9093-4d2a-8db2-7db5a442a086 req-1ba463e2-b1af-4c34-9461-514dff768338 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.923687 Aug 25 12:46:27.603285 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1032/1980] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:27.781059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40690fcc-29f1-4251-92c1-9cd9a30f7e9b tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 204 len: 0 microversion: 2.1 time: 0.716056 Aug 25 12:46:27.784804 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 949/1981] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:27 2022] DELETE /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:27.853897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:27.866345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:27.892912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.894411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.895788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.897716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.900155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.901567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:27.927418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6180833-6a10-494c-bf89-3d33c6975e73", "name": "network-vif-deleted", "tag": "7121fe1d-d0af-473a-beec-b5b4ae1d7905"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:27.978858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:27.980412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:27.981657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.031293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] Creating event network-vif-deleted:7121fe1d-d0af-473a-beec-b5b4ae1d7905 for instance e6180833-6a10-494c-bf89-3d33c6975e73 on n-h2-850468-18 Aug 25 12:46:28.056788 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a44f27be-1c62-4743-918c-8657fca2a87a req-fe568f0d-24f7-4b1f-8dca-aa7231bf9c30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.450286 Aug 25 12:46:28.058214 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1033/1982] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:28.072382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.073525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:28.074305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-558d31aa-d83b-44fb-a597-63e24b74b0ea tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.280727 Aug 25 12:46:28.095526 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 950/1983] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:46:27 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc/os-volume_attachments => generated 25 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:46:28.103414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.104909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.107497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.112748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.114187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.119808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.159913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.161456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:28.211257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.213271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:28.216652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.221134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.229752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.236417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.241750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.469748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.471503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.475012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.477232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lazy-loading 'fault' on Instance uuid e6180833-6a10-494c-bf89-3d33c6975e73 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:28.651799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e37dcf9-d3a8-4165-bf57-483d1cfe03a6 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 204 len: 0 microversion: 2.1 time: 0.590169 Aug 25 12:46:28.656634 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1034/1984] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:28 2022] DELETE /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:28.675863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:28.678314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:28.692926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.694334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.696638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.700079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:28.702015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:28.702677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:28.931730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e1e46f25b7848d2b936f7c7509ff8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b939a6b3254c378ccb17f94122d7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:28.987364 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2585a987-3c2d-4f92-be75-329e73d20774 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 200 len: 1306 microversion: 2.1 time: 0.871243 Aug 25 12:46:28.989066 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 951/1985] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:28 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 1306 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:30.041540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:30.048749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] [instance: e6180833-6a10-494c-bf89-3d33c6975e73] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:30.096589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:30.106143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:30.107661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:30.111847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:30.113063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:30.119239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:30.185778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] HTTP exception thrown: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Request method failure captured: Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 HTTP/1.1 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB27UAY1pKAnLXdape25rEKnQ-t6lsi2Yag7BEnQSTbvg8H7ECbuHrVd5dnLPFnxY4Vnr0oL1kjDJgufVDxBDGSrGK7QEcaZln3DjMvdxKZWvpPSScZbJm8NHzYCckJrw0GPxsssFKO5ekGfcA9d4raSvCdek7N5xHacCaZYfQVtKwKw Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b1b939a6b3254c378ccb17f94122d7ee Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceActionsTestJSON-61995944 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1b939a6b3254c378ccb17f94122d7ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1b939a6b3254c378ccb17f94122d7ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1b939a6b3254c378ccb17f94122d7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1b939a6b3254c378ccb17f94122d7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceActionsTestJSON-61995944 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b1b939a6b3254c378ccb17f94122d7ee Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceActionsTestJSON-61995944 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceActionsTestJSON-61995944-project Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2e1e46f25b7848d2b936f7c7509ff8f9 Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceActionsTestJSON-61995944-project Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'e6180833-6a10-494c-bf89-3d33c6975e73'} Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:30.191888 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. Aug 25 12:46:30.208335 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:30.223052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] Returning 404 to user: Instance e6180833-6a10-494c-bf89-3d33c6975e73 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:30.230894 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b780b01e-e95d-4bea-89ac-2170e15935f1 tempest-InstanceActionsTestJSON-61995944 tempest-InstanceActionsTestJSON-61995944-project] 10.222.0.60 "GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73" status: 404 len: 111 microversion: 2.1 time: 0.198172 Aug 25 12:46:30.236178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 952/1986] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:30 2022] GET /compute/v2.1/servers/e6180833-6a10-494c-bf89-3d33c6975e73 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:46:30.911174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:30.956992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec384697-d0df-4185-9195-7cc662a0e765 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 200 len: 1513 microversion: 2.1 time: 2.291168 Aug 25 12:46:30.960694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1035/1987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:28 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 1513 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:32.003950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:32.013617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:32.055410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:32.056542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:32.066567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:32.071198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:32.071876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:32.074778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:34.076607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:34.119273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ad5a2d5-29f6-485d-ba63-03e992c098b0 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 200 len: 1513 microversion: 2.1 time: 2.123524 Aug 25 12:46:34.161307 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 953/1988] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:31 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 1513 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:35.195628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:35.197141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:35.231341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.232448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.237322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.238847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:35.241893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:35.244485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:35.820030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:35.895134 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-074255cc-3cc9-4205-b373-7393a2dec064 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 200 len: 1471 microversion: 2.1 time: 0.697483 Aug 25 12:46:35.898510 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1036/1989] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:35 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 1471 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:36.409582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be99e5dd-05c0-4234-9337-c5595c8bdec1", "name": "network-vif-deleted", "tag": "388cd75a-459d-413c-bf11-34804b2df32d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:36.495847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.499527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.500856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.566726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] Creating event network-vif-deleted:388cd75a-459d-413c-bf11-34804b2df32d for instance be99e5dd-05c0-4234-9337-c5595c8bdec1 on n-h2-850468-18 Aug 25 12:46:36.580053 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a2a7de54-18d8-4aa8-bc95-94c3b3c4da92 req-09abc302-cf6c-4290-b9d3-26031acb6372 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186318 Aug 25 12:46:36.589178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 954/1990] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:36.939633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:36.940311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:36.981422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:36.982228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:36.983069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:36.999248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.002567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.003655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.311445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:37.327904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:37.329037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:37.330075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lazy-loading 'fault' on Instance uuid be99e5dd-05c0-4234-9337-c5595c8bdec1 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:37.980433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:38.017424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:38.035199 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a635874-1dbc-4de0-a3c3-0b609c2a36d4 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 200 len: 1308 microversion: 2.1 time: 1.095546 Aug 25 12:46:38.039652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1037/1991] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:36 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 1308 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:38.723075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5e1077-0a3f-47bc-851d-06ca51c48122", "name": "network-vif-deleted", "tag": "ede81b48-6873-482e-b683-00d3b9e41a58"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:38.776304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:38.781838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:38.786131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:38.822352 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] Creating event network-vif-deleted:ede81b48-6873-482e-b683-00d3b9e41a58 for instance cf5e1077-0a3f-47bc-851d-06ca51c48122 on n-h1-850468-18 Aug 25 12:46:38.844253 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-665c69a1-6c88-4ee4-97b8-70d607470b74 req-2795fd81-7d49-4120-b086-2c2e5137aff6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153467 Aug 25 12:46:38.852497 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 955/1992] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:46:39.034702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.037177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:39.081333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.090528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.093538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.098517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.098806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.099910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.100451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: be99e5dd-05c0-4234-9337-c5595c8bdec1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:39.103648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.125569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.126646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.127520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.129005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.130056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.130869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.189782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] HTTP exception thrown: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Request method failure captured: Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 HTTP/1.1 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB23WxEJU2sZUC7wzq9O5aMMg2KYmp6VDTJJoCfZbVnAo-mVEkIWVgIbkn952fQidKs1AZQj_z6SOwuGUt2YLg1fXSLtPZD8bqU3Rpc_MP-jxsSxbheH6pfQNaDlL6SrnlMZrY4cw_RZkU0KJ9k89r32InYLfyjmWtO4idqXTcC_IPtE Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0c22ede4a9de4abc9606e234a210d8a1 Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd331e01e-d961-4a8c-9692-09398c935198'} Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:39.197531 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.206648 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.212981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] HTTP exception thrown: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. Aug 25 12:46:39.213294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Returning 404 to user: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Request method failure captured: Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 HTTP/1.1 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB26XLhtWkTIGymT2PdMVjA6PGRQHCCOFprZb2pBaZYpWIzFOVZdkPuUjuLXBfe2j39Z0Sf7YZA-W6MEDar12aA2Wv1QEFNKFum2qQPSDYjNBcyST3b2vl6fPb0MiGTE31TERowst-ncVLNBst4Pc_brJvZuLKJafjpvJ2V1ZMIkIKAo Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 72e55826cfe54661b3f6868941c03c80 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e55826cfe54661b3f6868941c03c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 72e55826cfe54661b3f6868941c03c80 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MultipleCreateTestJSON-406763876-project Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 49806f7cfdde411093826853cf371e54 Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MultipleCreateTestJSON-406763876-project Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'be99e5dd-05c0-4234-9337-c5595c8bdec1'} Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.214718 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.222856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Returning 404 to user: Instance be99e5dd-05c0-4234-9337-c5595c8bdec1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:39.224348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42d733f9-6426-4e74-a19e-b58434b668ad tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 404 len: 111 microversion: 2.1 time: 0.208401 Aug 25 12:46:39.224564 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78c374cc-3f0b-4f3e-9126-8ac87ec22e0f tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1" status: 404 len: 111 microversion: 2.1 time: 0.143510 Aug 25 12:46:39.224783 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1038/1993] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:39 2022] DELETE /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:39.225511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 956/1994] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:39 2022] GET /compute/v2.1/servers/be99e5dd-05c0-4234-9337-c5595c8bdec1 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:46:39.242130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.244167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] [instance: d331e01e-d961-4a8c-9692-09398c935198] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:39.250835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:39.252106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:39.266642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.268336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.270930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.277400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.279115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.280022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.297792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.314022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.314934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.316693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.317921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.319158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.341078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] HTTP exception thrown: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Request method failure captured: Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 HTTP/1.1 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB23WxEJU2sZUC7wzq9O5aMMg2KYmp6VDTJJoCfZbVnAo-mVEkIWVgIbkn952fQidKs1AZQj_z6SOwuGUt2YLg1fXSLtPZD8bqU3Rpc_MP-jxsSxbheH6pfQNaDlL6SrnlMZrY4cw_RZkU0KJ9k89r32InYLfyjmWtO4idqXTcC_IPtE Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0bb85d78d22495b99ddd9a1c4efff22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a0bb85d78d22495b99ddd9a1c4efff22 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1692533376 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0c22ede4a9de4abc9606e234a210d8a1 Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1692533376-project Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd331e01e-d961-4a8c-9692-09398c935198'} Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:39.345320 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] Returning 404 to user: Instance d331e01e-d961-4a8c-9692-09398c935198 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:39.356645 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b2c9be1-4b31-45f4-86d4-5f27dee7914a tempest-AttachSCSIVolumeTestJSON-1692533376 tempest-AttachSCSIVolumeTestJSON-1692533376-project] 10.222.0.60 "GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198" status: 404 len: 111 microversion: 2.1 time: 0.122021 Aug 25 12:46:39.359862 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1039/1995] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:39 2022] GET /compute/v2.1/servers/d331e01e-d961-4a8c-9692-09398c935198 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:39.499767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:39.500901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:39.501745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:39.502726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lazy-loading 'fault' on Instance uuid cf5e1077-0a3f-47bc-851d-06ca51c48122 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:46:39.904982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49806f7cfdde411093826853cf371e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e55826cfe54661b3f6868941c03c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:39.948319 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-11940ba9-8d22-471d-85eb-57ea1bf5d709 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 200 len: 1308 microversion: 2.1 time: 0.714247 Aug 25 12:46:39.956775 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 957/1996] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:39 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:40.995534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:41.004619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] [instance: cf5e1077-0a3f-47bc-851d-06ca51c48122] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:41.045880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.053190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.062402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.068543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:41.093710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:41.097527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:41.198874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] HTTP exception thrown: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Request method failure captured: Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 HTTP/1.1 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB26XLhtWkTIGymT2PdMVjA6PGRQHCCOFprZb2pBaZYpWIzFOVZdkPuUjuLXBfe2j39Z0Sf7YZA-W6MEDar12aA2Wv1QEFNKFum2qQPSDYjNBcyST3b2vl6fPb0MiGTE31TERowst-ncVLNBst4Pc_brJvZuLKJafjpvJ2V1ZMIkIKAo Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 72e55826cfe54661b3f6868941c03c80 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_72e55826cfe54661b3f6868941c03c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/72e55826cfe54661b3f6868941c03c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 72e55826cfe54661b3f6868941c03c80 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MultipleCreateTestJSON-406763876 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MultipleCreateTestJSON-406763876-project Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49806f7cfdde411093826853cf371e54 Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MultipleCreateTestJSON-406763876-project Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'cf5e1077-0a3f-47bc-851d-06ca51c48122'} Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:46:41.207662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] Returning 404 to user: Instance cf5e1077-0a3f-47bc-851d-06ca51c48122 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:46:41.215907 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d86aecc0-f582-49a4-aa7f-d8c9736992c1 tempest-MultipleCreateTestJSON-406763876 tempest-MultipleCreateTestJSON-406763876-project] 10.222.0.60 "GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122" status: 404 len: 111 microversion: 2.1 time: 0.225947 Aug 25 12:46:41.217179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1040/1997] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:40 2022] GET /compute/v2.1/servers/cf5e1077-0a3f-47bc-851d-06ca51c48122 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:46:44.599950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:44.625980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:44.633394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Searching by: {'deleted': False, 'project_id': '2c520e65f6964fb79c8a415685db20d8'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:44.681854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:44.685638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:44.691193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:44.698236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:44.699311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:44.699983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:44.825195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:45.020905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc13efcf-f234-4c03-a284-50e8bb167336 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.427082 Aug 25 12:46:45.041483 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 958/1998] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:46:44 2022] GET /compute/v2.1/servers => generated 344 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:45.058391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:45.103410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:45.106835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Searching by: {'deleted': False, 'project_id': '2c520e65f6964fb79c8a415685db20d8'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:46:45.142093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.143943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.146178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.151533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:45.153795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:45.157122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:45.701854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:46:46.262058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:46.315395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:46.327841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:46.331691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.196546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1403168-ee28-4fa2-a7f0-fd6bd1ce5999 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 3.154964 Aug 25 12:46:48.199557 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1041/1999] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:46:45 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 3161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:48.274905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-971aa2df-c3a4-448a-a7b2-c94e00dac4d1 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:48.307764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-971aa2df-c3a4-448a-a7b2-c94e00dac4d1 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053580 Aug 25 12:46:48.332181 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 959/2000] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:46:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:46:48.654946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:48.657703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:48.677365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:48.682201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.684768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.691876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.693939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:48.706274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:48.708318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:48.837995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:46:49.139332 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-607b60fb-0108-4887-a8e8-6be279b2e1dc tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 204 len: 0 microversion: 2.1 time: 0.498181 Aug 25 12:46:49.144295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1042/2001] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:46:48 2022] DELETE /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:46:49.166949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:49.168176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:49.197929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:49.218789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.220058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.221291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:49.233728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:49.235185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:49.236167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:50.789667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:50.852247 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6afea337-143a-4caa-b786-15ca4937e6a0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1610 microversion: 2.1 time: 1.703380 Aug 25 12:46:50.861501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 960/2002] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:49 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1610 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:46:51.906006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:51.907386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:51.950013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.953379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.958958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:51.978329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:51.991054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:51.995076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:54.458751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:54.484745 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d3fcd8e-f8ef-474a-a1a4-8c814e615d89 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1610 microversion: 2.1 time: 2.586309 Aug 25 12:46:54.512278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1043/2003] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:51 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1610 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:46:55.558744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:46:55.581534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:46:55.640827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:55.650160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:55.653932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:55.684747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:55.695725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:55.708584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:55.715315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:55.795944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:56.187436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654", "name": "network-vif-unplugged", "status": "completed", "tag": "2d0cf4ba-7af9-42a5-aba9-fb7d1a984494"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:46:56.227950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:56.265044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:46:56.274833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:46:56.275740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:46:56.276641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:46:56.364002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] Creating event network-vif-unplugged:2d0cf4ba-7af9-42a5-aba9-fb7d1a984494 for instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 on n-h1-850468-18 Aug 25 12:46:56.385994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fd20f5ae-f343-417e-87e6-3168a1993422 req-b6592132-8d3f-483f-bb76-919a15cd1cf2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.206821 Aug 25 12:46:56.395552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1044/2004] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:46:59.274529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:46:59.325509 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-54619fb4-bc76-439c-b830-ec940b4d490b tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1610 microversion: 2.1 time: 3.784727 Aug 25 12:46:59.330130 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 961/2005] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:46:55 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1610 bytes in 3790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:00.377498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:00.396864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:00.449366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:00.450395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:00.451323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:00.457039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:00.458366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:00.459680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:01.510555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:01.559432 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-94f3d792-68b2-48d9-873c-dddbe6fb95e7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1542 microversion: 2.1 time: 1.172656 Aug 25 12:47:01.566560 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1045/2006] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:00 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1542 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:02.625031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:02.637151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:02.668727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:02.669802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:02.685094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:02.686842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:02.687925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:02.689088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:03.169659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08d11a66-e86a-4549-a1df-9045136221b8 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6bf3f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2144549627", "description": "tempest-description-2063560155"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:03.406016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:03.437168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd6871b4-3512-40fa-8788-d10f9374fe8c tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1542 microversion: 2.1 time: 0.836400 Aug 25 12:47:03.449518 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1046/2007] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:02 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1542 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:04.443648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654", "name": "network-vif-deleted", "tag": "2d0cf4ba-7af9-42a5-aba9-fb7d1a984494"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:04.531789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:04.533138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:04.533966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:04.618092 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] Creating event network-vif-deleted:2d0cf4ba-7af9-42a5-aba9-fb7d1a984494 for instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 on n-h1-850468-18 Aug 25 12:47:04.647237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0305adea-8606-4e35-991b-fc819810bf09 req-8abfde2e-f2ff-48ff-b629-003fb403237d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210838 Aug 25 12:47:04.649759 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1047/2008] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:04.675953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:04.710517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:04.753413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:04.754642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:04.761797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:04.762870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:04.765233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:04.765999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:05.130766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:05.165611 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c185846b-6631-42d1-8939-83089f53cfb8 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.499115 Aug 25 12:47:05.168303 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1048/2009] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:04 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:05.647056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:06.212249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:06.214745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:06.254027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:06.266617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:06.267804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.269497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:06.274269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:06.275769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:06.683340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08d11a66-e86a-4549-a1df-9045136221b8 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 4.095814 Aug 25 12:47:06.686246 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 962/2010] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 4101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:06.707045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:06.713719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b77d6e9-e115-4467-a3d8-222cc61f4e11 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c06a60>, body: {"security_group_rule": {"parent_group_id": "1e4d89e1-1bf4-4c0e-8ff1-f32856b9e604", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:06.755810 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a420a56-6bd4-48fe-9ab5-aa563c6e7bf0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.545841 Aug 25 12:47:06.792950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1049/2011] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:06 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:07.807659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:07.812756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:07.868800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.886040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.886894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:07.888161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:07.889014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:07.889803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:08.453457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:08.509331 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-973a7fbc-96ec-490b-b123-74801d367868 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.698003 Aug 25 12:47:08.526372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1050/2012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:07 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:09.319994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:09.575612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:09.576902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:09.622602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.628517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.631010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.641323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:09.642701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:09.644100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:09.810298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:10.122767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:10.150477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab213ede-a9d1-4fd0-95df-9d3145720735 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.603179 Aug 25 12:47:10.158229 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1051/2013] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:09 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:11.229649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:11.237384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:11.284677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.298376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.299363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.300564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:11.301462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:11.301944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:11.456276 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b77d6e9-e115-4467-a3d8-222cc61f4e11 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 4.750433 Aug 25 12:47:11.474014 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 963/2014] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 4763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:11.499565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-867c1bdc-2dc3-4f95-afcd-9aa6322cccc4 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6bf35e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1939759204", "description": "tempest-description-58873821"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:11.662417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:11.696760 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2365093d-575c-4b5d-a824-62126f857f55 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.481423 Aug 25 12:47:11.700694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1052/2015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:11 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:12.753173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:12.755853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:12.797236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:12.803431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:12.821016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:12.829225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:12.840456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:12.843744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:13.485233 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-867c1bdc-2dc3-4f95-afcd-9aa6322cccc4 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.005234 Aug 25 12:47:13.486371 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 964/2016] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:11 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:13.512136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a2a5a54-e928-405f-bc45-14c56234365f tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c03160>, body: {"security_group_rule": {"parent_group_id": "46a1eb71-c6d9-48a5-8f68-e0eab751d834", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:13.572027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:13.607163 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89f7a50d-058c-4a8b-b68a-07cb3a5f1cdf tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.857433 Aug 25 12:47:13.612918 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1053/2017] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:12 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:14.689459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:14.693286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:14.720023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.721566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.723779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:14.732370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:14.733267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:14.733970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:15.256424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:15.312555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0fdf4c73-3acd-4039-ad29-6e1523d644d7 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.658544 Aug 25 12:47:15.330036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1054/2018] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:14 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:16.384506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:16.391065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:16.448163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.466366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.480161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:16.482675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:16.485493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:16.486950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:18.635877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a2a5a54-e928-405f-bc45-14c56234365f tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 5.131484 Aug 25 12:47:18.635877 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 965/2019] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:13 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 5136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:47:18.661336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:18.701867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cce27114-3a7f-403b-b17c-77c54d914adb tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c2d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-59224547", "description": "tempest-description-208285194"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:18.712651 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-848295d2-0f7f-4d23-8914-9fac95ec7b7e tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 2.333571 Aug 25 12:47:18.713804 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1055/2020] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:16 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:19.764591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:19.767308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:19.782626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:19.803506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.827001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.828054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:19.835875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:19.837628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:19.838783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:20.214826 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cce27114-3a7f-403b-b17c-77c54d914adb tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.558961 Aug 25 12:47:20.218105 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 966/2021] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:18 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:20.276377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-925a0a65-1843-432a-86e9-61e7ed5c318c tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c0e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1792022760", "description": "tempest-description-456569322"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:20.571856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:20.610319 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e74ab939-071b-43c3-b6a0-aa5051517bbd tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.859043 Aug 25 12:47:20.617046 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1056/2022] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:19 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:21.657806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:21.663750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:21.692383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.693651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.694829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:21.703896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:21.705486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:21.706182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:22.059146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:22.126604 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b490e848-c87b-44d3-a991-88ae76ca3b69 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.476866 Aug 25 12:47:22.152171 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1057/2023] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:21 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:22.776840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-925a0a65-1843-432a-86e9-61e7ed5c318c tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.540330 Aug 25 12:47:22.778894 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 967/2024] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:47:22.805848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc6eca50-e1cc-4927-aa43-89de252f40f0 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c0be50>, body: {"security_group_rule": {"parent_group_id": "7638df37-8445-44ee-ab49-73eb588c4343", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3d11909e-d80a-4e50-9317-028aa36ace81"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:23.192990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:23.194259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:23.215246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:23.216108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:23.227819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:23.229315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:23.230239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:23.231385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:24.007722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:24.048744 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb636c45-03b1-44fb-88cb-87f9f137ae0f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.877465 Aug 25 12:47:24.054242 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 968/2025] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:23 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:25.108646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:25.109918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:25.167050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:25.168093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:25.168805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:25.170212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:25.171090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:25.171912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:25.595238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:25.627427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72aa0dfb-96f2-4621-9c5f-e4554698ac17 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.535181 Aug 25 12:47:25.638553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 969/2026] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:25 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:26.701814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:26.707031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:26.771591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:26.777136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:26.783969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:26.789472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:26.798736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:26.803285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:27.254872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c530eca6b6141eb81c0b0f2ddfbc925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c520e65f6964fb79c8a415685db20d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:27.326400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5df6e35-1df0-448b-baa1-628795f1f80f tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 200 len: 1253 microversion: 2.1 time: 0.647516 Aug 25 12:47:27.364733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 970/2027] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:26 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 1253 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:28.375146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:28.376396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] [instance: 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:28.394620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:28.396028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:28.398913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:28.402258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:28.405412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:28.407286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:28.474928 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] HTTP exception thrown: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Request method failure captured: Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 HTTP/1.1 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB25qs3OydBhcvCtRjzI_dHw8BO3ednlJrb3XbytAmWZlzY6C8tmKicx7h84nNmo4-8A84fHn-w0U_YjrPcUlbCZDlP3SJROrTbqLKe7Gjj6eIN_OoYdaI4TPc_U46KERqtgSiFtUFrUGZflT2BM20eePMypdIVvY2ye5CA-djHaZKUI Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2c520e65f6964fb79c8a415685db20d8 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestBootFromVolume-1872385869 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c520e65f6964fb79c8a415685db20d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c520e65f6964fb79c8a415685db20d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c520e65f6964fb79c8a415685db20d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c520e65f6964fb79c8a415685db20d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestBootFromVolume-1872385869 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2c520e65f6964fb79c8a415685db20d8 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1872385869 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestBootFromVolume-1872385869-project Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2c530eca6b6141eb81c0b0f2ddfbc925 Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestBootFromVolume-1872385869-project Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654'} Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:47:28.486052 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. Aug 25 12:47:28.496835 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:47:28.504007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Returning 404 to user: Instance 2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:47:28.512088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a52361ae-0a73-4143-a08e-987120d574a3 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654" status: 404 len: 111 microversion: 2.1 time: 0.149989 Aug 25 12:47:28.523251 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 971/2028] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:28 2022] GET /compute/v2.1/servers/2dee72e7-55b8-4cbb-ab2c-a7e1f0ed5654 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:47:28.547403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc6eca50-e1cc-4927-aa43-89de252f40f0 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 5.750087 Aug 25 12:47:28.548513 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1058/2029] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:22 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 5753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:28.558077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66177951-9e52-460e-b4a6-0d7bafb60ee0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] Calling method '.version_select at 0x7fc6c26f2a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:28.586311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50890e9a-2395-4fae-b295-d1fff8163936 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c0bc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-833972792", "description": "tempest-description-769867671"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:28.700837 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66177951-9e52-460e-b4a6-0d7bafb60ee0 tempest-ServersTestBootFromVolume-1872385869 tempest-ServersTestBootFromVolume-1872385869-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629960193" status: 202 len: 0 microversion: 2.1 time: 0.164717 Aug 25 12:47:28.705942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 972/2030] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629960193 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:47:30.187348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50890e9a-2395-4fae-b295-d1fff8163936 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.616392 Aug 25 12:47:30.189497 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1059/2031] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:28 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:30.208442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fa8d9a8-d3ec-40d9-bfd5-44ce5d8004c9 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6be5dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1483720489", "description": "tempest-description-1444975931"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:30.760406 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fa8d9a8-d3ec-40d9-bfd5-44ce5d8004c9 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.557411 Aug 25 12:47:30.762076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 973/2032] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:30.793740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a2609ac-c486-4c92-9151-e14eb0496ee2 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6ad8a60>, body: {"security_group_rule": {"parent_group_id": "615539e7-1ed0-4056-8729-730a2924961f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9611cf42-f680-4eee-866e-3e51d30c445a"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:31.691776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:32.077284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=41 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:36.657534 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a2609ac-c486-4c92-9151-e14eb0496ee2 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 5.876690 Aug 25 12:47:36.670950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1060/2033] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 5881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:36.688040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74071497-213c-421e-ad97-1bf8442fba6d tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6aeb940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:36.929373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4525665d-e6a8-445d-94de-ef6ba8b13304 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Action: 'create', calling method: .version_select at 0x7fc6c6c789d0>, body: {"keypair": {"name": "tempest-keypair-1889369850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPW7Y5MzB3SJ9bA1i1m72aWghxPQP0Rz1iPuDzWQQRsZ5lf3U8wTh9SIIqSRClx72MWgSwBkT7CbEVVQfBQxyIob4a219Oj6Kdl/ByE5PvxTawwSMiSgJb/Cl2gw8JZw=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:37.093821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4525665d-e6a8-445d-94de-ef6ba8b13304 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for project 6b509f3206954ae0afaf3840a9be18fd. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:37.128564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4525665d-e6a8-445d-94de-ef6ba8b13304 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for user 90aadf25819f4122aa608e27f95d4f0e and project 6b509f3206954ae0afaf3840a9be18fd. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:37.287076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4525665d-e6a8-445d-94de-ef6ba8b13304 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.224811 Aug 25 12:47:37.301498 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 974/2034] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:47:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:39.984875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74071497-213c-421e-ad97-1bf8442fba6d tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9611cf42-f680-4eee-866e-3e51d30c445a" status: 202 len: 0 microversion: 2.1 time: 3.311573 Aug 25 12:47:39.988230 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1061/2035] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:47:36 2022] DELETE /compute/v2.1/os-security-groups/9611cf42-f680-4eee-866e-3e51d30c445a => generated 0 bytes in 3317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:47:39.998800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=20 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:40.018492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30181e1f-59d1-49ca-a010-d19face6604d tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6c170d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:41.117431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1589918199", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1b190f40-d315-44fa-af57-e579f81ef520"}], "block_device_mapping_v2": [{"uuid": "e3c72c18-322e-4be0-aaf9-64ed6a9caac8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:41.376462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30181e1f-59d1-49ca-a010-d19face6604d tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/615539e7-1ed0-4056-8729-730a2924961f" status: 200 len: 246 microversion: 2.1 time: 1.380395 Aug 25 12:47:41.377640 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 975/2036] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:47:39 2022] GET /compute/v2.1/os-security-groups/615539e7-1ed0-4056-8729-730a2924961f => generated 246 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:41.409765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40253621-415d-448e-9c80-9c776dc8c780 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c3400d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-29637075", "description": "tempest-description-679670148"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:41.576202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] validate_networks() for [('1b190f40-d315-44fa-af57-e579f81ef520', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:45.156223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40253621-415d-448e-9c80-9c776dc8c780 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 3.756377 Aug 25 12:47:45.166053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 976/2037] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:47:41 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 3768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:47:45.212283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f576452b-23a9-40bf-987a-afcf1bb875f1 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c470d0>, body: {"security_group_rule": {"parent_group_id": "3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:46.573236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:47:46.574065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:47:46.574977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:47:46.580250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:47:46.580250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:47:46.622027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:46.628402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:46.630500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:46.635928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:46.639038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:46.639932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:46.721692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:46.741449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Getting quotas for user c6be50aac19c400cb9883fcf881ad13c and project 6fc96e94ab95423d81077cf6af360715. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:46.905841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:47:46.913342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3c72c18-322e-4be0-aaf9-64ed6a9caac8',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:47:47.193110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:47.242425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:47:47.357230 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0ae0040-18df-4551-bdc8-2bf160d0d853 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.251347 Aug 25 12:47:47.358382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1062/2038] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 6261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:47:47.386658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b84235c-b8cd-4811-9bc6-6a13675dc152 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:47.402164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b84235c-b8cd-4811-9bc6-6a13675dc152 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:47.475148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f576452b-23a9-40bf-987a-afcf1bb875f1 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.284160 Aug 25 12:47:47.490507 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 977/2039] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:47.512856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c359c678-d461-4b0b-9f27-9fec9eacc3ab tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Action: 'create', calling method: .version_select at 0x7fc6c6c10700>, body: {"security_group_rule": {"parent_group_id": "3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:48.004799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b84235c-b8cd-4811-9bc6-6a13675dc152 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:48.044706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b84235c-b8cd-4811-9bc6-6a13675dc152 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1053 microversion: 2.1 time: 0.660780 Aug 25 12:47:48.046739 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1063/2040] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:47 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1053 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:49.092674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e38c4de8-5c50-4ade-b686-c33f017b04b1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:49.099077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e38c4de8-5c50-4ade-b686-c33f017b04b1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:50.108316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e38c4de8-5c50-4ade-b686-c33f017b04b1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:50.194523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e38c4de8-5c50-4ade-b686-c33f017b04b1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1053 microversion: 2.1 time: 1.092337 Aug 25 12:47:50.217184 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1064/2041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:49 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1053 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:47:50.693603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3515e61a-2d7e-4ca8-9e0e-e9be689026e0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Action: 'create', calling method: .version_select at 0x7fc6c6afa5e0>, body: {"keypair": {"name": "tempest-keypair-1306692658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC61FUNcm5gEMPphRCblWYQU8IyzSWmNAap3irwnN/oQOlDMm8YUHwIA2cqZktGY+ILOzemaICI4NjL7g4UFg2aHDFVsYSfngrtUUELRgSKVftvAGn/PGf06uxiL8o8XQg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:50.761876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3515e61a-2d7e-4ca8-9e0e-e9be689026e0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Getting quotas for project 99e3ca8e316045648a29e1afb1b5669f. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:47:50.812957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3515e61a-2d7e-4ca8-9e0e-e9be689026e0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Getting quotas for user 9c773e3e9245464488269535790003b2 and project 99e3ca8e316045648a29e1afb1b5669f. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:47:50.900510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c359c678-d461-4b0b-9f27-9fec9eacc3ab tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 3.402365 Aug 25 12:47:50.901986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 978/2042] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 12:47:47 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 3408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:50.941921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be3bcc37-4070-4b99-a9af-df0ddd56a67e tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6c10a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:51.007585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3515e61a-2d7e-4ca8-9e0e-e9be689026e0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.324527 Aug 25 12:47:51.009752 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1065/2043] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:47:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:47:51.235973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:51.252818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:51.306786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:51.307822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:51.309033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:51.310756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:51.320913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:51.322433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:51.974497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:52.005485 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-78407830-7a37-408c-840c-bbb9c1c8b3bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1159 microversion: 2.1 time: 0.776813 Aug 25 12:47:52.016616 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1066/2044] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:51 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1159 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:52.281762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be3bcc37-4070-4b99-a9af-df0ddd56a67e tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3" status: 200 len: 662 microversion: 2.1 time: 1.349054 Aug 25 12:47:52.284519 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 979/2045] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:47:50 2022] GET /compute/v2.1/os-security-groups/3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3 => generated 662 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:47:52.310793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-114ecaab-da8d-4bfb-8dd0-0e34be4aa2e3 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c25a7e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:52.583167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1149741257", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "f1c15ed0-255a-4b0c-b3c2-cd18629dad58"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:47:52.881212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] validate_networks() for [('f1c15ed0-255a-4b0c-b3c2-cd18629dad58', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:47:54.853084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-114ecaab-da8d-4bfb-8dd0-0e34be4aa2e3 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/f4e4d485-281e-4b1b-a907-f576962d3fdb" status: 202 len: 0 microversion: 2.1 time: 2.548444 Aug 25 12:47:54.853629 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 980/2046] 10.222.0.60 () {58 vars in 1287 bytes} [Thu Aug 25 12:47:52 2022] DELETE /compute/v2.1/os-security-group-rules/f4e4d485-281e-4b1b-a907-f576962d3fdb => generated 0 bytes in 2551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:47:54.882120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:54.891349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:47:54.931490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:54.939509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:54.940660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:54.941993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:47:54.953342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:47:54.954923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:47:55.540840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:47:55.573214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-868e8b9c-b4e7-4de0-becb-f5352a4ec7de tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1169 microversion: 2.1 time: 0.717086 Aug 25 12:47:55.578625 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 981/2047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:47:54 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1169 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:47:55.598896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ff32ad77-dfaf-4a21-8fc1-bd894563cc05 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c2fd3280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:47:56.678965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:00.712806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:48:00.713857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:48:00.714645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:48:00.715372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:48:00.716134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:48:00.763899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.766085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.767805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.779641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:00.781407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:00.782702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:00.830447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Getting quotas for project de962fa126704e3c89463f1c49b14d99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:00.850004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Getting quotas for user ccef3f322e944e68a2795af799aab8da and project de962fa126704e3c89463f1c49b14d99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:00.886681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:48:00.891836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:48:01.045441 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d0d78fd3-c54f-40d1-aa7a-24b6a3e54b33 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.025023 Aug 25 12:48:01.047172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1067/2048] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 9030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:48:01.058966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:01.061424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:01.076484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.078111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.079288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.081409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:01.082665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:01.083852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:01.936592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ff32ad77-dfaf-4a21-8fc1-bd894563cc05 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3" status: 202 len: 0 microversion: 2.1 time: 6.355645 Aug 25 12:48:01.937891 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 982/2049] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:47:55 2022] DELETE /compute/v2.1/os-security-groups/3b1cf4c8-ad8c-4ab9-b552-6d0aa34f93e3 => generated 0 bytes in 6359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:01.953627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-389738417", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "685a2e8a-c053-4df3-9ce6-c09789095d7d"}], "security_groups": [{"name": "tempest-securitygroup--880566862"}], "key_name": "tempest-keypair-1889369850", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:02.749555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] validate_networks() for [('685a2e8a-c053-4df3-9ce6-c09789095d7d', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:48:03.089013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:03.161438 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-379e5073-4578-4395-b6a9-8ea853d066c2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1211 microversion: 2.1 time: 2.111872 Aug 25 12:48:03.202292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1068/2050] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:01 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1211 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:03.216863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6faf4379-865e-47c3-998f-81a00bda263f tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:03.224196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6faf4379-865e-47c3-998f-81a00bda263f tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:03.233199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:03.789838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6faf4379-865e-47c3-998f-81a00bda263f tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:03.824529 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6faf4379-865e-47c3-998f-81a00bda263f tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1225 microversion: 2.1 time: 0.619797 Aug 25 12:48:03.830822 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1069/2051] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:03 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1225 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:03.848709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6b32d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:04.064680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:48:04.066428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Neutron security group 9611cf42-f680-4eee-866e-3e51d30c445a not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:48:04.067782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] HTTP exception thrown: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.067782 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Request method failure captured: Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/9611cf42-f680-4eee-866e-3e51d30c445a HTTP/1.1 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB29GFpC9vCzUE6XzyokpBhCHjv5QfQ5ILFiid3-3q189WHq9BAoiiVOhwioBtPpjmNCHrTPvCrT64Hegci8Z34M8YciLEQGlIae5-9_sf3eV6uznByarcEub5n2B1h3w-UuP7mOkZllx13MtjABYb2xcqxQM8jhMObvSSdVDY3fFn8I Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ad2cd10fda054bd6b0f56a20bafb0e07 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-397473624 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ad2cd10fda054bd6b0f56a20bafb0e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ad2cd10fda054bd6b0f56a20bafb0e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad2cd10fda054bd6b0f56a20bafb0e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ad2cd10fda054bd6b0f56a20bafb0e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesTestJSON-397473624 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ad2cd10fda054bd6b0f56a20bafb0e07 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-397473624 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesTestJSON-397473624-project Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: a9b44c9c72c84beea729e7e2b9b382eb Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesTestJSON-397473624-project Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9611cf42-f680-4eee-866e-3e51d30c445a'} Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:48:04.075057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] Aug 25 12:48:04.082876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:04.091817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Returning 404 to user: Security group 9611cf42-f680-4eee-866e-3e51d30c445a does not exist Aug 25 12:48:04.091817 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-a37f2c43-d9cd-4d14-bc2c-b3172768bc41'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:04.091817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a97430e-fb74-46df-a6ff-5496353d57f6 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/9611cf42-f680-4eee-866e-3e51d30c445a" status: 404 len: 194 microversion: 2.1 time: 0.253560 Aug 25 12:48:04.115967 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1070/2052] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:03 2022] DELETE /compute/v2.1/os-security-groups/9611cf42-f680-4eee-866e-3e51d30c445a => generated 194 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:48:04.702855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25e29032-6e4c-4413-bf8f-d378aefad474 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:04.741545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25e29032-6e4c-4413-bf8f-d378aefad474 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.623337 Aug 25 12:48:04.748762 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1071/2053] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:04.771340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-098d7cbf-c794-40c2-948a-d14b7414aa35 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6b79310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:05.555460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:07.150875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for project 6b509f3206954ae0afaf3840a9be18fd. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:07.190721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for user 90aadf25819f4122aa608e27f95d4f0e and project 6b509f3206954ae0afaf3840a9be18fd. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:07.247239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:48:07.257243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:48:07.268194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:48:07.269321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:48:07.270544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:48:07.291563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.293013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.294204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.296101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.297484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.298643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.353141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for project 6b509f3206954ae0afaf3840a9be18fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:07.370942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Getting quotas for user 90aadf25819f4122aa608e27f95d4f0e and project 6b509f3206954ae0afaf3840a9be18fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:07.463137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:48:07.469421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:48:07.722407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-06f876db-4e85-4e90-9f2e-432dd3d9a05e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.781996 Aug 25 12:48:07.728022 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 983/2054] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 5789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:48:07.763880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:07.769434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:07.810423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.820639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.823533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:07.825202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:07.827668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:07.830179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.132833 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-098d7cbf-c794-40c2-948a-d14b7414aa35 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/615539e7-1ed0-4056-8729-730a2924961f" status: 202 len: 0 microversion: 2.1 time: 3.374248 Aug 25 12:48:08.134957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1072/2055] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:04 2022] DELETE /compute/v2.1/os-security-groups/615539e7-1ed0-4056-8729-730a2924961f => generated 0 bytes in 3385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:08.199856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6f39271-d2e7-492c-bc06-5a41598d1df4 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.272477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6f39271-d2e7-492c-bc06-5a41598d1df4 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.126525 Aug 25 12:48:08.278131 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1073/2056] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.303527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:08.306156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:08.319357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.320448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.321861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.323425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.324627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.341661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.560158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:08.611065 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23671f68-7fd8-45a2-913a-8f1ffabf5ecc tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1283 microversion: 2.1 time: 0.324065 Aug 25 12:48:08.616926 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1074/2057] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:08 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.831988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Action: 'create', calling method: .version_select at 0x7fc6c6b0df70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:08.840871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:08.870231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6d9a79b-3a9b-4201-8c7b-06c4b82220d4 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1211 microversion: 2.1 time: 1.138069 Aug 25 12:48:08.892996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 984/2058] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:07 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1211 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:08.907557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4dde21b-ecd1-4419-8dfb-7da86c488f62", "tag": "8b7d2001-4e3b-46cf-8cea-d27d16a4723a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:08.930456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:08.931306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:08.932051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:08.951421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Getting quotas for project 70d32f55262747a381a665767f7e9a5a. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:08.995952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Getting quotas for user ac8819e0fce24c45aac1f8d1a06ea3d8 and project 70d32f55262747a381a665767f7e9a5a. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:09.008981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] Creating event network-changed:8b7d2001-4e3b-46cf-8cea-d27d16a4723a for instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 on n-h1-850468-18 Aug 25 12:48:09.060983 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a4c1631e-2046-4b2d-a577-2bf20bb35cca req-8e7f300b-5c0a-4707-9776-67d5d593f083 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165042 Aug 25 12:48:09.069053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 985/2059] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:09.115360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-989e0596-6466-40a5-85ca-651caf570012 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:09.118797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-989e0596-6466-40a5-85ca-651caf570012 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:09.232928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Getting quotas for project 70d32f55262747a381a665767f7e9a5a. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:09.280438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Getting quotas for user ac8819e0fce24c45aac1f8d1a06ea3d8 and project 70d32f55262747a381a665767f7e9a5a. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:09.325151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a99e8ed4-0eae-4406-ae3b-e32299086ef5 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.702372 Aug 25 12:48:09.337938 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1075/2060] 10.222.0.60 () {62 vars in 1214 bytes} [Thu Aug 25 12:48:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:09.348094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-940393995", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f00ec211-d46a-4824-90ce-f7e540b19817"}, {"port": "86ad8493-c37f-44ec-b0f6-8fccbbc756cd", "tag": "port-1"}, {"port": "3d99ee29-74a8-4303-a784-e96e221ba3f3", "tag": "port-2"}, {"uuid": "a70bf8d0-2bc5-4c25-ac25-6d01572d484e", "tag": "net-1"}, {"uuid": "a70bf8d0-2bc5-4c25-ac25-6d01572d484e"}, {"uuid": "f24cc252-c875-4e00-9121-e4a4b05c5189", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f24cc252-c875-4e00-9121-e4a4b05c5189", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "960ef31c-0ade-4df1-a8b4-721be0b9263d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "dcf85f64-9697-4dd9-9d98-4ac35c99c5d7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "670bf22b-c027-417f-8190-24df7675ea2c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1441446413"}], "key_name": "tempest-keypair-1306692658", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:09.891174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-989e0596-6466-40a5-85ca-651caf570012 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:09.925253 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-989e0596-6466-40a5-85ca-651caf570012 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1269 microversion: 2.1 time: 0.842864 Aug 25 12:48:09.941601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 986/2061] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:09 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1269 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:09.962829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aafa008b-8e03-46e6-9f1d-cf75d8809a88 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6baba60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:10.454826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] validate_networks() for [('f00ec211-d46a-4824-90ce-f7e540b19817', None, None, None, None, None), (None, None, '86ad8493-c37f-44ec-b0f6-8fccbbc756cd', None, None, None), (None, None, '3d99ee29-74a8-4303-a784-e96e221ba3f3', None, None, None), ('a70bf8d0-2bc5-4c25-ac25-6d01572d484e', None, None, None, None, None), ('a70bf8d0-2bc5-4c25-ac25-6d01572d484e', None, None, None, None, None), ('f24cc252-c875-4e00-9121-e4a4b05c5189', '10.2.2.100', None, None, None, None), ('f24cc252-c875-4e00-9121-e4a4b05c5189', '10.2.2.200', None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:48:10.808845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:11.756786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aafa008b-8e03-46e6-9f1d-cf75d8809a88 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3d11909e-d80a-4e50-9317-028aa36ace81" status: 202 len: 0 microversion: 2.1 time: 1.812768 Aug 25 12:48:11.758955 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 987/2062] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:09 2022] DELETE /compute/v2.1/os-security-groups/3d11909e-d80a-4e50-9317-028aa36ace81 => generated 0 bytes in 1816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:11.777189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0db7d463-c92d-4bbe-bd83-18040541b591 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:11.824607 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0db7d463-c92d-4bbe-bd83-18040541b591 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061429 Aug 25 12:48:11.828416 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 988/2063] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:11.857760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-67bf0516-7b5f-4c11-81cd-f340958d6e9e tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:11.926418 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-67bf0516-7b5f-4c11-81cd-f340958d6e9e tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.092680 Aug 25 12:48:11.929587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 989/2064] 10.222.0.60 () {60 vars in 1193 bytes} [Thu Aug 25 12:48:11 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:11.965033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:11.965033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:11.981345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:11.982246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:11.983481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:11.986060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:11.986897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:11.987728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:14.341111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:14.366786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0fa8d654-9ddb-4713-ad17-5b9a4a58d0fa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 2.422536 Aug 25 12:48:14.384315 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 990/2065] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:11 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 2454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:14.408716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:14.410059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:14.426653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:14.427582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:14.429482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:14.431240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:14.432464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:14.433864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:15.421392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:15.457074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f8a2ae4-ad5c-47a4-9e91-6f8b6976f0a9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 1.070590 Aug 25 12:48:15.468945 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 991/2066] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:14 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:15.496190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:15.497956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:15.513879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:15.515245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:15.522201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:15.525203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:15.526541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:15.527739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:16.376396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:16.402598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6316f33d-cf61-4b83-8957-627f09cae72b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1394 microversion: 2.1 time: 0.929713 Aug 25 12:48:16.404422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 992/2067] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:15 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1394 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:16.415319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3037e106-3843-425e-8c63-5dae4ef77958 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6bf3550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:17.324430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:17.419545 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3037e106-3843-425e-8c63-5dae4ef77958 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7638df37-8445-44ee-ab49-73eb588c4343" status: 202 len: 0 microversion: 2.1 time: 1.010592 Aug 25 12:48:17.421557 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 993/2068] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:16 2022] DELETE /compute/v2.1/os-security-groups/7638df37-8445-44ee-ab49-73eb588c4343 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:17.437021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd0676af-635a-4567-a860-1ce02a53dc9f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:17.442702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:17.462139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd0676af-635a-4567-a860-1ce02a53dc9f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038516 Aug 25 12:48:17.463047 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 994/2069] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:17.472797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-67546109-9b7e-4284-a3d5-fe86b739f8d3 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:17.492649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-67546109-9b7e-4284-a3d5-fe86b739f8d3 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2" status: 200 len: 235 microversion: 2.64 time: 0.026777 Aug 25 12:48:17.493440 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 995/2070] 10.222.0.60 () {60 vars in 1304 bytes} [Thu Aug 25 12:48:17 2022] GET /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2 => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:48:17.790233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52f349ee-19cb-4171-a29f-f86cef4d9647 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-211561855", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:17.796864 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-52f349ee-19cb-4171-a29f-f86cef4d9647 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] HTTP exception thrown: min_count must be <= max_count Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52f349ee-19cb-4171-a29f-f86cef4d9647 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Request method failure captured: Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 183 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2-N1ETfZnOn1ffRk1Sd_kISjU1CbHaMwCUtemMVuJ63AQ1A8L3ZL0q2I_1Y3-6jrIr-S43Mo3EMkuaAbAwTSTFFSSfLt904mEyabPaeVqd9r49HAaTz8b1ZUwaEkio6Bv_nUVm0F0PyTqnW8D_YHrQ4jT3-lsDnEd9jxg8IFJco1QE Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 787651e9b1114e29bcb07f30cafd79c9 Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-211561855", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: exception: min_count must be <= max_count Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-211561855', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 25 12:48:17.800269 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:17.810462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52f349ee-19cb-4171-a29f-f86cef4d9647 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Returning 400 to user: min_count must be <= max_count {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:17.812266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52f349ee-19cb-4171-a29f-f86cef4d9647 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.316040 Aug 25 12:48:17.813765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 996/2071] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:17 2022] POST /compute/v2.1/servers => generated 74 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 12:48:17.822686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:17.825642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:17.840295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:17.841794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:17.844138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:17.846074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:17.847364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:17.848614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:18.471860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:18.493629 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-06cb473d-bd49-4608-97f2-5b3db3ded96d tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 0.677224 Aug 25 12:48:18.494583 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 997/2072] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:17 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:18.578216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=22 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:18.645652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d6d48d-9bd4-46b0-9689-916a70914cf4", "tag": "5847446a-0bc3-4bb4-984c-6ab3571ec543"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:18.681704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:18.682384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:18.690124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:18.707238 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] Creating event network-changed:5847446a-0bc3-4bb4-984c-6ab3571ec543 for instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 on n-h1-850468-18 Aug 25 12:48:18.716291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-82d67d3b-b6e3-489a-af6f-0400049b99c9 req-9f513548-a1e5-4bec-977c-49197911c542 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218797 Aug 25 12:48:18.717589 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 998/2073] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:18.732673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:18.734333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:18.748000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:18.748951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:18.749808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:18.751228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:18.752098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:18.752958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:19.170702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:19.187967 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3166e3dd-f9d7-4697-be51-76af57b0aa20 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 0.465379 Aug 25 12:48:19.188998 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 999/2074] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:18 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:19.206736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171debfd-bc35-489c-b9d2-9872472f5f0b", "tag": "90795744-ff98-40da-8cce-e53ff3794b37"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:19.228255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:19.229371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:19.230765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:19.259169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] Creating event network-changed:90795744-ff98-40da-8cce-e53ff3794b37 for instance 171debfd-bc35-489c-b9d2-9872472f5f0b on n-h2-850468-18 Aug 25 12:48:19.269267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3defa022-8b45-4824-82f8-62532d27b58d req-774a7c5a-4195-4bc8-a44c-d50ad3a0c73d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078124 Aug 25 12:48:19.270775 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1000/2075] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:19.281563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88778271-044b-42dd-b51b-f2bdad8a26c2 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6c10670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:19.309085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:19.918871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:20.076826 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88778271-044b-42dd-b51b-f2bdad8a26c2 tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/46a1eb71-c6d9-48a5-8f68-e0eab751d834" status: 202 len: 0 microversion: 2.1 time: 0.802850 Aug 25 12:48:20.078231 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1001/2076] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:19 2022] DELETE /compute/v2.1/os-security-groups/46a1eb71-c6d9-48a5-8f68-e0eab751d834 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:20.088302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:20.089746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:20.111049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:20.112329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:20.113177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:20.114563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:20.116016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:20.117446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.154572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:21.182294 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae30a157-0b59-4c9f-97b2-cca90dc53d76 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1394 microversion: 2.1 time: 1.095214 Aug 25 12:48:21.190363 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1002/2077] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:20 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1394 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:21.203435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-164e9b75-2159-4130-885e-41f12bc97b2f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.265419 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-164e9b75-2159-4130-885e-41f12bc97b2f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.072516 Aug 25 12:48:21.266950 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1003/2078] 10.222.0.60 () {58 vars in 1165 bytes} [Thu Aug 25 12:48:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:21.281847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4012f4c4-a33d-4248-9f7b-e7cb0fe6c327 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.347840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4012f4c4-a33d-4248-9f7b-e7cb0fe6c327 tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2" status: 204 len: 0 microversion: 2.64 time: 0.072772 Aug 25 12:48:21.357814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1004/2079] 10.222.0.60 () {60 vars in 1307 bytes} [Thu Aug 25 12:48:21 2022] DELETE /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:48:21.367687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96357162-1355-466d-8da4-ab31e4c2cb87 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1292357409", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "max_count": 0}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96357162-1355-466d-8da4-ab31e4c2cb87 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Request method failure captured: Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 168 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2-N1ETfZnOn1ffRk1Sd_kISjU1CbHaMwCUtemMVuJ63AQ1A8L3ZL0q2I_1Y3-6jrIr-S43Mo3EMkuaAbAwTSTFFSSfLt904mEyabPaeVqd9r49HAaTz8b1ZUwaEkio6Bv_nUVm0F0PyTqnW8D_YHrQ4jT3-lsDnEd9jxg8IFJco1QE Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 787651e9b1114e29bcb07f30cafd79c9 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1292357409", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "max_count": 0}} Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1292357409', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'max_count': 0}}} Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 0 Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:48:21.375995 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-96357162-1355-466d-8da4-ab31e4c2cb87 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:21.387125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-96357162-1355-466d-8da4-ab31e4c2cb87 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028199 Aug 25 12:48:21.394164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1005/2080] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:21.409808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.412594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:21.429031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.430174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.432734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.434465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.435461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.436335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.504331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:48:21.508026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:48:21.509629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:48:21.511898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:48:21.513488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:48:21.542296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.546401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.547419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.549895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:21.550709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:21.551325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:21.592544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Getting quotas for project 99e3ca8e316045648a29e1afb1b5669f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:21.605312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Getting quotas for user 9c773e3e9245464488269535790003b2 and project 99e3ca8e316045648a29e1afb1b5669f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:21.918503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:21.935905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d7902b0-93eb-4da4-8446-a2199de17588 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 0.541384 Aug 25 12:48:21.937347 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1006/2081] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:21 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:21.948801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36c92443-e51b-4459-8b16-5a24c870a2cd tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] Calling method '.version_select at 0x7fc6c6c06820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:21.966891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:48:21.973779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='960ef31c-0ade-4df1-a8b4-721be0b9263d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='dcf85f64-9697-4dd9-9d98-4ac35c99c5d7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='670bf22b-c027-417f-8190-24df7675ea2c',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:48:22.434184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36c92443-e51b-4459-8b16-5a24c870a2cd tempest-SecurityGroupRulesTestJSON-397473624 tempest-SecurityGroupRulesTestJSON-397473624-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/1e4d89e1-1bf4-4c0e-8ff1-f32856b9e604" status: 202 len: 0 microversion: 2.1 time: 0.493384 Aug 25 12:48:22.437481 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1007/2082] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:48:21 2022] DELETE /compute/v2.1/os-security-groups/1e4d89e1-1bf4-4c0e-8ff1-f32856b9e604 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:22.451787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.455178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:22.472310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.476478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.477636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.479146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.480531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.481670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.791300 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-19d9f488-f5e1-41e2-b566-e515f53e02b9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 13.451146 Aug 25 12:48:22.803421 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1076/2083] 10.222.0.60 () {62 vars in 1189 bytes} [Thu Aug 25 12:48:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 13464 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:48:22.813812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9a28f9a-2283-41f6-9742-fbe6df4d126a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.831990 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9a28f9a-2283-41f6-9742-fbe6df4d126a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026410 Aug 25 12:48:22.833648 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1077/2084] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:22.858265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fdc1edf9-c7c7-47d8-abdf-191d6901108a tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.873096 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fdc1edf9-c7c7-47d8-abdf-191d6901108a tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] HTTP exception thrown: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fdc1edf9-c7c7-47d8-abdf-191d6901108a tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Request method failure captured: Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2 HTTP/1.1 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2-Fd0R3MsQ3Zpn069K4ddUJies6dtlT365Bd9LeaJs5CHuauUbchbHcWjTe1R74qtmaJ4w1ihdRHWO2pQBL4gHSN7r2B-78vrXD39H8nwyXvCDWYiVNul83mCb8nTm8R9gqiNxF7Z49nwQhynx7UCi3ndNBtbugThF8rdQ_6SIU2sk Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.64 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 70d32f55262747a381a665767f7e9a5a Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerGroup264TestJSON-201721353 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_70d32f55262747a381a665767f7e9a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/70d32f55262747a381a665767f7e9a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70d32f55262747a381a665767f7e9a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/70d32f55262747a381a665767f7e9a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerGroup264TestJSON-201721353 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 70d32f55262747a381a665767f7e9a5a Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerGroup264TestJSON-201721353 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerGroup264TestJSON-201721353-project Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ac8819e0fce24c45aac1f8d1a06ea3d8 Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerGroup264TestJSON-201721353-project Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6ab22043-7b1e-40c5-b9cb-98dafd9906f2'} Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.883862 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fdc1edf9-c7c7-47d8-abdf-191d6901108a tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] Returning 404 to user: Instance group 6ab22043-7b1e-40c5-b9cb-98dafd9906f2 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fdc1edf9-c7c7-47d8-abdf-191d6901108a tempest-ServerGroup264TestJSON-201721353 tempest-ServerGroup264TestJSON-201721353-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2" status: 404 len: 117 microversion: 2.64 time: 0.047854 Aug 25 12:48:22.891284 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1078/2085] 10.222.0.60 () {60 vars in 1307 bytes} [Thu Aug 25 12:48:22 2022] DELETE /compute/v2.1/os-server-groups/6ab22043-7b1e-40c5-b9cb-98dafd9906f2 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:22.905775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba5146b7-880e-4316-9ae4-c996ec7b9ae5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-729665822", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "max_count": 2.5}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba5146b7-880e-4316-9ae4-c996ec7b9ae5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Request method failure captured: Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 169 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2-N1ETfZnOn1ffRk1Sd_kISjU1CbHaMwCUtemMVuJ63AQ1A8L3ZL0q2I_1Y3-6jrIr-S43Mo3EMkuaAbAwTSTFFSSfLt904mEyabPaeVqd9r49HAaTz8b1ZUwaEkio6Bv_nUVm0F0PyTqnW8D_YHrQ4jT3-lsDnEd9jxg8IFJco1QE Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 787651e9b1114e29bcb07f30cafd79c9 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-729665822", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "max_count": 2.5}} Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-729665822', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'max_count': 2.5}}} Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 2.5 Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:48:22.916041 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba5146b7-880e-4316-9ae4-c996ec7b9ae5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba5146b7-880e-4316-9ae4-c996ec7b9ae5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023445 Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1079/2086] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:22.939314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:22.952677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.953618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.954618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:22.956495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:22.958292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:22.959334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.428521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.467779 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3133720-75c8-41fb-a383-77d13b31b322 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 1.027957 Aug 25 12:48:23.472235 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1008/2087] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:22 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:23.487874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:23.497634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:23.645686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.665860 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e4d4330-4c54-42f8-92b0-ef41e6d2eef1 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1394 microversion: 2.1 time: 0.741812 Aug 25 12:48:23.666991 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1080/2088] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:22 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1394 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:23.680083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb96c590-b0cc-440c-a0da-4142d75095c2 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:23.704838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.720494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.723964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:23.727464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-883ee376-4953-46ed-ab5a-cc5d52ed5108 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1285 microversion: 2.32 time: 0.253243 Aug 25 12:48:23.728994 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1009/2089] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:23 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:23.738724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:23.742997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:23.743783 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb96c590-b0cc-440c-a0da-4142d75095c2 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.071000 Aug 25 12:48:23.760360 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1081/2090] 10.222.0.60 () {58 vars in 1169 bytes} [Thu Aug 25 12:48:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:23.765060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.766415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.767452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.769234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.770319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.771294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.778900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-983971a4-bf0f-4b15-9010-87246fcd59e5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-387103928", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 0}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-983971a4-bf0f-4b15-9010-87246fcd59e5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Request method failure captured: Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 167 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2-N1ETfZnOn1ffRk1Sd_kISjU1CbHaMwCUtemMVuJ63AQ1A8L3ZL0q2I_1Y3-6jrIr-S43Mo3EMkuaAbAwTSTFFSSfLt904mEyabPaeVqd9r49HAaTz8b1ZUwaEkio6Bv_nUVm0F0PyTqnW8D_YHrQ4jT3-lsDnEd9jxg8IFJco1QE Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 787651e9b1114e29bcb07f30cafd79c9 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-387103928", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 0}} Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-387103928', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'min_count': 0}}} Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 0 Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:48:23.787699 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-983971a4-bf0f-4b15-9010-87246fcd59e5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:23.799396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-983971a4-bf0f-4b15-9010-87246fcd59e5 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028308 Aug 25 12:48:23.807070 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1082/2091] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:23.861421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d6d48d-9bd4-46b0-9689-916a70914cf4", "name": "network-vif-plugged", "status": "completed", "tag": "5847446a-0bc3-4bb4-984c-6ab3571ec543"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:23.927226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:23.930235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:23.931743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:23.973956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] Creating event network-vif-plugged:5847446a-0bc3-4bb4-984c-6ab3571ec543 for instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 on n-h1-850468-18 Aug 25 12:48:23.986053 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e589b553-a902-467f-85b1-d7b8b63f1d0b req-329abc67-b16e-4d3b-a592-6a02bdf18484 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176710 Aug 25 12:48:23.989125 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1083/2092] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:24.004431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e10b615-b0d9-41f5-953c-800be2e7865f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:24.054616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e10b615-b0d9-41f5-953c-800be2e7865f tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.062002 Aug 25 12:48:24.072688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1084/2093] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:48:23 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:24.117377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e76caf57-831f-461f-8d32-63719da9ae70 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1757662702", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 2.5}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e76caf57-831f-461f-8d32-63719da9ae70 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Request method failure captured: Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 170 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2-N1ETfZnOn1ffRk1Sd_kISjU1CbHaMwCUtemMVuJ63AQ1A8L3ZL0q2I_1Y3-6jrIr-S43Mo3EMkuaAbAwTSTFFSSfLt904mEyabPaeVqd9r49HAaTz8b1ZUwaEkio6Bv_nUVm0F0PyTqnW8D_YHrQ4jT3-lsDnEd9jxg8IFJco1QE Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/83194eb6fac940dcb04a9b3ec01f7018"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 83194eb6fac940dcb04a9b3ec01f7018 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2050060061 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 787651e9b1114e29bcb07f30cafd79c9 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2050060061-project Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1757662702", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 2.5}} Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1757662702', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'min_count': 2.5}}} Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 2.5 Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:48:24.143746 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e76caf57-831f-461f-8d32-63719da9ae70 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:24.153860 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e76caf57-831f-461f-8d32-63719da9ae70 tempest-MultipleCreateNegativeTestJSON-2050060061 tempest-MultipleCreateNegativeTestJSON-2050060061-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.073992 Aug 25 12:48:24.160894 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1085/2094] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:48:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:48:24.202079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd810791-bb03-4ec1-906e-358ddffd67a1 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:24.246678 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd810791-bb03-4ec1-906e-358ddffd67a1 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.083992 Aug 25 12:48:24.247984 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1086/2095] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:24.288092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ef8697b-0f81-49fd-9486-daec54c92e84 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:24.416409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ef8697b-0f81-49fd-9486-daec54c92e84 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.143777 Aug 25 12:48:24.426206 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1087/2096] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 12:48:24 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:24.455176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5282a2c-ff9b-42a9-a7c3-cad9b1e0ed5a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:24.496632 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5282a2c-ff9b-42a9-a7c3-cad9b1e0ed5a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043201 Aug 25 12:48:24.498001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1088/2097] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:24.534489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:24.536329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:24.577885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:24.579028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:24.580008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:24.581996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:24.583313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:24.585440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:24.877622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:24.912305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72e68e22-813e-4d65-a295-b0de41cda948 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 1.178051 Aug 25 12:48:24.928997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1010/2098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:23 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:24.948973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86b1b3f9-5ea7-4d69-9c8c-bc44047c405a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:25.005361 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86b1b3f9-5ea7-4d69-9c8c-bc44047c405a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.074042 Aug 25 12:48:25.020760 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1011/2099] 10.222.0.60 () {58 vars in 1144 bytes} [Thu Aug 25 12:48:24 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:25.037255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:25.039531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:25.062817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:25.062817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:25.063179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:25.069793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:25.070891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:25.074810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:25.551022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:25.575152 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-854010cd-a3e4-46de-9eb0-1db36f0b27c1 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 1.069932 Aug 25 12:48:25.600735 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1089/2100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:24 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:25.622618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:25.630013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:25.654848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:25.664101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:25.665031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:25.666421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:25.667278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:25.668102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.010636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:26.017542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:26.046654 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2768473-5461-4322-ba96-8dc135c928ca tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1394 microversion: 2.1 time: 1.021589 Aug 25 12:48:26.064155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:26.064523 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1012/2101] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:25 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1394 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:26.078314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:26.078714 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4925d6c7-5b82-466f-a6bb-4f0c42060ed5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1527 microversion: 2.32 time: 0.475570 Aug 25 12:48:26.083054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca2ae14d-5360-4a46-a91a-41ad05bef489 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.095409 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1090/2102] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:25 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1527 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:26.104927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.106094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:26.119006 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca2ae14d-5360-4a46-a91a-41ad05bef489 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.062769 Aug 25 12:48:26.124622 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1013/2103] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:26.141829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:26.142638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:26.143143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.144305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:26.144756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171debfd-bc35-489c-b9d2-9872472f5f0b", "name": "network-vif-plugged", "status": "completed", "tag": "90795744-ff98-40da-8cce-e53ff3794b37"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:26.145883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:26.147186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.169448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:26.189195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:26.190163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.234938 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] Creating event network-vif-plugged:90795744-ff98-40da-8cce-e53ff3794b37 for instance 171debfd-bc35-489c-b9d2-9872472f5f0b on n-h2-850468-18 Aug 25 12:48:26.266321 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5a86318c-d8ee-4d8c-a889-0b38e40829d0 req-60248ad3-7902-49ff-8aad-bf1110b10be6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138841 Aug 25 12:48:26.267302 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1014/2104] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:26.293681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d814a33e-a76e-41e2-be42-1eb81c61c4c4 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.394438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d814a33e-a76e-41e2-be42-1eb81c61c4c4 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.124345 Aug 25 12:48:26.409568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1015/2105] 10.222.0.60 () {58 vars in 1148 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:26.441910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-756f1fcb-cb69-47b9-b5a0-601e9853f51b tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.492463 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-756f1fcb-cb69-47b9-b5a0-601e9853f51b tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.053275 Aug 25 12:48:26.514403 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1016/2106] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:48:26.525240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d62499b7-83ea-4ed3-8512-5c94b0ce51c9 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.565031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d62499b7-83ea-4ed3-8512-5c94b0ce51c9 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048138 Aug 25 12:48:26.566633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1017/2107] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:26.589550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3a6739e-cf49-4de6-96a1-87f040d6465a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.711554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:26.752636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a21f735-58ee-49cc-8e62-dbe8fa1022cf tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 0.652746 Aug 25 12:48:26.755119 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1091/2108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:26.778325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.782224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:26.788584 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3a6739e-cf49-4de6-96a1-87f040d6465a tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.206155 Aug 25 12:48:26.813312 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1018/2109] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:48:26.841510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a09984d-76fa-4cc6-89c7-9b6fc28f0e80 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:26.844790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:26.858883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:26.860807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.862621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:26.863605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:26.864712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:26.926969 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a09984d-76fa-4cc6-89c7-9b6fc28f0e80 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102898 Aug 25 12:48:26.929059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1019/2110] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:26.982848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eaa7ed26-6013-4f12-8dbd-f03d158d1115 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:27.025306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eaa7ed26-6013-4f12-8dbd-f03d158d1115 tempest-FlavorsV2TestJSON-1076835198 tempest-FlavorsV2TestJSON-1076835198-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.063123 Aug 25 12:48:27.035174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1020/2111] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:27.092366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:27.094014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:27.109944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:27.111407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:27.116895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:27.119654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:27.124716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:27.126111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:28.570503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:28.647040 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a220d50-6407-4eea-a820-4d170f064286 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 1.875904 Aug 25 12:48:28.651982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1092/2112] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:26 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:28.687765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:28.692986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:28.736694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:28.737590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:28.738439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:28.740862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:28.757821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:28.761786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:29.120080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:29.157232 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d1bf0e9-c2a0-45d3-a12d-4d0c45ff4e9b tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1575 microversion: 2.1 time: 2.072770 Aug 25 12:48:29.165446 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1021/2113] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:27 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1575 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:29.213356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:29.228412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:29.278858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:29.285248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:29.289464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:29.309151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:29.311484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:29.312537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:29.491521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:29.535333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:29.546202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:29.548746 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3b55cbb2-1138-4af2-b00e-05fce94c8e51 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1593 microversion: 2.32 time: 0.891663 Aug 25 12:48:29.556672 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1093/2114] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:28 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1593 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:29.573371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:29.581525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:29.605732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:29.607377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:29.608575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:29.617278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:29.618371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:29.619244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:30.124520 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8ada008-8bb7-41ff-ae49-7d185d2b246f tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.565245 Aug 25 12:48:30.126422 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1094/2115] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:48:29 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4/os-interface => generated 285 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:30.143384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4dde21b-ecd1-4419-8dfb-7da86c488f62", "name": "network-vif-plugged", "status": "completed", "tag": "8b7d2001-4e3b-46cf-8cea-d27d16a4723a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:30.191818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:30.193090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:30.196424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:30.311199 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] Creating event network-vif-plugged:8b7d2001-4e3b-46cf-8cea-d27d16a4723a for instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 on n-h1-850468-18 Aug 25 12:48:30.368262 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f2026431-e1e5-4459-82dc-165714715b81 req-685893b9-abae-4bc4-af02-e0c3c267fbb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236219 Aug 25 12:48:30.373849 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1095/2116] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:30.395073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:30.410113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:30.426683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:30.428106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:30.446058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:30.467665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:30.469153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:30.476312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:31.263646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:31.294909 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29e5a570-874b-482b-9738-af066b910ef4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1325 microversion: 2.1 time: 2.121809 Aug 25 12:48:31.300760 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1022/2117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:29 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1325 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:31.340352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:31.342324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:31.372472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:31.375701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:31.377130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:31.397737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:31.399079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:31.400168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:31.573467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:31.621964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:32.754752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:32.811285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:32.830221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:32.842472 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-16a23c09-2ec7-4445-bb6c-5f7c9bc3af56 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1593 microversion: 2.32 time: 1.532250 Aug 25 12:48:32.850310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1023/2118] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:31 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1593 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:32.888620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:32.888620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:32.926767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:32.931180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:32.933930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:32.935478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:32.936393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:32.939596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:33.430739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:33.498939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-831788d5-64c7-41c5-9659-a669ed7b6ade tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1199 microversion: 2.1 time: 3.122913 Aug 25 12:48:33.504339 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1096/2119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:30 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1199 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:33.717440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:34.037820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-168259142", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:34.059527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:34.200998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:48:34.203551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:48:34.205618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:48:34.206994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:48:34.208453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:48:34.240147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.241785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.242968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.244798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.246760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.248146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.332177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Getting quotas for project f4a3035e3d264badbc60fc6a74073cfd. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:48:34.344964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Getting quotas for user 7d737a81b8be4ac1bece148fef71f882 and project f4a3035e3d264badbc60fc6a74073cfd. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:48:34.390962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:48:34.397382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:48:34.575880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6bf97e1f-0cd2-45e1-83eb-c5b9264b9aaa tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.069220 Aug 25 12:48:34.583157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1097/2120] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:48:34.602277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.612573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:34.628982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.629742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.632811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.635840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.639850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.640373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.823868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:34.832776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:34.869447 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d7bb4e0-69a0-4222-9051-27752cc7fb5c tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1521 microversion: 2.1 time: 2.016998 Aug 25 12:48:34.872294 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1024/2121] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:32 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1521 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:34.883464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:34.893282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:34.918971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.925453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.926586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:34.928761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:34.938016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:34.939262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:35.040042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.098297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.119470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.123164 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc25a542-2812-4615-962b-f283f2b02009 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1593 microversion: 2.32 time: 0.534921 Aug 25 12:48:35.126667 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1098/2122] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1593 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:35.157118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:35.159019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:35.901834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.936953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.942475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:35.952034 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-755711ad-55f3-4d25-ae9b-232ddca46ccf tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1280 microversion: 2.47 time: 0.822829 Aug 25 12:48:35.969439 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1099/2123] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:35 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1280 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:35.988533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:35.988533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:36.019710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.022316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.025407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.032871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.034075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.035017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.184756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] HTTP exception thrown: Action 999 not found Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Request method failure captured: Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b/os-instance-actions/999 HTTP/1.1 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2935Sgl9CHB-bpe3PMjdgLg-LZ1eVDJuk4LlhFloZl5D_mNhzGXcT31AnlOg2LFGFs4U8ftYsepfMqZvJgukdaPn-AbF5tgH-ejboxrrVK0sbTmIxPTU0_5rHB3BD3gW1huPp5QXgIB1doxb739pMsH_55PDguJV737iki0lUA4weU Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de962fa126704e3c89463f1c49b14d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ccef3f322e944e68a2795af799aab8da Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: exception: Action 999 not found Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': '171debfd-bc35-489c-b9d2-9872472f5f0b', 'id': '999'} Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 25 12:48:36.201735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.214918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Returning 404 to user: Action 999 not found {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:36.214918 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9b730a9-1d53-4cdd-b598-72e241651b1a tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.255049 Aug 25 12:48:36.215754 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1100/2124] 10.222.0.60 () {58 vars in 1308 bytes} [Thu Aug 25 12:48:35 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b/os-instance-actions/999 => generated 66 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:48:36.235946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:36.242207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:36.271816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.273179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.274700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.280041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:36.281651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:36.282874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:36.729175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:36.765579 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-110b61a5-d639-4358-9a61-83c304ca1b80 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1383 microversion: 2.1 time: 1.890570 Aug 25 12:48:36.789020 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1025/2125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:34 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1383 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:36.807870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '.version_select at 0x7fc6c6bff8b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:36.809216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:36.821692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] HTTP exception thrown: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Request method failure captured: Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e/os-instance-actions HTTP/1.1 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2935Sgl9CHB-bpe3PMjdgLg-LZ1eVDJuk4LlhFloZl5D_mNhzGXcT31AnlOg2LFGFs4U8ftYsepfMqZvJgukdaPn-AbF5tgH-ejboxrrVK0sbTmIxPTU0_5rHB3BD3gW1huPp5QXgIB1doxb739pMsH_55PDguJV737iki0lUA4weU Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de962fa126704e3c89463f1c49b14d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ccef3f322e944e68a2795af799aab8da Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e'} Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:48:36.828479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. Aug 25 12:48:36.836221 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:36.838388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Returning 404 to user: Instance a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:36.839496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bcd6c18-8bcf-40a1-bcdf-537fad887bf4 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.048683 Aug 25 12:48:36.840416 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1026/2126] 10.222.0.60 () {58 vars in 1296 bytes} [Thu Aug 25 12:48:36 2022] GET /compute/v2.1/servers/a2f4b4e9-bc63-4929-ab7b-f2fcdff6376e/os-instance-actions => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:48:37.252730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:37.312517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:37.321918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:37.328533 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82aedd21-7641-4ef8-9d70-353067bd31a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1593 microversion: 2.32 time: 1.108862 Aug 25 12:48:37.333013 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1101/2127] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:36 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1593 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:37.354381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:37.356536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:37.372164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.373140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.373986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.386140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:37.386955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.389351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.390453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:37.394059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.411713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.413712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.415048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.417809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:37.419188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:37.421492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:37.518403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:48:37.982541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9bbf980d-e1ab-49c7-8222-1b9e22791a6b tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "DELETE /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 204 len: 0 microversion: 2.1 time: 0.644355 Aug 25 12:48:37.983077 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1102/2128] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:48:37 2022] DELETE /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:48:38.003775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:38.007780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:38.038929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.044272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.044272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:38.045521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.046395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.047225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:38.607900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:38.650832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:38.660469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:38.670391 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e51ebcb-9f46-4e34-a5ad-d83a3c8c0142 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1340 microversion: 2.47 time: 0.685087 Aug 25 12:48:38.685165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1103/2129] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:37 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1340 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:38.705987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:38.707789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:38.747880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.760378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.761561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:38.763431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:38.764648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:38.765719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:39.346026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-975b4241-a921-4891-9e89-1ba18e0c604b tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1536 microversion: 2.1 time: 2.502126 Aug 25 12:48:39.375858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1027/2130] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:36 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1536 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:39.409146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:39.412158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:39.434645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:39.436925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:39.438120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:39.440611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:39.444174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:39.445934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.379706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:41.392067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:41.454595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9153055c-a4dd-4810-a48d-46c638985719 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1527 microversion: 2.1 time: 2.767067 Aug 25 12:48:41.465748 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1104/2131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:38 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1527 bytes in 2770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:41.509073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:41.514326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:41.561522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.564922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.566734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:41.570635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:41.571875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:41.573015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.072455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:42.104251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:42.108833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:42.110844 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-147da868-e860-4412-a20e-59645d07ff37 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1661 microversion: 2.32 time: 2.730717 Aug 25 12:48:42.125802 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1028/2132] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:39 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1661 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:42.153281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:42.154562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:42.167796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.169167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.169983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:42.176837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:42.177814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:42.178965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.246453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:43.301099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:43.308797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:43.312566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-128517b0-bedb-4359-b58c-3ef905fa2ac7 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1338 microversion: 2.47 time: 1.184800 Aug 25 12:48:43.321471 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1029/2133] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:42 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1338 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:43.346309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:43.360202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:43.387119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.391212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.392679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:43.400287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:43.403092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:43.404002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.314386 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a95ac74b-9558-4d96-8d4b-1008fde05fb9 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1536 microversion: 2.1 time: 2.842884 Aug 25 12:48:44.316467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1105/2134] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:41 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1536 bytes in 2850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:44.336221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:44.337345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:44.367089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:44.370351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.371213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.372027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:44.374893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:44.379627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:44.381587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:45.918630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:47.128527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccef3f322e944e68a2795af799aab8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de962fa126704e3c89463f1c49b14d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:47.259628 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b701d670-bedf-42a2-835b-33514e3ab043 tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 200 len: 1527 microversion: 2.1 time: 3.934609 Aug 25 12:48:47.275052 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1030/2135] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:43 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 1527 bytes in 3941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:47.294432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:47.296395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:47.325975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.327177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.328321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.337916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.338948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.340340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.734889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:47.776671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:47.794543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:47.801523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6bf2c934-5342-43ee-aca5-5f688c0f8748 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1661 microversion: 2.32 time: 3.478262 Aug 25 12:48:47.806626 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1106/2136] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:44 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1661 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:47.825061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d6d48d-9bd4-46b0-9689-916a70914cf4", "tag": "5847446a-0bc3-4bb4-984c-6ab3571ec543"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:47.858656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.860550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.861755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.905529 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] Creating event network-changed:5847446a-0bc3-4bb4-984c-6ab3571ec543 for instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 on n-h1-850468-18 Aug 25 12:48:47.924384 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-40674461-c9e5-4b13-be3e-be1d6f724903 req-502f8e57-8bd3-4abe-be3d-0221eff11cc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112082 Aug 25 12:48:47.929066 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1107/2137] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:47.946191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:47.958682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.962238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.963445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:47.965668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:47.967560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:47.968844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.112394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-423b4c59-063b-4a05-a449-2bc12971de80 tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.178966 Aug 25 12:48:48.114083 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1108/2138] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 12:48:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:48.126072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:48.127481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:48.155677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.159027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.160328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.162493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.165944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.180771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.625710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:48.659455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:48.666726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:48.673874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf844028-01c6-459c-a14e-b09cb4d1cc66 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1359 microversion: 2.47 time: 0.556469 Aug 25 12:48:48.680652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1109/2139] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:48 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1359 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:48.743685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171debfd-bc35-489c-b9d2-9872472f5f0b", "name": "network-vif-unplugged", "status": "completed", "tag": "90795744-ff98-40da-8cce-e53ff3794b37"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:48.805416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:48.812001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:48.813208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:48.895616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] Creating event network-vif-unplugged:90795744-ff98-40da-8cce-e53ff3794b37 for instance 171debfd-bc35-489c-b9d2-9872472f5f0b on n-h2-850468-18 Aug 25 12:48:48.920546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ee485d2c-1eaa-4d67-a3a0-82f23f73d5c3 req-1a95a3c7-735c-4884-9963-2fb3f2e29b7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213536 Aug 25 12:48:48.929064 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1110/2140] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:48.996912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-18", "block_migration": false, "disk_over_commit": false}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:49.007499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:49.063871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.066139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.070014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.076946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.078234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.079299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.326418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lazy-loading 'flavor' on Instance uuid d4dde21b-ecd1-4419-8dfb-7da86c488f62 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:48:49.377574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Going to try to live migrate instance to n-h2-850468-18 {{(pid=122701) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 12:48:49.584632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:49.628524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2df17543-97a2-4701-a2db-50a6cbd3b168 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 200 len: 1575 microversion: 2.1 time: 2.347173 Aug 25 12:48:49.632691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1031/2141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:47 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 1575 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:49.646617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:49.648480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] [instance: 171debfd-bc35-489c-b9d2-9872472f5f0b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:49.666865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:49.696834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.701601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.702774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.710717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.711918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.713157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.789753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] HTTP exception thrown: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Request method failure captured: Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b HTTP/1.1 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2935Sgl9CHB-bpe3PMjdgLg-LZ1eVDJuk4LlhFloZl5D_mNhzGXcT31AnlOg2LFGFs4U8ftYsepfMqZvJgukdaPn-AbF5tgH-ejboxrrVK0sbTmIxPTU0_5rHB3BD3gW1huPp5QXgIB1doxb739pMsH_55PDguJV737iki0lUA4weU Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_de962fa126704e3c89463f1c49b14d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/de962fa126704e3c89463f1c49b14d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: de962fa126704e3c89463f1c49b14d99 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1117235235 Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ccef3f322e944e68a2795af799aab8da Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1117235235-project Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '171debfd-bc35-489c-b9d2-9872472f5f0b'} Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.793451 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. Aug 25 12:48:49.802101 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:48:49.811380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] Returning 404 to user: Instance 171debfd-bc35-489c-b9d2-9872472f5f0b could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:48:49.814104 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4c91a60-397e-44af-8cf8-4f7ab8d1c1aa tempest-InstanceActionsNegativeTestJSON-1117235235 tempest-InstanceActionsNegativeTestJSON-1117235235-project] 10.222.0.60 "GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b" status: 404 len: 111 microversion: 2.1 time: 0.177544 Aug 25 12:48:49.821389 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1032/2142] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:49 2022] GET /compute/v2.1/servers/171debfd-bc35-489c-b9d2-9872472f5f0b => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:48:49.856616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1222710873"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:49.861988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:49.878209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.886265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.887726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:49.889563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:49.915466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:49.916885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:50.935819 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b7d7c76-9e46-402d-ba98-f52bfafaa636 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "POST /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07/action" status: 202 len: 52 microversion: 2.47 time: 1.110717 Aug 25 12:48:50.936946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1033/2143] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 12:48:49 2022] POST /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07/action => generated 52 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:48:50.947170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:50.947998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:50.989306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:50.993811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:50.994709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:50.997836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:50.998510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:50.999010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.445612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:52.467818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:52.471929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:52.475792 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd25aa2c-9808-485f-9d5e-7b1e881d5c40 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1708 microversion: 2.32 time: 1.537437 Aug 25 12:48:52.477936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1034/2144] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:50 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1708 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:52.488811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171debfd-bc35-489c-b9d2-9872472f5f0b", "name": "network-vif-deleted", "tag": "90795744-ff98-40da-8cce-e53ff3794b37"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:48:52.510248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.511515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.513807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.543181 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] Creating event network-vif-deleted:90795744-ff98-40da-8cce-e53ff3794b37 for instance 171debfd-bc35-489c-b9d2-9872472f5f0b on n-h2-850468-18 Aug 25 12:48:52.556732 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-80ad8143-4062-4386-b43a-27f0f2099bd2 req-d149a61e-9059-4753-9ac5-c4e0a7e2792d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075008 Aug 25 12:48:52.560157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1035/2145] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:48:52.583003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:52.587352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:52.628596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.631395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.632726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.636319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:52.637541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:52.638574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:52.774128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:48:53.095139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72e6e410-1fee-4cea-ac6b-bae6ea85588b tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 204 len: 0 microversion: 2.47 time: 0.530553 Aug 25 12:48:53.098544 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1036/2146] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:48:52 2022] DELETE /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:48:53.122873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:53.124059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:53.144494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:53.146484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:53.147791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:53.149074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:53.150205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:53.151410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:53.531965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:53.577051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:53.581169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:53.584056 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-06ba8489-604e-404b-bf50-5b62f79b7fb8 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1365 microversion: 2.47 time: 0.475983 Aug 25 12:48:53.585639 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1037/2147] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:53 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:53.595565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:53.596734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:53.609081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:53.609823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:53.610634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:53.611995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:53.612884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:53.613653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.857019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3020b89a-88b5-4d06-aaff-5da9f73acc8a tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62/action" status: 202 len: 0 microversion: 2.1 time: 6.924307 Aug 25 12:48:55.858575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1111/2148] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:48:48 2022] POST /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62/action => generated 0 bytes in 6929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:48:55.889940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:55.895397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:55.935280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.946598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:55.947614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:55.949476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:55.950603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:55.954469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:56.405346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.452923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.458196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.466164 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-226dedfe-6b83-468f-a194-7d4001aa8d84 tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1365 microversion: 2.47 time: 0.596393 Aug 25 12:48:56.471714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1112/2149] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:55 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:56.495297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:56.496975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:56.527766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:56.528711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:56.529563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:56.531008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:56.531925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:56.544746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:56.872962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.928390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.933547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:56.946353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f43b6851-9416-4fb0-98e1-ec4cf154b80a tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1755 microversion: 2.32 time: 3.358274 Aug 25 12:48:56.968468 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1038/2150] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:53 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1755 bytes in 3382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:57.521766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:57.527408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:57.563979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:57.567669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:57.573429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:57.575261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:57.578259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:57.579772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.004499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:48:58.007632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:58.053901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:58.062003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:58.064382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ec74fde-f655-421d-8afc-0893cf28e36f tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1365 microversion: 2.47 time: 0.551107 Aug 25 12:48:58.106480 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1039/2151] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:57 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1365 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:48:58.117363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:58.118955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:58.143589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.151245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.151889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.156494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:58.172829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:58.176377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:58.325267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:58.346804 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-566facc2-98df-459b-959b-e46e48c6d590 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 1.872770 Aug 25 12:48:58.348326 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1113/2152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:56 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:48:59.120104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:59.121320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:59.190626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.191906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.193289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:59.194943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.196136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.197320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:48:59.714339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:59.765558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:59.792316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d737a81b8be4ac1bece148fef71f882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a3035e3d264badbc60fc6a74073cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:48:59.810558 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0ee2c3e-0115-4367-b86f-595166897c5e tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 200 len: 1365 microversion: 2.47 time: 0.685529 Aug 25 12:48:59.875948 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1114/2153] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:59 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 1365 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:48:59.919444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:48:59.935313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:48:59.968613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:48:59.970773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:48:59.973384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:00.007661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:00.010124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:00.011618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:02.000953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:02.027158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:02.043627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:02.051619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:02.057923 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63bb46ab-eb35-4858-8230-6ec5a7c1eba6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1755 microversion: 2.32 time: 3.949414 Aug 25 12:49:02.068854 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1040/2154] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:48:58 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1755 bytes in 3957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:02.081774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:02.092166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] [instance: 9001621d-c7ad-4008-86ab-ef5fe994cd07] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:02.109663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:02.110997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:02.112069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:02.114282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:02.117692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:02.118824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:02.169735 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] HTTP exception thrown: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Request method failure captured: Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 HTTP/1.1 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2-g4n-h_i3F32EbxffYaRDC6zY0aq4pxDhz4LcDq_ZZxxHWtQw7YAa3-g7zEOLiUcPmZyWuzfUfyG-_2tQT7d_0X47mmh8e9RWDIE_3PQ8ZwLk6tTcRhBPHDVNWu8UCx7NwpVfjfyBpOizuPyWdS8IqvU6-U5CsmwNOK5mGC_4JWIs Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: f4a3035e3d264badbc60fc6a74073cfd Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAaction247Test-1031734440 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4a3035e3d264badbc60fc6a74073cfd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4a3035e3d264badbc60fc6a74073cfd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4a3035e3d264badbc60fc6a74073cfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4a3035e3d264badbc60fc6a74073cfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAaction247Test-1031734440 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: f4a3035e3d264badbc60fc6a74073cfd Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAaction247Test-1031734440 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAaction247Test-1031734440-project Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7d737a81b8be4ac1bece148fef71f882 Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAaction247Test-1031734440-project Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9001621d-c7ad-4008-86ab-ef5fe994cd07'} Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:49:02.173707 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. Aug 25 12:49:02.181838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:49:02.184719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] Returning 404 to user: Instance 9001621d-c7ad-4008-86ab-ef5fe994cd07 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:49:02.186720 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41820192-5df7-49d1-a732-463c7edf94ee tempest-ServersAaction247Test-1031734440 tempest-ServersAaction247Test-1031734440-project] 10.222.0.60 "GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07" status: 404 len: 111 microversion: 2.47 time: 0.120737 Aug 25 12:49:02.194880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1041/2155] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:02 2022] GET /compute/v2.1/servers/9001621d-c7ad-4008-86ab-ef5fe994cd07 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:49:03.127178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:03.137166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:03.196603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.201562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.206382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:03.212741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:03.218539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:03.222581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:07.638951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:07.695959 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b8a046b1-da43-4008-8d06-8eeb8e283e63 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 7.816082 Aug 25 12:49:07.697771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1115/2156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:48:59 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 7820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:09.022957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:09.027193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-894527582", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:09.086977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:09.146966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:09.152049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:09.160890 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74c0da93-c05d-44ca-ad4a-ccb84003de13 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1755 microversion: 2.32 time: 6.061343 Aug 25 12:49:09.169964 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1042/2157] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:03 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1755 bytes in 6076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:09.193459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:09.207889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:09.257864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.274640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.276417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.278847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:09.280183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:09.281231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:09.348175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] validate_networks() for [('aece9742-1add-4f59-b848-e633a3e7299f', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:11.727331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:11.807137 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e08c882-dab1-4c57-97d4-e65c4e7e83eb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.633059 Aug 25 12:49:11.838834 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1043/2158] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:09 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:11.892752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:11.894213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:11.914958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:11.916058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:11.916992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:11.918332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:11.919547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:11.920508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:13.501719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:13.549702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:13.557577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:13.564328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c9ce09e5-05ff-456b-abd6-ee63815fafbd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1802 microversion: 2.32 time: 1.713277 Aug 25 12:49:13.570034 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1044/2159] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:11 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1802 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:13.599895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:13.604051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:13.631025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:13.634519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:13.637356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:13.641063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:13.644347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:13.647601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:14.475801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:14.483156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:14.491505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:14.494663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:14.501762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:14.546336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:14.548361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:14.549994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:14.552798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:14.554678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:14.555897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:14.586073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:14.623742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:14.643455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for user 3566ed81b8cd452f8e1427269170f661 and project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:14.689449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:14.697798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:14.923126 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-023f032a-b457-4d0a-9965-7461fcea6700 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.691640 Aug 25 12:49:14.929204 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1116/2160] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 6699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:49:14.939960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:14.943019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:14.962729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:14.970771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:14.976711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:14.983225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:14.987192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:14.990245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:15.197127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:15.226790 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b93c7ab-e643-4770-bdcd-61db4cf9ea6d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 1.652850 Aug 25 12:49:15.233617 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1045/2161] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:13 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:15.249500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f299e5b3-6b4b-4a07-a649-ee27a0e1a308 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:15.250665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f299e5b3-6b4b-4a07-a649-ee27a0e1a308 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:15.616930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f299e5b3-6b4b-4a07-a649-ee27a0e1a308 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:15.648462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f299e5b3-6b4b-4a07-a649-ee27a0e1a308 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1221 microversion: 2.1 time: 0.412415 Aug 25 12:49:15.675307 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1046/2162] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:15 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1221 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:16.224833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-739545003", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:16.515845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] validate_networks() for [('aece9742-1add-4f59-b848-e633a3e7299f', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:20.384278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:20.464955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:20.469637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:20.472494 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd3e04ee-25ea-4c5c-bc36-c003892414fe tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1802 microversion: 2.32 time: 5.540810 Aug 25 12:49:20.474250 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1117/2163] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:14 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1802 bytes in 5544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:20.485029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:20.489248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:20.511897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:20.513197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:20.514278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:20.519001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:20.522145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:20.523455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:22.745445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:22.776103 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a6f1440-33be-4b7e-9a44-2d2fa69ed9d9 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.299300 Aug 25 12:49:22.779437 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1118/2164] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:20 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:22.801566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:22.805776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:22.832696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:22.840882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:22.842037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:22.862108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:22.867269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:22.869708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:24.585949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:24.670725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:24.995273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:25.070913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:25.074473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:25.077525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:25.077998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:25.080725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:25.092702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:25.118487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:25.120250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:25.126179 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b88499f7-c880-4270-9698-7be8f06fb9f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1849 microversion: 2.32 time: 2.344132 Aug 25 12:49:25.133267 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1119/2165] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:22 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1849 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:25.173214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:25.178147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:25.184806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:25.186224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:25.188929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:25.190404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:25.194875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:25.200254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:25.225698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:25.231398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:25.232716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:25.238056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:25.240188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:25.246037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:25.246484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:25.319429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:25.335852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for user 3566ed81b8cd452f8e1427269170f661 and project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:25.374388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:25.382290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:25.651055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-39bd6e1a-78f5-4bd8-9cc7-d34615c41a04 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 9.447520 Aug 25 12:49:25.671587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1047/2166] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 9466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:49:25.694062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f7cfe34-1574-465d-bfdd-8d3a8e67dffe tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:25.695153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f7cfe34-1574-465d-bfdd-8d3a8e67dffe tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:26.468070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f7cfe34-1574-465d-bfdd-8d3a8e67dffe tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:26.497030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f7cfe34-1574-465d-bfdd-8d3a8e67dffe tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1221 microversion: 2.1 time: 0.815097 Aug 25 12:49:26.506921 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1048/2167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:25 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1221 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:49:26.525532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:26.541932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:26.569077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.575883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.577589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:26.579257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:26.581865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:26.584103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:29.044535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:29.098449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:29.119193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:29.125734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:29.133834 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f4932174-b8f7-4d30-b6d7-5851e0265b60 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1849 microversion: 2.32 time: 2.619305 Aug 25 12:49:29.144762 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1049/2168] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:26 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1849 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:29.169710 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15dc5f4b-9b39-45eb-bcdd-41233267993a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 4.017359 Aug 25 12:49:29.200742 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1120/2169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:25 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 4058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:29.219831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:29.221269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:29.274001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:29.288322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:29.292961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:29.294774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:29.297376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:29.304435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:30.219688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:30.220912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:30.291494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:30.295531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:30.296528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:30.311368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:30.312323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:30.312824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:31.250669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:31.320726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e403f70-6bc0-46d4-adda-5f38914cdedb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1273 microversion: 2.1 time: 2.167833 Aug 25 12:49:31.331842 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1050/2170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:29 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1273 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:31.358192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:31.359347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:31.389180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:31.397273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:31.398202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:31.399496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:31.403761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:31.405208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:33.490333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:33.519788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-87815b70-209e-40c1-913d-78f09fed2814 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.184893 Aug 25 12:49:33.521355 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1051/2171] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:31 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:33.561215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:33.562977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:33.585058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:33.590824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:33.603950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:33.614083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:33.617863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:33.620522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:33.627641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:33.680263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:33.684458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:33.687133 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7818dc6c-f217-456c-9928-fbf47f4754b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1837 microversion: 2.32 time: 3.490451 Aug 25 12:49:33.691170 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1121/2172] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:30 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1837 bytes in 3496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:34.120217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:34.160103 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-075b4324-dcba-4a12-944d-f9969e84bf2a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1279 microversion: 2.1 time: 0.628399 Aug 25 12:49:34.167837 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1052/2173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:33 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1279 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:34.356063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "866fcb99-5974-4d0f-84c9-547637dd0877"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:34.396966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:34.398116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:34.398990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:34.431689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] Creating event network-changed:866fcb99-5974-4d0f-84c9-547637dd0877 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:49:34.444775 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-78789a2b-ec72-4b32-9653-a2a4c4914772 req-fc15f522-8331-49ba-8327-c54c9c8f892d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099015 Aug 25 12:49:34.449765 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1122/2174] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:49:34.572728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:34.587544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:34.651016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:34.651915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:34.652741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:34.654085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:34.665308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:34.670757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:34.768682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:34.779534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:34.807627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:34.809019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:34.810184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:34.811841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:34.820107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:34.821846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:35.253519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:36.158320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:36.206874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:36.209750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:36.222209 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13bfda3d-23e9-4980-9899-3fbba886b5e5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1837 microversion: 2.32 time: 1.476824 Aug 25 12:49:36.236165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1123/2175] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:34 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1837 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:49:36.475174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:36.584709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:36.620952 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f95f9387-552b-49b5-85ba-c6d53a81ff25 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.053952 Aug 25 12:49:36.622928 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1053/2176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:34 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:36.664031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:36.665549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:36.679370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:36.683390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:36.685050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:36.686530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89a63752-4e50-4f8e-a02e-08dfaa9ab410 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c6ccf160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-865092936", "description": "tempest-description-1770907607"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:36.689881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:36.691691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:36.695067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:37.149991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:37.196875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c6254e1-944b-42d0-a3e5-820cc763d1ab tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1279 microversion: 2.1 time: 0.535734 Aug 25 12:49:37.198834 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1054/2177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:36 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1279 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:37.427373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-194518273", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "8a0e6137-41da-43c9-b8fd-0781e72c4bda"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:37.626046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] validate_networks() for [('8a0e6137-41da-43c9-b8fd-0781e72c4bda', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:38.201053 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89a63752-4e50-4f8e-a02e-08dfaa9ab410 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.974922 Aug 25 12:49:38.202377 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1124/2178] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:49:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:38.221063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:38.225732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:38.276211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:38.281739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:38.282753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:38.290595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:38.292011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:38.293723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:39.039176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:39.068580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:39.085677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:39.088976 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02bedfd8-4003-4065-a613-00d4c3c454c1 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1837 microversion: 2.32 time: 0.884137 Aug 25 12:49:39.090286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1125/2179] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:38 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1837 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:39.122289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:39.132895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:39.151241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:39.152219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:39.153293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:39.155052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:39.157349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:39.158281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:39.856280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:39.890272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-294d6557-09b2-4c36-b4c6-a2b159d55352 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 0.794878 Aug 25 12:49:39.897065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1126/2180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:39 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:39.919164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32b3dd1e-ec33-4f67-b659-170a8ae13559 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c1f79dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1323521307", "description": "tempest-description-1437476168"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:42.257175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:42.260491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:42.262248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:42.264146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:42.269861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:42.321553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:42.323036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:42.324790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:42.336932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:42.348226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:42.350239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:42.434616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Getting quotas for project 74ec5b4d77e549e286137fe2e0574224. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:42.474007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Getting quotas for user 894b2f7fd28749e786683135eee3e55d and project 74ec5b4d77e549e286137fe2e0574224. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:42.525040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:42.539290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:42.747386 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dcc9048d-f44a-4220-8b32-edadc77b7fca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.545022 Aug 25 12:49:42.749044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1055/2181] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:49:42.773729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:42.775743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:42.795880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:42.799856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:42.800772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:42.806322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:42.806770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:42.808021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.885707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32b3dd1e-ec33-4f67-b659-170a8ae13559 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 4.985277 Aug 25 12:49:44.887222 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1127/2182] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:49:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 4988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:44.891037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:44.903530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:44.904802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:44.907942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:44.951400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.952252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.955260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.956798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:44.968078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:44.968918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:44.993557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=52 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:44.999084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e49be7ba-3e92-474c-a1cc-d8a8207aab30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1321 microversion: 2.1 time: 2.244129 Aug 25 12:49:45.011361 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1056/2183] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:42 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1321 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:45.043884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:45.049827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:45.090717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:45.095113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:45.099087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:45.104885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:45.107885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:45.111635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.765042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:46.801153 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d41559f8-367a-4184-b4ed-f0ad50a405bd tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 1.784721 Aug 25 12:49:46.816813 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1057/2184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:45 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:46.846372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8f122f-9542-433c-898e-9c3bbe30f239", "tag": "23042e68-a62f-41db-bd12-f525141a612e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:46.894276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:46.894725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:46.895494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:46.940273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] Creating event network-changed:23042e68-a62f-41db-bd12-f525141a612e for instance be8f122f-9542-433c-898e-9c3bbe30f239 on n-h1-850468-18 Aug 25 12:49:46.995461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-63eeffe0-9bb2-4e31-bc3a-bfdddbdda007 req-16c7d1da-f5d6-48ef-872e-2c16ad883f90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173526 Aug 25 12:49:46.999007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1058/2185] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:47.018553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:47.021899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:47.040378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.046198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.048312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:47.054507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.058508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.062175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:47.107433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.155638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.174082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.177595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a86b1d7-b7d7-4cfe-88ae-5fdda5a02553 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1858 microversion: 2.32 time: 2.287846 Aug 25 12:49:47.179483 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1128/2186] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:44 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1858 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:47.196839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-72782341", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "43830c38-a8ce-46a3-987b-c1e3ab9df63c"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:47.436842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] validate_networks() for [('43830c38-a8ce-46a3-987b-c1e3ab9df63c', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:49:47.455850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:47.488303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa68420a-498c-4b59-a4aa-14bca723e408 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1273 microversion: 2.1 time: 0.484346 Aug 25 12:49:47.525402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1059/2187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:46 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1273 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:47.538613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104aafde-b4b1-48c3-8268-e82a786c1945", "tag": "aeb71a72-9b5b-4f57-86bd-6acd4434b688"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:47.568867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.570742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.571949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:47.603998 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] Creating event network-changed:aeb71a72-9b5b-4f57-86bd-6acd4434b688 for instance 104aafde-b4b1-48c3-8268-e82a786c1945 on n-h2-850468-18 Aug 25 12:49:47.620563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2e7f0622-2624-416c-bf7b-76c67ecd9189 req-8ba844ff-a633-4973-ba86-6669760de704 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090368 Aug 25 12:49:47.625284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1060/2188] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:47.643775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:47.645827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:47.665796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.671279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.672706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:47.676215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:47.678810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:47.681597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.501370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:48.558858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b778819f-e9c2-4cd7-aaf4-ed1e8d22d568 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1321 microversion: 2.1 time: 0.930212 Aug 25 12:49:48.560931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1061/2189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:47 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1321 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:48.572143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:48.574053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:48.589854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.591261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.592435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:48.594145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:48.595579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:48.597123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.355644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:49.472881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca2b88bb-3a4a-451a-94f4-e335835746e5 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 0.862254 Aug 25 12:49:49.484227 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1062/2190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:48 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:49.507601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:49.516822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:49.549696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.555395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.559266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.568397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.570063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.573084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.699484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:49:49.701601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:49:49.703069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:49:49.704408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:49:49.705256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:49:49.780564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.782024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.785227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.789648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:49.791865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:49.793502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:49.902044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Getting quotas for project 9fcc4efcc4bb4e33b110b6c8c2fea54d. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:49:49.929994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Getting quotas for user 90c8cd80349d47fba0afe81f8f93923c and project 9fcc4efcc4bb4e33b110b6c8c2fea54d. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:49:49.987735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:49:49.997133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:49:50.294732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d6731033-99ec-441b-ae7d-a855e5a20fb1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.112719 Aug 25 12:49:50.310348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1129/2191] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:49:50.329735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:50.333962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:50.409524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:50.410344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.415411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.416631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.429721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.437171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.447342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.453768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:50.470134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:50.473225 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f668ceed-eacd-4012-8604-962d69dda25b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 0.986362 Aug 25 12:49:50.485447 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1063/2192] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:49 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:49:50.504758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:50.531544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:50.534985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Searching by: {'deleted': False, 'project_id': '6b509f3206954ae0afaf3840a9be18fd'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:49:50.557534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.564405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.565709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.568028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.573411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.574577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.729999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:49:50.832168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77866986-0973-4410-90fb-1c93c1f726f7 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.344347 Aug 25 12:49:50.839016 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1064/2193] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:49:50 2022] GET /compute/v2.1/servers => generated 333 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:50.849617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4dde21b-ecd1-4419-8dfb-7da86c488f62", "name": "network-vif-unplugged", "status": "completed", "tag": "8b7d2001-4e3b-46cf-8cea-d27d16a4723a"}, {"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "86ad8493-c37f-44ec-b0f6-8fccbbc756cd"}, {"name": "network-changed", "server_uuid": "d4dde21b-ecd1-4419-8dfb-7da86c488f62", "tag": "8b7d2001-4e3b-46cf-8cea-d27d16a4723a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:49:50.889992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:50.897543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:50.898972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:50.969857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Creating event network-vif-unplugged:8b7d2001-4e3b-46cf-8cea-d27d16a4723a for instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 on n-h1-850468-18 Aug 25 12:49:50.974077 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Creating event network-changed:86ad8493-c37f-44ec-b0f6-8fccbbc756cd for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:49:50.984233 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] Creating event network-changed:8b7d2001-4e3b-46cf-8cea-d27d16a4723a for instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 on n-h1-850468-18 Aug 25 12:49:51.062264 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5225e02a-e473-44b6-9d0e-c760856311b2 req-db7cbe47-9eb0-470f-bfb3-d08feb402626 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.209895 Aug 25 12:49:51.076105 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1065/2194] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:49:51.104105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:51.105456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:51.143897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:51.156737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:51.157727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:51.159168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:51.168533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:51.169113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:51.395145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:51.429753 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-151e2e0b-0f75-45e5-b4f6-dd4996d47b65 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1273 microversion: 2.1 time: 1.117467 Aug 25 12:49:51.473985 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1130/2195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:50 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1273 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:51.490692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea075802-6fdb-4546-86aa-c1f625b097a0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:51.506342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea075802-6fdb-4546-86aa-c1f625b097a0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:52.509613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:53.319350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ea075802-6fdb-4546-86aa-c1f625b097a0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:53.353811 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea075802-6fdb-4546-86aa-c1f625b097a0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1214 microversion: 2.1 time: 1.876711 Aug 25 12:49:53.355657 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1131/2196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:51 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1214 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:53.390941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:53.392626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:53.414140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.415490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.423828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:53.426421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:53.432999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:53.434723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:54.931214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:54.966732 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63dc9261-a54a-4d55-a0c6-b4928f6058c8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1321 microversion: 2.1 time: 3.888208 Aug 25 12:49:54.991489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1066/2197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:51 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1321 bytes in 3914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:55.017998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:55.043389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:55.070328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Searching by: {'deleted': False, 'project_id': '6b509f3206954ae0afaf3840a9be18fd'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:49:55.119972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.121636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.122995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:55.125117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.126588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.127852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:55.451964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:55.583537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:49:55.883908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aadf25819f4122aa608e27f95d4f0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b509f3206954ae0afaf3840a9be18fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:55.896010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:49:55.900838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:55.904626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:55.906369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:57.482099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:49:57.516227 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70aed204-54d7-42fb-bdca-c5feb9a2b1a0 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 4.157922 Aug 25 12:49:57.521481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1132/2198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:53 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 4165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:57.539190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:57.545783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:57.570003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:57.573124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:57.580962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:57.583560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:57.588672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:57.589899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:58.954600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f74b155d-66e6-48e6-8103-c5b8bb7a411e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 3.948727 Aug 25 12:49:58.958506 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1067/2199] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:49:55 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 3954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:49:59.005509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:49:59.007073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:49:59.050192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.073108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.074293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.082139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:49:59.084346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:49:59.087685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:49:59.858565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:00.144092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:00.193162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:00.198972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:00.210756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e569ed74-20f2-43c9-af98-e1efe999cec6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.682152 Aug 25 12:50:00.212242 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1133/2200] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:49:57 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:00.235382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "3d99ee29-74a8-4303-a784-e96e221ba3f3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:00.346415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:00.347844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:00.354668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:00.396728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] Creating event network-changed:3d99ee29-74a8-4303-a784-e96e221ba3f3 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:50:00.410301 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-df1de98d-ab9f-4180-982b-fce720a8b2e5 req-3bd96ed9-57fd-45cf-95a3-d5fe2e328e8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194517 Aug 25 12:50:00.425848 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1134/2201] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:00.440320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:00.441738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:00.459538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:00.462989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:00.465446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:00.467216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:00.469144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:00.470319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.086698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:01.107011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7ab4da1-851f-4cc4-bc5d-15abb4166235 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1272 microversion: 2.1 time: 0.677380 Aug 25 12:50:01.109311 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1135/2202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:00 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1272 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:01.120949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:01.122899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:01.141531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.143794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.146204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.148328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.149781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.151311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.245349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:01.283261 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-122284c2-9112-4226-9738-6e02bfcf2dd0 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1315 microversion: 2.1 time: 2.307993 Aug 25 12:50:01.289173 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1068/2203] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:49:58 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1315 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:01.312899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104aafde-b4b1-48c3-8268-e82a786c1945", "name": "network-vif-plugged", "status": "completed", "tag": "aeb71a72-9b5b-4f57-86bd-6acd4434b688"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:01.365142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.366807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.368099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.394125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] Creating event network-vif-plugged:aeb71a72-9b5b-4f57-86bd-6acd4434b688 for instance 104aafde-b4b1-48c3-8268-e82a786c1945 on n-h2-850468-18 Aug 25 12:50:01.404829 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c77f6103-e353-4ed1-8c97-a44ce942b0f7 req-fafb976f-af09-434f-b375-fc0ef8a0077f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110177 Aug 25 12:50:01.406949 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1069/2204] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:01.419893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:01.422067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:01.437376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.439103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.440528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:01.443218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:01.444701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:01.446174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:03.341853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:03.738672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:03.773506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9290b8cb-6227-49a6-9cd1-0b047ab632fb tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.360261 Aug 25 12:50:03.792656 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1070/2205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:01 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:03.826547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ac3fb0c-f45d-4416-bd56-b216d3820e0e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:03.856617 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ac3fb0c-f45d-4416-bd56-b216d3820e0e tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061348 Aug 25 12:50:03.858108 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1071/2206] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:50:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:03.953359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:03.993914 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6f391af5-628d-412d-a277-fef153acb2bc tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1321 microversion: 2.1 time: 2.881991 Aug 25 12:50:03.999367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1136/2207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:01 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1321 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:04.024466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:04.026592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:04.048363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:04.051758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:04.053423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:04.056566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:04.061988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:04.067075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:04.115630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-847459395", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "16eaf2a1-f250-4570-8d58-2ccfe97b157d"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:04.439402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] validate_networks() for [('16eaf2a1-f250-4570-8d58-2ccfe97b157d', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:50:05.275434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:05.776305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:05.813804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:05.819975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:05.825448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d75989f6-48be-4fe4-b6e3-ad388803a53f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.819657 Aug 25 12:50:05.835364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1137/2208] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:03 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:05.869417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:05.872175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:05.880978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:05.891532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:05.892999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:05.894531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:05.897134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:05.898427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:05.899629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:07.153847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:07.173976 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a610449-effc-4764-abfa-d5feafc9f298 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1314 microversion: 2.1 time: 1.336026 Aug 25 12:50:07.185431 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1138/2209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:05 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1314 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:07.195207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:07.197173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:07.213746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:07.215275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:07.216463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:07.218354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:07.219628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:07.220729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:07.873243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:50:07.874140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:50:07.874953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:50:07.875723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:50:07.878904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:50:07.902821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:07.903845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:07.906263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:07.908275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:07.909618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:07.910644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:07.949818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Getting quotas for project 81bd60d684bc43d0be10421f7792266c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:07.963949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Getting quotas for user 9d0980cc6c86495aba5b39d385fff41d and project 81bd60d684bc43d0be10421f7792266c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:07.994031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:50:07.999032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:50:08.114857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2336805f-b86f-4a7f-aac0-e73a9eec0b39 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.254334 Aug 25 12:50:08.127931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1072/2210] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:50:08.142040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "d0b7166a-7415-4c83-aec2-68510b37e32b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:08.174581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.176254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.178186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.207341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] Creating event network-changed:d0b7166a-7415-4c83-aec2-68510b37e32b for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:50:08.230815 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c561d387-d26e-4ac2-be95-ec73fad9668e req-7fcbb5c5-425a-4b92-a74b-380fa1de65a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099461 Aug 25 12:50:08.233536 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1073/2211] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:08.264721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d22e873-b6da-4b40-8add-ee1212c2c7d7", "tag": "77130e1f-c00e-405d-8f02-aae4a433f682"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:08.319433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.320253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.321033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.378756 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] Creating event network-changed:77130e1f-c00e-405d-8f02-aae4a433f682 for instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 on n-h1-850468-18 Aug 25 12:50:08.401230 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-99d07180-dd18-40a5-bfc7-7c1a159f3a8c req-0954210a-4d20-4405-941a-5dc11be336e2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164954 Aug 25 12:50:08.409649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1074/2212] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:08.433208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8f122f-9542-433c-898e-9c3bbe30f239", "name": "network-vif-plugged", "status": "completed", "tag": "23042e68-a62f-41db-bd12-f525141a612e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:08.482257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.483315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.499090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.560885 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] Creating event network-vif-plugged:23042e68-a62f-41db-bd12-f525141a612e for instance be8f122f-9542-433c-898e-9c3bbe30f239 on n-h1-850468-18 Aug 25 12:50:08.584455 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-91aad95d-e153-4a27-8781-d03eb2d3fbcc req-68ed7487-b6f9-4217-b6e1-6352e101f1b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167852 Aug 25 12:50:08.592326 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1075/2213] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:08.615120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:08.621863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:08.646758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.648577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.650256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.652024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:08.653392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:08.654841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:08.774043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:08.827840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:08.870582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-88e00621-8dd8-432d-9a57-1801184fde19 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1315 microversion: 2.1 time: 1.682328 Aug 25 12:50:08.876745 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1139/2214] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:07 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1315 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:09.087951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-246393000", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "a9a2be49-47ea-40bf-a106-804e6cee9e22"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:09.184565 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5dd260b0-c24f-40f0-9a69-67c7121b67ae tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "DELETE /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 204 len: 0 microversion: 2.1 time: 0.586536 Aug 25 12:50:09.190765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1076/2215] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:08 2022] DELETE /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:09.225690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:09.229268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:09.255560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.258807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.261868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.263797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:09.267452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:09.274260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:09.340051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] validate_networks() for [('a9a2be49-47ea-40bf-a106-804e6cee9e22', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:50:11.287087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:11.315093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b84b205-c227-42af-b444-bedb4caf82db tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1393 microversion: 2.1 time: 2.120177 Aug 25 12:50:11.319668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1077/2216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:09 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1393 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:11.329022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:11.331501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:11.368289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:11.369842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:11.370683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:11.372287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:11.373884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:11.378859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:12.724874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:12.757005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02547f21-259a-4463-868e-17126e1b66f4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1516 microversion: 2.1 time: 1.432664 Aug 25 12:50:12.761160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1078/2217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:11 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1516 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:12.796760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:12.800159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:12.816678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:12.818057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:12.819479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:12.822873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:12.824642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:12.826073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.942862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:50:13.944833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:50:13.945883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:50:13.947095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:50:13.947888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:50:13.967477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.968927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.970349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:13.971988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:13.973867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:13.975036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.016315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Getting quotas for project af16ecd8561848169cdb81235a034b66. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:50:14.029852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Getting quotas for user 94b29d56aaa4465f9464b6a5ee0ffd84 and project af16ecd8561848169cdb81235a034b66. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:50:14.052991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:50:14.057074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:50:14.144168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f167b40-13cd-45b8-b454-6fe7694799c7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.262574 Aug 25 12:50:14.150572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1140/2218] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:50:14.165387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.170834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.213423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.217174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.222637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.225650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.231539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.233568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.556265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:14.584791 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dfb01a2b-cdb7-4c8a-b985-ff945ba94b04 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1273 microversion: 2.1 time: 0.431850 Aug 25 12:50:14.597939 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1141/2219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1273 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:14.607326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:14.611191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:14.642600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.643674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.651090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:14.653111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:14.654033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:14.655093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.229255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:15.253191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:15.258335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:15.262393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9dc43879-7e9c-4b50-aacf-b577f9211641 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.497438 Aug 25 12:50:15.264718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1079/2220] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:12 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:15.280631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:15.283440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] [instance: 44d6d48d-9bd4-46b0-9689-916a70914cf4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:15.310765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.312261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.313539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.314916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.316005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.317643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.366272 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] HTTP exception thrown: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Request method failure captured: Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 HTTP/1.1 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB29ndCc6arCB4IQqxnPVhDAKRILmjM7UnlOeiv2WDWn7-UYM3EQJyPdOlasUO9MYuHzefhIJVOkbb9jPe9LaNxh3Vhvf3JsPRSrTWimBjeCa4n7lmrg8WtS18fA6ZcDXQUfJstx8BVorAuBcedmb0_03F-0GcDSOh4-6GYO_Dfmz6iU Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b509f3206954ae0afaf3840a9be18fd Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-554844401 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b509f3206954ae0afaf3840a9be18fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b509f3206954ae0afaf3840a9be18fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b509f3206954ae0afaf3840a9be18fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b509f3206954ae0afaf3840a9be18fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-554844401 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b509f3206954ae0afaf3840a9be18fd Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-554844401 Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-554844401-project Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90aadf25819f4122aa608e27f95d4f0e Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-554844401-project Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '44d6d48d-9bd4-46b0-9689-916a70914cf4'} Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:15.372141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Returning 404 to user: Instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b1f79b3-e559-4064-961f-f40129cc1e2c tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4" status: 404 len: 111 microversion: 2.1 time: 0.116348 Aug 25 12:50:15.386594 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1080/2221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:15 2022] GET /compute/v2.1/servers/44d6d48d-9bd4-46b0-9689-916a70914cf4 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:15.401510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:15.403082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:15.421193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.422907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.424309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:15.426788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:15.432509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:15.433784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:16.836415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:16.840586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=70 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:16.854995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46ce058c-240f-470d-8e83-c074c8ac011d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1314 microversion: 2.1 time: 2.253960 Aug 25 12:50:16.856050 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1142/2222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:14 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1314 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:16.865445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "f7963a7b-7a3d-40a4-af83-c475625d89d9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:16.875914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:16.896050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:16.897053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:16.897821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:16.921463 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] Creating event network-changed:f7963a7b-7a3d-40a4-af83-c475625d89d9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:50:16.930657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-56f5ea99-fc92-49cd-b433-91c5438c8786 req-086fea5f-a17b-4bc6-bc9e-0c27be5c0509 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072484 Aug 25 12:50:16.931681 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1143/2223] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:16.941181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d22e873-b6da-4b40-8add-ee1212c2c7d7", "name": "network-vif-plugged", "status": "completed", "tag": "77130e1f-c00e-405d-8f02-aae4a433f682"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:16.961759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:16.962263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:16.962720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:16.996902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] Creating event network-vif-plugged:77130e1f-c00e-405d-8f02-aae4a433f682 for instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 on n-h1-850468-18 Aug 25 12:50:17.011261 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f4ee1228-745d-4df2-9ab4-17ff02fb3f03 req-aead291e-220b-476d-a170-692890425196 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077253 Aug 25 12:50:17.013607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1144/2224] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:17.027971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:17.029622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:17.039804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:17.043556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.045369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.046160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.047215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.047904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.048729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.057358 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6527ab5-7122-423b-8014-8be875a60dca tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1315 microversion: 2.1 time: 1.661875 Aug 25 12:50:17.076174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1081/2225] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:15 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1315 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:17.089789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:17.093957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:17.103438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.103944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.104439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.105205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.106030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.106850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.541536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'flavor' on Instance uuid 104aafde-b4b1-48c3-8268-e82a786c1945 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:17.743800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-937a104a-28eb-4bf1-8352-0a6260f3143b tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action" status: 200 len: 32 microversion: 2.1 time: 0.663192 Aug 25 12:50:17.744963 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1082/2226] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:17 2022] POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action => generated 32 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:50:17.756217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d6d48d-9bd4-46b0-9689-916a70914cf4", "name": "network-vif-deleted", "tag": "5847446a-0bc3-4bb4-984c-6ab3571ec543"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:17.779361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.780221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.782422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.818908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] Creating event network-vif-deleted:5847446a-0bc3-4bb4-984c-6ab3571ec543 for instance 44d6d48d-9bd4-46b0-9689-916a70914cf4 on n-h1-850468-18 Aug 25 12:50:17.829923 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0e627725-6d00-4027-b625-ffee8040b3c8 req-1d204e51-65da-4c4b-8d25-eb27496222e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082141 Aug 25 12:50:17.832890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1083/2227] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:17.843574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:17.845441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:17.868871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.870584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.871872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.874863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:17.875787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:17.877439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:17.931225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:17.979658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:18.195628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.222337 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5bc7b52b-b57e-4883-8615-940c8473dc22 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1274 microversion: 2.1 time: 0.387059 Aug 25 12:50:18.236166 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1084/2228] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:17 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1274 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:18.236166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d977a0a3-dc72-44a8-b341-c56787339643 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] Calling method '.version_select at 0x7fc6c1f40f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.294684 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d977a0a3-dc72-44a8-b341-c56787339643 tempest-ServersTestJSON-554844401 tempest-ServersTestJSON-554844401-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889369850" status: 202 len: 0 microversion: 2.1 time: 0.067055 Aug 25 12:50:18.295057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.303844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1085/2229] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889369850 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:18.307987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.309636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.322119 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb92c53f-0162-49aa-88a7-a89f227fa708 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1383 microversion: 2.1 time: 1.305687 Aug 25 12:50:18.323626 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1145/2230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:17 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1383 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:18.325036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.325971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.326879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.328284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.333893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.335467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.341148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.342113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.356638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.357355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.358159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.359224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.360028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.360699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.439210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:18.787553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:18.812515 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25503ff3-407c-4c9f-a938-7b7fc3290a6c tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1273 microversion: 2.1 time: 0.514219 Aug 25 12:50:18.814235 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1086/2231] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1273 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:18.826198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:18.830774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:18.849419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.850426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.851522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:18.853142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:18.854021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:18.855243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.749009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:19.778642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:19.782272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:19.784799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6910ec86-603e-49d0-b31a-42c1e18823f3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.458873 Aug 25 12:50:19.800678 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1146/2232] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:19.824025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:19.825483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:19.838381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.839613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.840708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:19.842333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:19.843397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:19.844452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:20.033161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:20.057990 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9a1815b-5ab5-48fa-aecf-6991343d7a78 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1522 microversion: 2.1 time: 1.241478 Aug 25 12:50:20.060400 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1087/2233] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:18 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1522 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:20.071812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:20.073510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:20.087183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:20.088721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:20.090105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:20.091581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:20.092888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:20.093595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.351926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:21.367483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea707e3b-321d-4d87-ba75-2f501ebcaa76 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1314 microversion: 2.1 time: 1.564547 Aug 25 12:50:21.368639 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1147/2234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:19 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1314 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:21.380367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e911b87-1bd0-41e8-adaf-f0de6f65a7db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '.version_select at 0x7fc6c6d0e280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:21.388526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e911b87-1bd0-41e8-adaf-f0de6f65a7db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.389793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e911b87-1bd0-41e8-adaf-f0de6f65a7db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.391449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e911b87-1bd0-41e8-adaf-f0de6f65a7db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.421420 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e911b87-1bd0-41e8-adaf-f0de6f65a7db tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.049191 Aug 25 12:50:21.423732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1148/2235] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:50:21 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:21.435484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:21.436192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "94d3aef5-5dce-46b9-bfd1-288869dbf5e0"}, {"name": "network-changed", "server_uuid": "0920b852-6d75-4301-ac86-f5421b17a5aa", "tag": "9b871e64-753c-4e68-ac11-633b445b3c30"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:21.452173 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81ca6326-f6cb-472e-bbad-b85d6254adfc tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1502 microversion: 2.1 time: 1.389019 Aug 25 12:50:21.453584 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1088/2236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:20 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1502 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:21.461764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:21.462644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.463345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:21.463635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.464369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.474742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.475515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.477452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.479178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.480646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.481820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.490796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Creating event network-changed:94d3aef5-5dce-46b9-bfd1-288869dbf5e0 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:50:21.492333 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] Creating event network-changed:9b871e64-753c-4e68-ac11-633b445b3c30 for instance 0920b852-6d75-4301-ac86-f5421b17a5aa on n-h2-850468-18 Aug 25 12:50:21.512794 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4a3a4a08-3901-4fe9-87a1-5de20ceab6ad req-1bacaebd-9143-4e40-8e85-4fb72f5048e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086150 Aug 25 12:50:21.514709 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1149/2237] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:21.526359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:21.528924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:21.542594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.544006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.545201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.546902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.548249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.549456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.784517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:21.809949 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9653a1af-1e04-49c1-817f-4a5b508fd93f tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1274 microversion: 2.1 time: 0.354273 Aug 25 12:50:21.824579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1089/2238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:21 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:21.847199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:21.850064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:21.862528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.864514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.865284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:21.866686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:21.867575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:21.868808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.397291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.418984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38662c5b-4126-4918-9d52-308707100ec8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 0.901151 Aug 25 12:50:22.421028 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1150/2239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:21 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:22.431854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:22.433738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:22.451429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.452074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.452694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.454549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:22.455228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:22.455802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:22.924396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.956986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.966690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:22.970777 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b403d107-f8bb-4ad8-aa7c-5566b63dd1a0 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.143806 Aug 25 12:50:22.986237 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1090/2240] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:21 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:23.006868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:23.012424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:23.027356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.029102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.030474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.032545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.033462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.034277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.513034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:23.534869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38ef9c19-627e-4cfd-8424-5f2a8b42e089 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1522 microversion: 2.1 time: 1.111287 Aug 25 12:50:23.539520 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1151/2241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:22 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1522 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:23.588893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:23.590520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:23.608739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.611339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.613276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.616000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.618570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:23.619882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:23.689576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:23.894524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee65d4e7-05e0-486c-8526-2be9c98f1f1d tempest-LiveMigrationTest-99441746 tempest-LiveMigrationTest-99441746-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1536 microversion: 2.1 time: 0.904827 Aug 25 12:50:23.904485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1091/2242] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:22 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1536 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:23.919716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:23.929617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:23.989789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-729b4f6f-e707-444a-9fd7-b4eae062146f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 204 len: 0 microversion: 2.1 time: 0.445263 Aug 25 12:50:23.993705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1152/2243] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:23 2022] DELETE /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:23.995893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:23.999143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.002186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:24.008159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:24.010790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.011894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:24.023380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:24.028662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:24.059269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:24.065337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:24.070521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:24.074808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.077687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:24.082619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:24.086127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:24.089152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.058217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:25.085056 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd7f0285-435a-4af4-83d2-3f122243fb40 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1314 microversion: 2.1 time: 1.177943 Aug 25 12:50:25.091452 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1092/2244] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:23 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:25.113573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:25.115965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:25.132339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.133607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.134323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.136468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.138480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.141558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.169362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:25.201735 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90257dc8-dd48-4195-ab13-d2705dacccfb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 1.203740 Aug 25 12:50:25.216161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1153/2245] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:23 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:25.227149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "3bf0bb65-2dd9-487c-b142-b393435c60b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:25.255651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.256507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.257350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.308025 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] Creating event network-changed:3bf0bb65-2dd9-487c-b142-b393435c60b9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:50:25.318188 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d8038e14-549f-482d-99f6-90fe02ef66cc req-e0515e2e-f3dc-451d-9aab-6d23cb517f4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112045 Aug 25 12:50:25.322193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1154/2246] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:25.333074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:25.334216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:25.348572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.349891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.351094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.352862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.354880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.356505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.430403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:25.656263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-579c1942-05da-4091-b93d-2bf2e866c1bf tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 204 len: 0 microversion: 2.1 time: 0.331311 Aug 25 12:50:25.657778 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1155/2247] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:25 2022] DELETE /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:25.675886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:25.678632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:25.692891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.693492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.694406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:25.696303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:25.697326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:25.698277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.073454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:26.096651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35e50a4f-fe90-4e28-a4ce-9b5a023df3e2 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 1.001267 Aug 25 12:50:26.099180 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1093/2248] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:25 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:26.109964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:26.112018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:26.124606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:26.128889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.131728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.133641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.135582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.137447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.139994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.838955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894b2f7fd28749e786683135eee3e55d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ec5b4d77e549e286137fe2e0574224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:26.868647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5d93fe0-b250-46b4-879d-f9711820c865 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 200 len: 1508 microversion: 2.1 time: 1.208481 Aug 25 12:50:26.881826 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1156/2249] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:25 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 1508 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:26.891260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:26.895506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:26.921505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.922935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.924164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:26.925863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:26.927834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:26.928960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:27.920682 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 12:50:27.921655 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 12:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 (ip 10.222.0.60) !!! Aug 25 12:50:28.408189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.438788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.442708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.445481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7bbd53c8-e582-4c57-928b-579e50c6e560 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.343771 Aug 25 12:50:28.447595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1094/2250] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:26 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:28.457141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0920b852-6d75-4301-ac86-f5421b17a5aa", "name": "network-vif-plugged", "status": "completed", "tag": "9b871e64-753c-4e68-ac11-633b445b3c30"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:28.478391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.479944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.481231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.509822 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] Creating event network-vif-plugged:9b871e64-753c-4e68-ac11-633b445b3c30 for instance 0920b852-6d75-4301-ac86-f5421b17a5aa on n-h2-850468-18 Aug 25 12:50:28.520932 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-91558e24-203e-488f-800d-fec41e0a63ad req-66fadc85-d98f-45d5-8770-3b14507ab171 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069575 Aug 25 12:50:28.523203 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1095/2251] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:28.537651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:28.539418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:28.554901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.556264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.557456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.559146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.560393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.562094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.745709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:28.764771 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f460ab8-6594-409a-891f-2e16d62baf10 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1522 microversion: 2.1 time: 1.880356 Aug 25 12:50:28.781880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1157/2252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:26 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1522 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:28.808011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:28.810035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:28.834611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.836451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.841489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:28.842902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:28.843770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:28.844626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.119662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:30.164491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:30.166476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9d0d6c1-19e5-4a1c-9418-a2d09ffce40a tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1389 microversion: 2.1 time: 1.640261 Aug 25 12:50:30.185767 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1096/2253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:28 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1389 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:30.193630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b99eb9dd-b713-418d-852c-43a06403a920 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1314 microversion: 2.1 time: 1.409511 Aug 25 12:50:30.212853 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1158/2254] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:28 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1314 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:30.230691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:30.233034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:30.238207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:30.243678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:30.254228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.258079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.259439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.261138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.262469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.264927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.289597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.290373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.290909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.291779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:30.295027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:30.297488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:30.354541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:31.212669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:31.224435 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4a6b16b-2802-4e1c-a735-0ffc41b7565f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 1.009329 Aug 25 12:50:31.240603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:31.242018 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1159/2255] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:30 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:31.263296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeee783e-ff2e-4f67-8049-e1bceeb58517", "tag": "b2121c93-f9d8-45a5-9e16-bb7cea99dacd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:31.282168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.283672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.284993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.290219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-110e981f-9bf9-4c16-9726-300587ee5a73 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 1.095289 Aug 25 12:50:31.319076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1097/2256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:30 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:31.325676 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] Creating event network-changed:b2121c93-f9d8-45a5-9e16-bb7cea99dacd for instance eeee783e-ff2e-4f67-8049-e1bceeb58517 on n-h1-850468-18 Aug 25 12:50:31.336208 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-06c729e1-febf-45f0-87c1-551775582b3c req-a568575a-978c-466a-96ad-782b64b4333c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091478 Aug 25 12:50:31.338284 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1160/2257] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:31.343332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:31.344668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.358380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d22e873-b6da-4b40-8add-ee1212c2c7d7", "name": "network-vif-deleted", "tag": "77130e1f-c00e-405d-8f02-aae4a433f682"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:31.375076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.376057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.377151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.378584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.380620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.381521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.385316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.386894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.388224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.439947 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] Creating event network-vif-deleted:77130e1f-c00e-405d-8f02-aae4a433f682 for instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 on n-h1-850468-18 Aug 25 12:50:31.445073 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 HTTP/1.1 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5d22e873-b6da-4b40-8add-ee1212c2c7d7'} Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:31.449023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:31.457882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:31.458896 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e4b36315-7e8e-4bc9-a391-1f7150bb2664 req-a8bb4018-2d42-4818-8767-04ef54159dd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112038 Aug 25 12:50:31.458896 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1161/2258] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:31.461005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:31.463134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-384adbcf-1dda-4a2d-a0b1-caa15f2b0328 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 404 len: 111 microversion: 2.1 time: 0.142093 Aug 25 12:50:31.466503 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1098/2259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:31 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:31.475117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:31.488174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:31.489143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.490104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:31.505012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.505861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.506680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.508076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.509035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.509858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.520776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.522285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.523512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:31.530184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:31.531067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:31.531888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.478127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.519689 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dec643fb-2460-459f-9910-133d055d4e7f tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1502 microversion: 2.1 time: 1.050606 Aug 25 12:50:32.524863 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1099/2260] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:31 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1502 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:32.548334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.548815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.552904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.580062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.581825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.585253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.587089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.590288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:32.591459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.594529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.597552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.601704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5a930d3c-2fc5-4688-a589-544ec8e2771e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.140967 Aug 25 12:50:32.605195 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1162/2261] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:31 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:32.633185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:32.634082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:32.661294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.662263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.669551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:32.673861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:32.674787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:32.675600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.102982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:33.135836 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c951faed-3664-469f-81de-771c8fa2c890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1184 microversion: 2.1 time: 0.607737 Aug 25 12:50:33.142348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1100/2262] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1184 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:33.174267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-398582851", "metadata": {"image_type": "test"}}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:33.187695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:33.211024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.211904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.212730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.225381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.226377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.227169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.295126 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7/action HTTP/1.1 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 111 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-398582851", "metadata": {"image_type": "test"}}} Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5d22e873-b6da-4b40-8add-ee1212c2c7d7', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-398582851', 'metadata': {'image_type': 'test'}}}} Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:50:33.299146 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:33.318397 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:33.323476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:33.326153 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a3a3175-b9fa-4798-8e74-2346c00df50a tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "POST /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7/action" status: 404 len: 111 microversion: 2.1 time: 0.181551 Aug 25 12:50:33.327582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1101/2263] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Aug 25 12:50:33 2022] POST /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7/action => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:33.364775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.366778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:33.392312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.400975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.402013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.403421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:33.409709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:33.410799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:33.885824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:33.916046 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d22f888-0f11-4594-8296-85d533c22907 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1502 microversion: 2.1 time: 1.308993 Aug 25 12:50:33.917154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1163/2264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:32 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1502 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:33.964867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:33.978038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:34.000342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.008594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.009816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.011499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.012780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.017680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.229934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.245587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a29f0475-dac2-4c1b-bc9a-39f67021805d tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 0.899079 Aug 25 12:50:34.247855 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1102/2265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:33 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:34.258417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:34.260392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:34.283499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.285251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.286646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.290226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:34.291907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:34.293322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:34.958566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:34.983905 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8d72ff0-e164-499c-8860-55a6a3ad6602 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 1.026174 Aug 25 12:50:35.008811 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1164/2266] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:33 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:35.023540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-541012268", "metadata": {"image_type": "test"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:35.029227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Failed to fetch instance by id tempest-invalid-1576357009 {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:50:35.030601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance tempest-invalid-1576357009 could not be found. Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/tempest-invalid-1576357009/action HTTP/1.1 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 111 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-541012268", "metadata": {"image_type": "test"}}} Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance tempest-invalid-1576357009 could not be found. Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'tempest-invalid-1576357009', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-541012268', 'metadata': {'image_type': 'test'}}}} Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1576357009 could not be found. Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:35.034265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1576357009 could not be found. Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1576357009 could not be found. Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:35.047129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance tempest-invalid-1576357009 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:35.050046 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e2069f5d-0724-47e9-be57-3bec0556d547 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "POST /compute/v2.1/servers/tempest-invalid-1576357009/action" status: 404 len: 101 microversion: 2.1 time: 0.039194 Aug 25 12:50:35.052014 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1165/2267] 10.222.0.60 () {60 vars in 1249 bytes} [Thu Aug 25 12:50:35 2022] POST /compute/v2.1/servers/tempest-invalid-1576357009/action => generated 101 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:35.060971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e96075-2727-45fd-a801-f31fccb80f26", "tag": "9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4"}, {"server_uuid": "d4dde21b-ecd1-4419-8dfb-7da86c488f62", "name": "network-vif-deleted", "tag": "8b7d2001-4e3b-46cf-8cea-d27d16a4723a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:35.089905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.091359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.092752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.126506 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Creating event network-changed:9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4 for instance d7e96075-2727-45fd-a801-f31fccb80f26 on n-h1-850468-18 Aug 25 12:50:35.128499 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] Creating event network-vif-deleted:8b7d2001-4e3b-46cf-8cea-d27d16a4723a for instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 on n-h2-850468-18 Aug 25 12:50:35.149159 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5ee632a0-390f-49d3-8add-4f2cdcb822ac req-231b2529-e8a9-4cae-8c81-7207eb8e4a87 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093764 Aug 25 12:50:35.151934 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1166/2268] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:35.165659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:35.167742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:35.189002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.194342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.195484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.198028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.198951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.199786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.322937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:35.341648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9433cc99-1127-4333-801e-30fb2eb2f7e2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1516 microversion: 2.1 time: 1.090892 Aug 25 12:50:35.345276 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1103/2269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:34 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1516 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:35.356331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-865092936"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:35.358141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:35.381972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.385604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.397954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:35.399933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:35.402446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:35.403922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.685736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:36.716852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:36.722154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:36.726505 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b0e110d-fe9b-49cb-b8db-9d5af427b4ee tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.571114 Aug 25 12:50:36.729680 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1167/2270] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:35 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:36.750174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Adding security group c956454e-61ec-441d-86a5-c27980ae54bb to port 9b871e64-753c-4e68-ac11-633b445b3c30 Aug 25 12:50:36.767439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:36.770023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:36.791756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.792918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.794680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:36.797379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:36.799119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:36.800847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.037348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:37.070869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f7ddc9d-5592-4227-96b6-bc3fc6c30a6b tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1184 microversion: 2.1 time: 0.333945 Aug 25 12:50:37.085265 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1168/2271] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:36 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1184 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:37.104077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-871835864"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:37.108625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:50:37.109628 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 56 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: {"createImage": {"name": "tempest-test-snap-871835864"}} Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-871835864'}}} Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:37.113158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-53df975f-ea93-452f-bf5d-9d5e5c0a7242 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.031317 Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1169/2272] 10.222.0.60 () {60 vars in 1275 bytes} [Thu Aug 25 12:50:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:37.131723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:37.143209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.144221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.145228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.146604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.147793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.148761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.572440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:37.597342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d6b87a22-87fe-4dd0-95d3-6167a6bd4408 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 0.477096 Aug 25 12:50:37.599893 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1170/2273] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:37 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:37.609781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:37.615858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: bca24a1b-9c01-45fb-b490-d8903940da44] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:37.627475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/bca24a1b-9c01-45fb-b490-d8903940da44/action HTTP/1.1 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 14 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: {"rescue": {}} Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'bca24a1b-9c01-45fb-b490-d8903940da44', 'body': {'rescue': {}}} Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.638876 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:37.649061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 404 to user: Instance bca24a1b-9c01-45fb-b490-d8903940da44 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:37.661317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-006ad90e-f184-4814-bfe8-eb7b2dfa4b70 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/bca24a1b-9c01-45fb-b490-d8903940da44/action" status: 404 len: 111 microversion: 2.1 time: 0.048445 Aug 25 12:50:37.661317 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1171/2274] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:37 2022] POST /compute/v2.1/servers/bca24a1b-9c01-45fb-b490-d8903940da44/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:37.663501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:37.664659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:37.684370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.685501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.687482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:37.691157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:37.692767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:37.693878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.014813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f21c45d0-4312-4f35-a8f8-50cbb3b7447c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/action" status: 202 len: 0 microversion: 2.1 time: 2.666774 Aug 25 12:50:38.020039 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1104/2275] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:35 2022] POST /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/action => generated 0 bytes in 2673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:38.044396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee783e-ff2e-4f67-8049-e1bceeb58517", "name": "network-vif-plugged", "status": "completed", "tag": "b2121c93-f9d8-45a5-9e16-bb7cea99dacd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:38.094131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.094131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.101037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.109323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:38.128898 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] Creating event network-vif-plugged:b2121c93-f9d8-45a5-9e16-bb7cea99dacd for instance eeee783e-ff2e-4f67-8049-e1bceeb58517 on n-h1-850468-18 Aug 25 12:50:38.149815 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-63a4a57f-9051-4bf0-8bc0-76068141d7ce req-e59b1117-7a2d-4510-9f47-5a8d12e44f80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126017 Aug 25 12:50:38.151774 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1105/2276] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:38.170901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1275884504"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:38.187026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 12:50:38.188155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 57 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: {"createImage": {"name": "tempest-test-snap-1275884504"}} Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1275884504'}}} Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:38.194228 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b942d2f1-2613-4e54-a186-f1c5ec3d961f tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.043907 Aug 25 12:50:38.205060 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1106/2277] 10.222.0.60 () {60 vars in 1281 bytes} [Thu Aug 25 12:50:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:38.227014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:38.228402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.284281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.285129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:38.285891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.304017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.306263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.308658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.311189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.321742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04b4f002-deaa-4a70-a025-86aa55a31fe7 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 0.664847 Aug 25 12:50:38.322893 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1172/2278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:37 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:38.355493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:38.356589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.369004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.369884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.370970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.372611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.373475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.374548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.553878 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8540ca61-d389-4d48-b874-780747e0290c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action" status: 202 len: 0 microversion: 2.1 time: 0.335651 Aug 25 12:50:38.556233 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1107/2279] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:38 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:38.571326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1323521307"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:38.574925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:38.598504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.600532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.604145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:38.606666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:38.607683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:38.608594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.016534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:39.105734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:39.116367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:39.124013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e58060ca-f798-4754-9e5c-62a26ead5189 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 0.787218 Aug 25 12:50:39.136420 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1173/2280] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:38 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:39.142328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0920b852-6d75-4301-ac86-f5421b17a5aa", "tag": "9b871e64-753c-4e68-ac11-633b445b3c30"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:39.164922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.165901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.167063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.205229 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] Creating event network-changed:9b871e64-753c-4e68-ac11-633b445b3c30 for instance 0920b852-6d75-4301-ac86-f5421b17a5aa on n-h2-850468-18 Aug 25 12:50:39.224494 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5b5fc693-1628-4089-a153-339fcabb2e94 req-881cc298-dbe2-4006-8bbf-2e830976d371 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095863 Aug 25 12:50:39.230972 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1174/2281] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:39.243629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.245009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:39.259578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.260538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.262200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.263920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.265139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.265831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.283496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Adding security group ac9f4a06-1427-409e-823a-00717387dace to port 9b871e64-753c-4e68-ac11-633b445b3c30 Aug 25 12:50:39.537254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:39.593101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d6bb089-ccfe-4f15-8f57-a7249c784e1d tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1184 microversion: 2.1 time: 0.357514 Aug 25 12:50:39.597243 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1175/2282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:39 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1184 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:39.622737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.624335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:39.648912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.651024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.652440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.654288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.656432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.658532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.722457 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 HTTP/1.1 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5d22e873-b6da-4b40-8add-ee1212c2c7d7'} Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:39.727120 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:39.740467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b1cafaf-6691-43d2-85cf-b81c678d7ba7 tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 404 len: 111 microversion: 2.1 time: 0.129261 Aug 25 12:50:39.748670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1176/2283] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:39 2022] DELETE /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:39.768196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:39.774640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:39.797971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.799342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.800291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:39.811639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:39.812503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:39.814423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:40.663739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:40.692374 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-75e6d287-dfec-444d-ae5d-400a079c7fa6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1521 microversion: 2.1 time: 0.940917 Aug 25 12:50:40.695583 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1177/2284] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:39 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1521 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:40.722879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:40.726560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:40.744610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:40.746769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:40.748046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:40.750249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:40.751696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:40.753577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.705835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7c95de84-1d35-4602-8c46-e679c5736519 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/action" status: 202 len: 0 microversion: 2.1 time: 3.146294 Aug 25 12:50:41.707934 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1108/2285] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:38 2022] POST /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/action => generated 0 bytes in 3150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:41.722287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:41.723811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:41.768421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.769459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.773483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:41.777938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:41.782280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:41.783807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.050785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:42.077292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0017b77d-17f4-49a0-ba00-bb64d7b640b3 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1315 microversion: 2.1 time: 1.378289 Aug 25 12:50:42.080420 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1178/2286] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:40 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:42.092490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:42.095950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] [instance: 5d22e873-b6da-4b40-8add-ee1212c2c7d7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:42.118272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.122656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.124980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.128402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.132269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.133520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.175011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] HTTP exception thrown: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Request method failure captured: Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 HTTP/1.1 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_g27bbut9qEwxynSSxBR8IE6t5VUDNH6VKsRUFkl844CKkJ95tMNtm4A5hiGDMV2XzqkYMo09Ac-HnwNJxvPVKaSaFaEgopuov8eDXQPLHPRKchmBruMOaciT_a6ILaY6Nf8B5Ba8BklwDI790fUmOb3JR8I58QNuXd4Oi9UCMGWY Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/74ec5b4d77e549e286137fe2e0574224"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 74ec5b4d77e549e286137fe2e0574224 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1987993833 Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 894b2f7fd28749e786683135eee3e55d Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesNegativeTestJSON-1987993833-project Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5d22e873-b6da-4b40-8add-ee1212c2c7d7'} Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:42.179130 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] Returning 404 to user: Instance 5d22e873-b6da-4b40-8add-ee1212c2c7d7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:42.188644 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a2b75a1-d7fc-4e3c-a941-bfc254e6a81d tempest-ImagesNegativeTestJSON-1987993833 tempest-ImagesNegativeTestJSON-1987993833-project] 10.222.0.60 "GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7" status: 404 len: 111 microversion: 2.1 time: 0.099585 Aug 25 12:50:42.203707 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1179/2287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:42 2022] GET /compute/v2.1/servers/5d22e873-b6da-4b40-8add-ee1212c2c7d7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:42.227028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:42.228684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:42.255604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.261210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.262421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.263872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.265018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.265828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.653376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:42.687587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00e1a2ca-005d-4389-be21-39eb127c204b tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 0.977646 Aug 25 12:50:42.688721 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1109/2288] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:41 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:42.730987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:42.732261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:42.757541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.758365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.759165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:42.760647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:42.761508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:42.762261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.280597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.308715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-87bbabc3-44d4-43dd-8c4f-119278fa8059 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 200 len: 1184 microversion: 2.1 time: 0.617767 Aug 25 12:50:43.325864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1110/2289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:42 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 1184 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:43.356707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.358148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:43.376242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.377770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.379589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.386273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.387296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.389106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.742848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.788301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.795803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:43.799468 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c8dca24-8ff2-48b8-b9c5-d3458d79009e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.594216 Aug 25 12:50:43.808949 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1180/2290] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:42 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:43.826390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:43.838628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:43.856322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.861317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.865785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:43.867796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:43.871517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:43.876030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.497228 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4229b359-6772-4314-9bfc-1114338a8322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.154674 Aug 25 12:50:44.498647 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1111/2291] 10.222.0.60 () {58 vars in 1293 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa/os-security-groups => generated 1158 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:44.533031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0920b852-6d75-4301-ac86-f5421b17a5aa", "tag": "9b871e64-753c-4e68-ac11-633b445b3c30"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:44.585644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.586666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.589199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.642111 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] Creating event network-changed:9b871e64-753c-4e68-ac11-633b445b3c30 for instance 0920b852-6d75-4301-ac86-f5421b17a5aa on n-h2-850468-18 Aug 25 12:50:44.659850 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-98265aef-fcc8-433f-9c80-186560d35dc9 req-41bbbbe9-7d27-487c-a6b3-784803f7a719 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158397 Aug 25 12:50:44.662224 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1112/2292] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:44.667372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:44.687134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:44.691370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:44.712469 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01d378df-05e5-4338-b80a-0537c30bab38 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1501 microversion: 2.1 time: 0.900899 Aug 25 12:50:44.720054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.721677 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1181/2293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:43 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1501 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:44.723556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.725763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.727488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.728620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.729658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.747163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:44.749045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:44.771191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.784579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.790208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:44.794545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:44.800270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:44.802945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:45.814273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:45.854042 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-54563136-cf4d-4ea8-9c32-73d736bd3cf8 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1502 microversion: 2.1 time: 1.189022 Aug 25 12:50:45.877684 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1113/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:44 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1502 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:45.921433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:45.922435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: d4dde21b-ecd1-4419-8dfb-7da86c488f62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:45.963411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:45.966113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:45.986452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:45.991929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:45.994387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:45.999275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.045202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:46.116449 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b64396f-184a-46bf-80c5-3e2b686f4b19 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 1.392671 Aug 25 12:50:46.123613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1182/2295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:44 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:46.128721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] HTTP exception thrown: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. Aug 25 12:50:46.133532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e79e38ed-8e20-496e-9e9a-41cb385368a6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c2585ee0>, body: {"security_group": {"name": " tempest-securitygroup -994592255 ", "description": "tempest-description-1099572061"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Request method failure captured: Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 HTTP/1.1 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2zL3CfdiUzmpqR9aeCIs3dQJtYkyOp8C-WEKfAfyHYO_VXwQvjxdIbjGnRTWOjRwp30jaiTv60_jQMb6d8vUicL1-I5_aw_mBnB3gf9Ya9Ls-4vDKmQxqgN_7hm20lZWu6uGD7wxc07Gpe7nIfLzYVioZmTOpaJU93w15f7igLKSNI Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveMigrationTest-686342 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6fc96e94ab95423d81077cf6af360715"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveMigrationTest-686342 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveMigrationTest-686342 Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveMigrationTest-686342-project Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: c6be50aac19c400cb9883fcf881ad13c Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveMigrationTest-686342-project Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd4dde21b-ecd1-4419-8dfb-7da86c488f62'} Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.146381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. Aug 25 12:50:46.154843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.157565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Returning 404 to user: Instance d4dde21b-ecd1-4419-8dfb-7da86c488f62 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:46.159601 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b84ef37-e27c-4394-9399-902190ac2d64 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62" status: 404 len: 111 microversion: 2.1 time: 0.279077 Aug 25 12:50:46.168842 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1114/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:45 2022] GET /compute/v2.1/servers/d4dde21b-ecd1-4419-8dfb-7da86c488f62 => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:46.220733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:46.241735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:46.266116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.272718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.276944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.282689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.289587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.291031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.509665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'flavor' on Instance uuid be8f122f-9542-433c-898e-9c3bbe30f239 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:46.594944 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Cannot 'rescue' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state paused Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action HTTP/1.1 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 14 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: {"rescue": {}} Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'rescue' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state paused Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'be8f122f-9542-433c-898e-9c3bbe30f239', 'body': {'rescue': {}}} Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be8f122f-9542-433c-898e-9c3bbe30f239 in vm_state paused. Cannot rescue while the instance is in this state. Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state paused Aug 25 12:50:46.607989 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state paused Aug 25 12:50:46.622339 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:50:46.625050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 409 to user: Cannot 'rescue' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state paused {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:46.631737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61e68d9b-7bfa-4075-bfca-3cf082990111 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action" status: 409 len: 144 microversion: 2.1 time: 0.452803 Aug 25 12:50:46.633142 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1115/2297] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:46 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action => generated 144 bytes in 463 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:50:46.662774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:46.666243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:46.697540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.724839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.726042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:46.727647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:46.731223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:46.732574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.299413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e79e38ed-8e20-496e-9e9a-41cb385368a6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 2.173056 Aug 25 12:50:48.304410 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1183/2298] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:50:46 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:48.339321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:48.341273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:48.389456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:48.404634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.405987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.407660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.418696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.420008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.432625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.442565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.483823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:48.487424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.496037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:48.499953 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a36bc84e-7448-4310-bc17-d32d2c51d183 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.858002 Aug 25 12:50:48.510195 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1116/2299] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:46 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:48.529975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:48.531234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:48.552419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.557448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.564233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.567459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.569140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.570530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.871155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b0f5163-e1c4-4871-becc-5a31f49c5396 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action" status: 202 len: 0 microversion: 2.1 time: 0.358560 Aug 25 12:50:48.883179 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1117/2300] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:48 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:48.905171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e96075-2727-45fd-a801-f31fccb80f26", "name": "network-vif-plugged", "status": "completed", "tag": "9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:48.935779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5716c879-0d11-47c9-a74a-2ceb326ef4cc tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.626981 Aug 25 12:50:48.941152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1184/2301] 10.222.0.60 () {58 vars in 1296 bytes} [Thu Aug 25 12:50:48 2022] DELETE /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517/os-server-password => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:48.962025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:48.962583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:48.964264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:48.965574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:48.966258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:48.998350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.000853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.001370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] Creating event network-vif-plugged:9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4 for instance d7e96075-2727-45fd-a801-f31fccb80f26 on n-h1-850468-18 Aug 25 12:50:49.002660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.004895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:49.007288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:49.010045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:49.017168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-84efbfa8-8d53-4340-80ff-48e0f1668b8d req-4c0e6cb5-510f-4d36-9f7e-d8da5a4d8578 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131017 Aug 25 12:50:49.022885 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1118/2302] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:49.050109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0659cdbb-d1da-4fad-9c5a-e131bfa6963a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6bf2160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:50.622825 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0659cdbb-d1da-4fad-9c5a-e131bfa6963a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8" status: 200 len: 223 microversion: 2.1 time: 1.597342 Aug 25 12:50:50.627785 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1119/2303] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:50:49 2022] GET /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 => generated 223 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:50.639051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:50.640598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:50.675968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.677038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.678173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:50.679870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:50.680759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:50.681496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.394031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:51.437630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01365749-9a6f-466c-a83a-0f2a48f87acd tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1316 microversion: 2.1 time: 2.487698 Aug 25 12:50:51.440190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1185/2304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:48 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1316 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:51.462828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:51.468541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:51.503420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.505604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.506365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.507573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.508452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.509234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.595988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:51.629652 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83d87c96-434a-4a92-a3af-f02755d44057 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.180856 Aug 25 12:50:51.639453 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1186/2305] 10.222.0.60 () {58 vars in 1293 bytes} [Thu Aug 25 12:50:51 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517/os-server-password => generated 16 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:50:51.644309 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aabc0c70-a3ee-4ca9-8285-346c054c4a30 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1516 microversion: 2.1 time: 1.013506 Aug 25 12:50:51.658600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:51.676188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:51.689711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.697146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1120/2306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:50 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1516 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:51.703235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.704220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:51.710599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb2a78ff-71e0-4315-a4a8-4f66fcb2ea09 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6bf2a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:51.713373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:51.714319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:51.715144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:52.601438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:52.696821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:52.717148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:52.719656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b148b56a-8329-4012-a744-d62f8f0a46c6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.078973 Aug 25 12:50:52.743943 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1187/2307] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:51 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:52.782046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:52.782824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:52.852023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:52.855733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:52.857075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:52.873864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:52.886507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:52.887938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.079793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:53.292082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb2a78ff-71e0-4315-a4a8-4f66fcb2ea09 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8" status: 202 len: 0 microversion: 2.1 time: 1.590640 Aug 25 12:50:53.294410 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1121/2308] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:50:51 2022] DELETE /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 => generated 0 bytes in 1596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:50:53.314548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:53.318125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:53.380398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.381173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.381941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.411765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.415397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.420182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.459940 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e36f6af-76f5-4b46-ac07-49a8eb735b35 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 204 len: 0 microversion: 2.1 time: 0.713575 Aug 25 12:50:53.460862 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1188/2309] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:52 2022] DELETE /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:53.482786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2587ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:53.680131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:50:53.681475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:50:53.682590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.682590 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 HTTP/1.1 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3b4f3daa-3c97-4d70-a3aa-30feb514daa8'} Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:50:53.687081 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-43c38965-4e1d-4a08-b4e8-235796b7d70d'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:50:53.696466 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-893b9f08-2dfc-4b8a-9eb8-c3df93cb44d0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8" status: 404 len: 194 microversion: 2.1 time: 0.228880 Aug 25 12:50:53.708982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1189/2310] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:50:53 2022] GET /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 => generated 194 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:50:53.727971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:53.729797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:53.794284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.795911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.802081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:53.804011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:53.818562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:53.819816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:54.868825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:54.903052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e96596b1-046c-44e4-aa22-cb1a0565891f tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1508 microversion: 2.1 time: 1.185145 Aug 25 12:50:54.905555 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1190/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:53 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1508 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:54.927309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:54.932519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6e3f7e5-665f-4af2-844d-db961af53003 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c25f0e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-415401980", "description": "tempest-description-743462815"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:54.967561 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e64fa0e3-be98-4022-affa-52f3b063711a tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1505 microversion: 2.1 time: 1.670936 Aug 25 12:50:54.976367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1122/2312] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:53 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1505 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:54.997959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:54.999062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:55.040257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:55.041243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:55.041855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:55.043570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:55.078581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:55.082778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:56.847224 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6e3f7e5-665f-4af2-844d-db961af53003 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.937211 Aug 25 12:50:56.849417 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1191/2313] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:50:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:56.873679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:56.874471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:56.933085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:56.934005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:56.935152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:56.936838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:56.946774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:56.947964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.055601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6b63b4e1-6b16-4476-a80e-5009b669e5a9 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips" status: 200 len: 109 microversion: 2.1 time: 0.203868 Aug 25 12:50:57.072198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1192/2314] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:50:56 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips => generated 109 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:57.087065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:57.088645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:57.118744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.120106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.121251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.123030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.124342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.127082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.648952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.696523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.701470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:57.704683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e7f29ce-b922-4fdf-a631-58bc7afaf1ce tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.726256 Aug 25 12:50:57.706484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1123/2315] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:50:54 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:50:57.721267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:57.729899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:57.733733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=54 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:57.767484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.770175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.775215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.789724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:57.790648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:57.792192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:57.924517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'flavor' on Instance uuid be8f122f-9542-433c-898e-9c3bbe30f239 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:50:58.065672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:50:58.148726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-862e8c41-7f47-47a9-a713-a7f161fdc226 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action" status: 200 len: 32 microversion: 2.1 time: 0.437930 Aug 25 12:50:58.157205 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1124/2316] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:50:57 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:50:58.172082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5234cb91-c843-431e-b312-8574a8f7ced5 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c6c2d820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-557993435", "description": "tempest-description-927306386"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:50:58.297473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0980cc6c86495aba5b39d385fff41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bd60d684bc43d0be10421f7792266c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:50:58.324077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89ba9aa8-097a-4084-8bd2-28b3159e6411 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 200 len: 1508 microversion: 2.1 time: 1.249571 Aug 25 12:50:58.367613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1193/2317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:57 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 1508 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:50:58.387996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:58.393514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:58.419819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.424640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.426103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.432516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.434152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.435369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.496586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-07e6c939-428b-4428-9f05-e0ad5aa5b5f6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips" status: 200 len: 109 microversion: 2.1 time: 0.126472 Aug 25 12:50:58.498870 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1194/2318] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:50:58 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips => generated 109 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:58.509204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:58.510733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:58.542098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.543742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.546694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.549861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.552198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.555694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.674252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:50:58.942025 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9baea46-4aeb-437e-9310-89ba4b6ab115 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 204 len: 0 microversion: 2.1 time: 0.439204 Aug 25 12:50:58.943234 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1195/2319] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:50:58 2022] DELETE /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:50:58.962731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:58.964636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:58.982648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.983920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.986055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:58.988163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:58.990508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:58.992156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.881170 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5234cb91-c843-431e-b312-8574a8f7ced5 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.719894 Aug 25 12:50:59.883762 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1125/2320] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:50:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:50:59.913294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:50:59.914524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:50:59.954135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:59.958535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:59.959709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:50:59.961454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:50:59.966251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:50:59.967367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.147376 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0281fb82-33f2-4e84-bd1a-b4a39422d0fb tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips/tempest-ServerAddressesTestJSON-1203684000-network" status: 200 len: 94 microversion: 2.1 time: 0.261045 Aug 25 12:51:00.165537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1126/2321] 10.222.0.60 () {58 vars in 1401 bytes} [Thu Aug 25 12:50:59 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26/ips/tempest-ServerAddressesTestJSON-1203684000-network => generated 94 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:51:00.202666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:00.205238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:00.246791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.247569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.248408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:00.249756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:00.250638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:00.255691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.790870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:01.817265 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e38ad33d-cde8-4f0f-bde1-1de931d8a2a1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 2.870019 Aug 25 12:51:01.846209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1196/2322] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:50:58 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:01.875561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:01.876770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:01.887663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.888407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.889203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:01.890409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:01.891077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:01.891715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.143628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:02.175022 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9554377a-f219-4800-ac00-f2a10b13c178 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 200 len: 1599 microversion: 2.1 time: 0.325599 Aug 25 12:51:02.182043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1197/2323] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:01 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 1599 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:02.198443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:02.208799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] [instance: eeee783e-ff2e-4f67-8049-e1bceeb58517] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:02.224218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.225444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.226524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.228177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:02.229279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:02.230279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:02.280322 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] HTTP exception thrown: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Request method failure captured: Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 HTTP/1.1 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_2NP-EJeKS41reprgP9CgOjDquu6cnlJwtV1LjCOCgjyUVW-OuYZha5IR74PmKRD5gr2GMp8bz4Ipy14VL2lQkQqwlU2SYfO0HYKTUeJhh6X2p_zq5G-MaFFLsjuzR3CKQ60On31MQLS6pzV_9uE-mKTW8Ws0rWgrfufNtU6wf2ak Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 81bd60d684bc43d0be10421f7792266c Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerPasswordTestJSON-1119429090 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_81bd60d684bc43d0be10421f7792266c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/81bd60d684bc43d0be10421f7792266c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81bd60d684bc43d0be10421f7792266c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/81bd60d684bc43d0be10421f7792266c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerPasswordTestJSON-1119429090 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 81bd60d684bc43d0be10421f7792266c Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1119429090 Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerPasswordTestJSON-1119429090-project Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9d0980cc6c86495aba5b39d385fff41d Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerPasswordTestJSON-1119429090-project Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'eeee783e-ff2e-4f67-8049-e1bceeb58517'} Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:02.292816 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. Aug 25 12:51:02.300590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:02.304093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] Returning 404 to user: Instance eeee783e-ff2e-4f67-8049-e1bceeb58517 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:02.306317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7973764d-8216-4adc-84cd-74260b997b68 tempest-ServerPasswordTestJSON-1119429090 tempest-ServerPasswordTestJSON-1119429090-project] 10.222.0.60 "GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517" status: 404 len: 111 microversion: 2.1 time: 0.121775 Aug 25 12:51:02.317719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1198/2324] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:02 2022] GET /compute/v2.1/servers/eeee783e-ff2e-4f67-8049-e1bceeb58517 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:02.328662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbf24591-f357-4bf0-b00d-4b1160b65ebb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c1ffaaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-586272547", "description": "tempest-description-496070324"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:03.195140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:03.246845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:03.255763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:03.258872 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1878fabf-998e-4ba8-a347-30e0f32677d8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 3.091445 Aug 25 12:51:03.278969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1127/2325] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:00 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 3111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:03.320695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:03.325316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:03.344466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:03.346575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:03.350554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:03.353693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:03.355498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:03.361524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:03.446485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:51:03.865598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21f98924-4f31-4c35-9eed-104512d430d6 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 204 len: 0 microversion: 2.1 time: 0.584366 Aug 25 12:51:03.867286 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1128/2326] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:03 2022] DELETE /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:03.899293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeee783e-ff2e-4f67-8049-e1bceeb58517", "name": "network-vif-deleted", "tag": "b2121c93-f9d8-45a5-9e16-bb7cea99dacd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:03.974692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:03.985580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:03.989630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.060738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] Creating event network-vif-deleted:b2121c93-f9d8-45a5-9e16-bb7cea99dacd for instance eeee783e-ff2e-4f67-8049-e1bceeb58517 on n-h1-850468-18 Aug 25 12:51:04.084832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d403fe9e-ec53-43e4-ab9f-e48a7c312084 req-aad3ea96-e36b-46e0-800c-8bd1dbfb52af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214833 Aug 25 12:51:04.090031 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1129/2327] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:04.095728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efc9251-2cc1-4c76-9083-7a2e66a0b2bc", "name": "network-vif-deleted", "tag": "b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:04.111147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.111940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.112711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.146800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] Creating event network-vif-deleted:b9a7148a-4d95-47a5-874b-3d8cb6b7e0ef for instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc on n-h2-850468-18 Aug 25 12:51:04.187976 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ed28e487-d4f8-43cd-8c19-e02617f31fd2 req-707e165a-3272-46c9-a7df-acdbbc7f3d11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095396 Aug 25 12:51:04.189306 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1130/2328] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:04.223765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:04.229234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:04.251063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.261503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.265762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:04.267953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:04.269306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:04.271513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.535123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:05.558572 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ac98710-c6ca-475b-a0f9-9a68991fc474 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 1.357688 Aug 25 12:51:05.560039 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1131/2329] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:04 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:05.568905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:05.570256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:05.573146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fbf24591-f357-4bf0-b00d-4b1160b65ebb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 3.252678 Aug 25 12:51:05.574327 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1199/2330] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:51:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 3256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:05.582954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.584364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.585451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.586930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.587880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.588618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.590016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:05.591226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:05.618828 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] HTTP exception thrown: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Request method failure captured: Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc HTTP/1.1 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2zL3CfdiUzmpqR9aeCIs3dQJtYkyOp8C-WEKfAfyHYO_VXwQvjxdIbjGnRTWOjRwp30jaiTv60_jQMb6d8vUicL1-I5_aw_mBnB3gf9Ya9Ls-4vDKmQxqgN_7hm20lZWu6uGD7wxc07Gpe7nIfLzYVioZmTOpaJU93w15f7igLKSNI Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6fc96e94ab95423d81077cf6af360715"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-LiveMigrationTest-686342 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-LiveMigrationTest-686342-project Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: c6be50aac19c400cb9883fcf881ad13c Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-LiveMigrationTest-686342-project Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1efc9251-2cc1-4c76-9083-7a2e66a0b2bc'} Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.625169 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. Aug 25 12:51:05.630296 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:05.630768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.630768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.630768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.631420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.632520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.633149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Returning 404 to user: Instance 1efc9251-2cc1-4c76-9083-7a2e66a0b2bc could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:05.634311 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36f767da-cb4d-40ad-9e2d-6691e614aab2 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc" status: 404 len: 111 microversion: 2.1 time: 0.072353 Aug 25 12:51:05.634769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.635467 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1132/2331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:05 2022] GET /compute/v2.1/servers/1efc9251-2cc1-4c76-9083-7a2e66a0b2bc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:05.643564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:05.645381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:05.656742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.657866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.658858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:05.660962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:05.662011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:05.663230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:06.766701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:06.778275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:06.783024 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-145b19e3-18bc-43ad-a509-cc29b2850d03 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1511 microversion: 2.1 time: 1.205835 Aug 25 12:51:06.785733 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1200/2332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:05 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1511 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:06.791484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:06.793472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-756508db-625a-4d8a-83d6-993df3d364dd tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c1ffa430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:06.819722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:06.821917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:06.826981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-720c4c17-f1ab-444c-9f30-f47be54be01d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.186139 Aug 25 12:51:06.827659 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1133/2333] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:05 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:06.834612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38d29d33-2aee-490f-afdb-70a6a1c8e57c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '.version_select at 0x7fc6c6bf3c10>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:07.057915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38d29d33-2aee-490f-afdb-70a6a1c8e57c tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615614537" status: 202 len: 0 microversion: 2.1 time: 0.222795 Aug 25 12:51:07.071976 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1134/2334] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:51:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615614537 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:07.112846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:07.122253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:07.164860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:07.167954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:07.172096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:07.173632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:07.178631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:07.180681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.201355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:08.217208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f89458d2-a0ac-477f-a9b1-cbb06bdaaed4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 1.139712 Aug 25 12:51:08.218743 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1135/2335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:07 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:08.229361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:08.230987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:08.247348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.248789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.250438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.252941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.254222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.256568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.809453 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-756508db-625a-4d8a-83d6-993df3d364dd tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 2.019885 Aug 25 12:51:08.814460 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1201/2336] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:51:06 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:08.829647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:08.830668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:08.863881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.865805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.872506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:08.874348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:08.877088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:08.878717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:09.671992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:09.701569 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4bfb35a6-42f5-45ea-8ea0-0aa585715802 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1511 microversion: 2.1 time: 1.479332 Aug 25 12:51:09.704575 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1136/2337] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:08 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1511 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:09.717630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eda6f0e-5ed4-4cd4-9e22-21a11e235d1b tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6bf25e0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:10.669756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:10.708136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:10.724215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:10.737646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7fa3dd32-dff7-497a-8e7f-6f624b506b7b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.916224 Aug 25 12:51:10.753185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1202/2338] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:08 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:10.780612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:10.781411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:10.821419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:10.822440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:10.823244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:10.825040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:10.827478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:10.835352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:11.822538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9eda6f0e-5ed4-4cd4-9e22-21a11e235d1b tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65" status: 202 len: 0 microversion: 2.1 time: 2.114524 Aug 25 12:51:11.826865 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1137/2339] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:51:09 2022] DELETE /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65 => generated 0 bytes in 2121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:11.866169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:11.868462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:11.976448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:11.981074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:11.982993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:11.997472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.014660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.021413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.024688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-86e1a0e8-6f94-4284-a2a2-011107f18ad1 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 1.262138 Aug 25 12:51:12.024991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.025481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1203/2340] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:10 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:12.083424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:12.085571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:12.131742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.137249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.138816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.145227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.150951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.152848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.191955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:51:12.331267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.333516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.335081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.337659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lazy-loading 'fault' on Instance uuid d7e96075-2727-45fd-a801-f31fccb80f26 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:51:12.542294 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e22980e2-50a6-4454-a26f-8f9f085d2890 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 204 len: 0 microversion: 2.1 time: 0.711768 Aug 25 12:51:12.546416 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1138/2341] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:11 2022] DELETE /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:12.576011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e96075-2727-45fd-a801-f31fccb80f26", "name": "network-vif-deleted", "tag": "9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:12.615471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.619793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.625447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.689722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] Creating event network-vif-deleted:9ba6b87d-0237-4f65-a6ec-1d419fa3ebb4 for instance d7e96075-2727-45fd-a801-f31fccb80f26 on n-h1-850468-18 Aug 25 12:51:12.721196 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8a8f9fdd-8489-4f52-92c5-a09779b343de req-c0140f47-f8b5-479a-904d-0b985ad6157a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168502 Aug 25 12:51:12.727847 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1139/2342] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:12.752002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:12.761573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:12.776836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.778730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.779847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:12.782779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:12.783967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:12.786753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:13.211819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b29d56aaa4465f9464b6a5ee0ffd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af16ecd8561848169cdb81235a034b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:13.242204 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ad18aba-26d5-413d-9e12-9aaf3184a864 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 200 len: 1306 microversion: 2.1 time: 1.188335 Aug 25 12:51:13.243275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1204/2343] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:12 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 1306 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:13.281488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c25e05e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:13.432993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:51:13.434516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:51:13.435932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.435932 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65 HTTP/1.1 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'aec5b1b3-31db-4980-bf27-66f68ab5ac65'} Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:51:13.440744 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] Aug 25 12:51:13.457290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:13.469105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:51:13.469105 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-416d5c01-31d6-4db2-ba65-57ac018d30e0'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:13.471704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38a76410-1cb9-4b0c-8152-f3029c68d0c9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65" status: 404 len: 194 microversion: 2.1 time: 0.219481 Aug 25 12:51:13.473311 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1205/2344] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:51:13 2022] GET /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65 => generated 194 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:13.499707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:13.505450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:13.543819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:13.547806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:13.549925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:13.555589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:13.559293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:13.560721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:14.531727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:14.582861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:14.601275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:14.607528 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-434c2de5-7d3b-49a6-a95f-84616b2c765d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.873592 Aug 25 12:51:14.610719 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1140/2345] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:12 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:14.639690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:14.641176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:14.659733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:14.661685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:14.664454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:14.666739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:14.668032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:14.669324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:15.109923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:15.165160 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a326517-765a-4016-b3aa-eaf6378423f3 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1485 microversion: 2.1 time: 1.685874 Aug 25 12:51:15.171523 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1206/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:13 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1485 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:15.222483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-66c55e35-4b81-4919-9654-f655e237158d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6aebca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:15.715213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:15.765328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-984bc813-a469-4ab3-a4fc-945cfbdb02d2 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 1.152120 Aug 25 12:51:15.773953 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1141/2347] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:14 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:15.799415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:15.808013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] [instance: d7e96075-2727-45fd-a801-f31fccb80f26] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:15.838742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:15.840104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:15.844979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:15.847850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:15.852485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:15.853852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:15.949199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] HTTP exception thrown: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Request method failure captured: Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 HTTP/1.1 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_7lKhhYIJbir4T0uTWqmfsYk3qLTL2JvhTQlkwyKV7W7cYbJqxBKJmdG4Dc9EAIBVSYqRfQIgmIQISORI1NZ60QV6Qzy8eyWyPXQlCCVQFQ2vz7JZH5ZiaqIetS6vCJ0Hp3xldmPHyqXpPnoMUIpqZfgQsAZ-c81QExCRJNrbyANA Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af16ecd8561848169cdb81235a034b66 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerAddressesTestJSON-2002747411 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af16ecd8561848169cdb81235a034b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af16ecd8561848169cdb81235a034b66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af16ecd8561848169cdb81235a034b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af16ecd8561848169cdb81235a034b66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerAddressesTestJSON-2002747411 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af16ecd8561848169cdb81235a034b66 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2002747411 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerAddressesTestJSON-2002747411-project Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 94b29d56aaa4465f9464b6a5ee0ffd84 Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerAddressesTestJSON-2002747411-project Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd7e96075-2727-45fd-a801-f31fccb80f26'} Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:15.953544 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] Returning 404 to user: Instance d7e96075-2727-45fd-a801-f31fccb80f26 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:15.964901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31addaf9-cfbc-4fc4-ae54-76ca4186cc46 tempest-ServerAddressesTestJSON-2002747411 tempest-ServerAddressesTestJSON-2002747411-project] 10.222.0.60 "GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26" status: 404 len: 111 microversion: 2.1 time: 0.180271 Aug 25 12:51:15.975287 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1142/2348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:15 2022] GET /compute/v2.1/servers/d7e96075-2727-45fd-a801-f31fccb80f26 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:15.986007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "3bf0bb65-2dd9-487c-b142-b393435c60b9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:16.007579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.008741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.009694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.040063 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] Creating event network-vif-plugged:3bf0bb65-2dd9-487c-b142-b393435c60b9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:16.052149 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6c12242d-63ff-470d-bcc9-c2c86305c631 req-8e1279d9-b612-4f1e-a04d-9c8651f0ccbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074227 Aug 25 12:51:16.053687 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1143/2349] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:16.066437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:16.068839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:16.085105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.086254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.087622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:16.089487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:16.090555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:16.091483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:18.309659 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-66c55e35-4b81-4919-9654-f655e237158d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3" status: 202 len: 0 microversion: 2.1 time: 3.136291 Aug 25 12:51:18.311952 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1207/2350] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:51:15 2022] DELETE /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3 => generated 0 bytes in 3140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:18.324340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:18.331202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:18.379684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:18.380630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:18.381475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:18.382947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:18.384912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:18.386186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:18.941922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:18.949972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:18.998969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.013329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.017854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:19.053184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7497b19e-996c-4274-ad40-7d8b89adfefd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.962742 Aug 25 12:51:19.054732 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1144/2351] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:16 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:19.073000 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d61ce4d-1b11-4254-9535-e928a6c03cb8 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 200 len: 1443 microversion: 2.1 time: 0.758491 Aug 25 12:51:19.088792 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1208/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:18 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 1443 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:19.113170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c269e820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:19.119855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:19.129567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:19.170926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.171915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.172840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.174238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.203412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.204283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.329905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:51:19.330979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group d0b791e3-b759-4078-b53f-90379b8e00c3 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:51:19.333089 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.333089 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3 HTTP/1.1 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd0b791e3-b759-4078-b53f-90379b8e00c3'} Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:51:19.350195 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] Aug 25 12:51:19.357985 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:19.368151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:51:19.368151 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-62446dd3-2b0f-45ae-87ed-6ab7af4d40c4'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:19.368151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-369243de-fd55-4ced-8b64-eda68051db4a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3" status: 404 len: 194 microversion: 2.1 time: 0.275333 Aug 25 12:51:19.368151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1209/2353] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:51:19 2022] GET /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3 => generated 194 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:19.395074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "866fcb99-5974-4d0f-84c9-547637dd0877"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:19.437182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:19.465214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.471566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.482933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.532163 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] Creating event network-vif-plugged:866fcb99-5974-4d0f-84c9-547637dd0877 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:19.555065 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4746f0e4-275c-485c-a248-c7254c69c801 req-80c3578a-866b-44ee-89c9-610e3893e9fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175499 Aug 25 12:51:19.558077 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1210/2354] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:19.590673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f9e89-a8ea-4996-86d4-cb44e3943dc0", "name": "network-vif-deleted", "tag": "4c6b387d-49d6-4247-a602-e24476e62f74"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:19.633064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:19.639979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:19.652895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:19.701716 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] Creating event network-vif-deleted:4c6b387d-49d6-4247-a602-e24476e62f74 for instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 on n-h1-850468-18 Aug 25 12:51:19.717409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-05289e06-d6b6-4e27-b894-d663930f3634 req-370542b7-e942-4665-8abe-d926673b37ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153688 Aug 25 12:51:19.718756 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1211/2355] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:19.739569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3347b151-d3c7-47d2-8a3b-bd8201e6fc44 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c269e8b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:21.254198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:21.290015 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee5e5bf0-cd87-4d2b-bd47-02acdea5ceba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 2.217080 Aug 25 12:51:21.298662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1145/2356] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:19 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:21.322950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:21.329335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:21.364746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.366534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.368428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.370296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.371666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.372871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.524427 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3347b151-d3c7-47d2-8a3b-bd8201e6fc44 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768" status: 202 len: 0 microversion: 2.1 time: 1.803284 Aug 25 12:51:21.525638 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1212/2357] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:51:19 2022] DELETE /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768 => generated 0 bytes in 1806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:21.543476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:21.545631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:21.576459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.577877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.579582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.581412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:21.583499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:21.590171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:21.671756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] HTTP exception thrown: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Request method failure captured: Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 HTTP/1.1 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2zL3CfdiUzmpqR9aeCIs3dQJtYkyOp8C-WEKfAfyHYO_VXwQvjxdIbjGnRTWOjRwp30jaiTv60_jQMb6d8vUicL1-I5_aw_mBnB3gf9Ya9Ls-4vDKmQxqgN_7hm20lZWu6uGD7wxc07Gpe7nIfLzYVioZmTOpaJU93w15f7igLKSNI Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6fc96e94ab95423d81077cf6af360715"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveMigrationTest-686342 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveMigrationTest-686342-project Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: c6be50aac19c400cb9883fcf881ad13c Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveMigrationTest-686342-project Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '4b6f9e89-a8ea-4996-86d4-cb44e3943dc0'} Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.676525 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.687317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Returning 404 to user: Instance 4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:21.710661 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-832ce3da-2aa9-477b-bd73-e9b5a2962f54 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0" status: 404 len: 111 microversion: 2.1 time: 0.170584 Aug 25 12:51:21.711759 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1213/2358] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:21 2022] GET /compute/v2.1/servers/4b6f9e89-a8ea-4996-86d4-cb44e3943dc0 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:21.795339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c269e5e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:21.935921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:51:21.937138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:51:21.938122 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.938122 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768 HTTP/1.1 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2b3826bd-dd3a-4fdd-9652-3124dc0bd768'} Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:51:21.946213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] Aug 25 12:51:21.952922 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:21.984651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:51:21.984651 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-c4b15b80-5732-44de-9b6e-7808907c4ed0'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:21.986485 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-631d1427-a7de-4532-9bc1-0f70ef1b2549 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768" status: 404 len: 194 microversion: 2.1 time: 0.238763 Aug 25 12:51:21.987549 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1214/2359] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:51:21 2022] GET /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768 => generated 194 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:22.022071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:22.022851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:22.052957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:22.055330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:22.056631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:22.058435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:22.059802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:22.061664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:22.130461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:51:22.352786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95ef2761-033b-44fe-bc74-2cd125f38345 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 204 len: 0 microversion: 2.1 time: 0.361953 Aug 25 12:51:22.358900 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1215/2360] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:51:21 2022] DELETE /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:51:22.379039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "f7963a7b-7a3d-40a4-af83-c475625d89d9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:22.432212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:22.437543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.441090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:22.445343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:22.511600 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] Creating event network-vif-plugged:f7963a7b-7a3d-40a4-af83-c475625d89d9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:22.518770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.532483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bd21b6cb-8265-45fb-91ba-5e7bff658388 req-fb38e74c-2802-4a47-a2a7-16b1db100a73 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170449 Aug 25 12:51:22.534361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:22.539412 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1216/2361] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:22.542780 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f55198d5-32ef-4b09-a5d8-90039699ca6c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 1.240547 Aug 25 12:51:22.544172 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1146/2362] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:21 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:22.569860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d28cf5f-ce74-4233-983d-0fc0dc0994e2 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c1ffaa60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:22.646585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:22.655398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:22.708940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:22.721487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:22.723739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:22.728872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:22.735626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:22.740092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:23.788075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:23.816225 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c11b8a5a-5b89-4092-acd5-666e7b8a924a tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1502 microversion: 2.1 time: 1.256398 Aug 25 12:51:23.818099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1147/2363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:22 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1502 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:23.827206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:23.828923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:23.841139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.842603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.843775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:23.845518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:23.846724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:23.852812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:24.691313 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d28cf5f-ce74-4233-983d-0fc0dc0994e2 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 2.143892 Aug 25 12:51:24.693514 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1217/2364] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:51:22 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:24.701643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:24.713231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:24.755395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:24.756936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:24.758695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:24.760518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:24.761898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:24.773813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:24.939567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6be50aac19c400cb9883fcf881ad13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc96e94ab95423d81077cf6af360715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:24.990311 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0754f9b-07d7-4ebb-ae48-2783be02c7ce tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 200 len: 1500 microversion: 2.1 time: 1.168050 Aug 25 12:51:24.991552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1148/2365] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:23 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 1500 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:25.015701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2071f650-78d0-4280-ac41-9e99242fcbc1"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:25.028847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:25.079789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:25.082057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:25.085251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:25.087419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:25.091094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:25.096050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:25.220633 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Cannot 'attach_volume' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state rescued Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/os-volume_attachments HTTP/1.1 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 74 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: {"volumeAttachment": {"volumeId": "2071f650-78d0-4280-ac41-9e99242fcbc1"}} Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'attach_volume' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state rescued Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'be8f122f-9542-433c-898e-9c3bbe30f239', 'body': {'volumeAttachment': {'volumeId': '2071f650-78d0-4280-ac41-9e99242fcbc1'}}} Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be8f122f-9542-433c-898e-9c3bbe30f239 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 25 12:51:25.224427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state rescued Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state rescued Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 409 to user: Cannot 'attach_volume' instance be8f122f-9542-433c-898e-9c3bbe30f239 while it is in vm_state rescued {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:25.230965 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-16b09360-b99d-4f7c-a30f-655172cb7257 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.233325 Aug 25 12:51:25.236985 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1149/2366] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:51:24 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/os-volume_attachments => generated 152 bytes in 244 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:51:25.244675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1309482629", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "49468899-6dca-4598-9d96-e2c1b7219b70"}, {"uuid": "53171b5d-92a2-4f02-87e0-84cff5d522a5"}, {"uuid": "49468899-6dca-4598-9d96-e2c1b7219b70"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:25.438602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] validate_networks() for [('49468899-6dca-4598-9d96-e2c1b7219b70', None, None, None, None, None), ('53171b5d-92a2-4f02-87e0-84cff5d522a5', None, None, None, None, None), ('49468899-6dca-4598-9d96-e2c1b7219b70', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:51:26.676438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:26.734526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:26.759976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:26.775789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68bcbe59-296c-4817-9714-5ef79ee1c2cc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.078780 Aug 25 12:51:26.779526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1218/2367] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:24 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:26.799927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "d0b7166a-7415-4c83-aec2-68510b37e32b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:26.829050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:26.830107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:26.831046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:26.873531 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] Creating event network-vif-plugged:d0b7166a-7415-4c83-aec2-68510b37e32b for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:26.896756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8fdf1bad-31ba-4917-a5b7-a935a77bca37 req-f550fcf8-295d-4688-8151-a2a4edb7fb40 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109740 Aug 25 12:51:26.914115 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1219/2368] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:26.943010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e65ce10-ac61-4344-8ffb-c5f7d78123e5 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c2c9f940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-472745710", "description": "tempest-description-1172511587"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:29.478980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e65ce10-ac61-4344-8ffb-c5f7d78123e5 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.560582 Aug 25 12:51:29.495966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1220/2369] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:51:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:29.507306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:29.509062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:29.532587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.534181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.535554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.537636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.539526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.540704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.759779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3587441d-0207-4a8c-9d5c-c3e69aa40785 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action" status: 202 len: 0 microversion: 2.1 time: 0.260431 Aug 25 12:51:29.762804 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1221/2370] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:51:29 2022] POST /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:51:29.780090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbac45bc-3c6e-462b-8a42-5c2a08124143", "name": "network-vif-deleted", "tag": "eacacf3e-0733-47d9-aa83-30888618a4be"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:29.810285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.811765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.813787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.853411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] Creating event network-vif-deleted:eacacf3e-0733-47d9-aa83-30888618a4be for instance dbac45bc-3c6e-462b-8a42-5c2a08124143 on n-h2-850468-18 Aug 25 12:51:29.873353 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3c011155-ab03-4d60-ba6e-56ce99d4669c req-bb921d86-5f45-4112-86a8-18c69252d0ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101971 Aug 25 12:51:29.877538 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1222/2371] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:29.901285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:29.911838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] [instance: dbac45bc-3c6e-462b-8a42-5c2a08124143] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:29.933284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.934551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.935413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:29.939226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:29.941762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:29.952959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:30.008478 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] HTTP exception thrown: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Request method failure captured: Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 HTTP/1.1 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2zL3CfdiUzmpqR9aeCIs3dQJtYkyOp8C-WEKfAfyHYO_VXwQvjxdIbjGnRTWOjRwp30jaiTv60_jQMb6d8vUicL1-I5_aw_mBnB3gf9Ya9Ls-4vDKmQxqgN_7hm20lZWu6uGD7wxc07Gpe7nIfLzYVioZmTOpaJU93w15f7igLKSNI Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6fc96e94ab95423d81077cf6af360715"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6fc96e94ab95423d81077cf6af360715"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-LiveMigrationTest-686342 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6fc96e94ab95423d81077cf6af360715 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-LiveMigrationTest-686342 Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-LiveMigrationTest-686342-project Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: c6be50aac19c400cb9883fcf881ad13c Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-LiveMigrationTest-686342-project Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'dbac45bc-3c6e-462b-8a42-5c2a08124143'} Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:30.016684 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. Aug 25 12:51:30.025705 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:51:30.028853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] Returning 404 to user: Instance dbac45bc-3c6e-462b-8a42-5c2a08124143 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:51:30.039079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-093fd2dd-3f18-4aae-a63e-e2d56cc5a633 tempest-LiveMigrationTest-686342 tempest-LiveMigrationTest-686342-project] 10.222.0.60 "GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143" status: 404 len: 111 microversion: 2.1 time: 0.146037 Aug 25 12:51:30.041417 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1223/2372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:29 2022] GET /compute/v2.1/servers/dbac45bc-3c6e-462b-8a42-5c2a08124143 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:51:30.054054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:30.055853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:30.070327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:30.072667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:30.073852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:30.075557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:30.076864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:30.078173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:32.475635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.518635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.522581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:32.536161 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-418e5d6c-0ba2-4fa2-b25e-4bff4a72253b tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.481281 Aug 25 12:51:32.551940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1224/2373] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:30 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:32.879396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:51:32.880238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:51:32.881521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:51:32.882364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:51:32.883509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:51:32.903065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:32.967289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:32.971437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:32.977000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:32.980996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:32.989619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:32.989619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:33.092285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Getting quotas for project bd445c58c0b544a480e2aa0c5afd1cf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:33.111692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Getting quotas for user 6fe40285fc75459f9d8549db4f166b51 and project bd445c58c0b544a480e2aa0c5afd1cf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:33.198546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:51:33.213234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:51:33.428333 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ff89424f-7595-4375-9244-1352206cf25d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.188406 Aug 25 12:51:33.430289 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1150/2374] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 8193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:51:33.541033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2112608186", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "fabf892b-f355-4faa-8957-7370362aa48d"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:33.899076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "94d3aef5-5dce-46b9-bfd1-288869dbf5e0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:33.928153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] validate_networks() for [('fabf892b-f355-4faa-8957-7370362aa48d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:51:33.950809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:33.951416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:33.951869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:34.049494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] Creating event network-vif-plugged:94d3aef5-5dce-46b9-bfd1-288869dbf5e0 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:34.066310 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b96a5e03-acf0-43e0-8137-9a92c3071e44 req-b898331a-543a-4ac5-b9de-317eabdf9af1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.633912 Aug 25 12:51:34.075008 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1151/2375] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:34.102722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b9be0bc-4071-4f8c-a035-b79db2e6398d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c6c43310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-338509740", "description": "tempest-description-1396821994"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:37.609824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b9be0bc-4071-4f8c-a035-b79db2e6398d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.532030 Aug 25 12:51:37.614520 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1152/2376] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:51:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:37.630728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:37.638174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:37.680272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.682179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.689670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:37.693612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:37.695553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:37.699740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:37.961034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:51:37.962272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:51:37.964150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:51:37.964942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:51:37.965670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:51:38.023653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:38.027942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:38.040538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:38.040538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:38.040538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:38.040538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:38.231083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:38.243439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for user 8a26316f4ba04e8598ae218980ef72f0 and project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:38.314383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:51:38.321955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:51:38.532608 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b530bbc7-e7a7-4a11-a5ce-37775cafc657 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.975869 Aug 25 12:51:38.539299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1225/2377] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 5986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:51:38.573345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:38.580202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:38.646639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:38.647467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:38.648298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:38.656751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:38.657768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:38.658593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:38.679472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:39.493005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:39.533310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca13999a-2397-4d5e-b47d-5cd0358c2c06 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1271 microversion: 2.1 time: 0.991528 Aug 25 12:51:39.534413 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1226/2378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:38 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1271 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:39.570316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:39.573984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:39.596721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:39.603024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:39.603890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:39.605339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:39.608642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:39.612196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:40.107632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:40.145529 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e705f679-8c1c-497b-9550-db38ae1e3f71 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1510 microversion: 2.1 time: 2.528087 Aug 25 12:51:40.154631 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1153/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:37 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1510 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:40.194581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "86ad8493-c37f-44ec-b0f6-8fccbbc756cd"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-plugged", "status": "completed", "tag": "3d99ee29-74a8-4303-a784-e96e221ba3f3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:40.282710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:40.283761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:40.285222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:40.347979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Creating event network-vif-plugged:86ad8493-c37f-44ec-b0f6-8fccbbc756cd for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:40.348693 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] Creating event network-vif-plugged:3d99ee29-74a8-4303-a784-e96e221ba3f3 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:51:40.372093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2ee1cf04-6f7b-4f9c-85ef-f87e4dc57a5b req-006bb2ef-f26b-4c3b-8ec0-2edc1af90c0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.211102 Aug 25 12:51:40.382462 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1154/2380] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:40.399911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1451918984", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "43830c38-a8ce-46a3-987b-c1e3ab9df63c"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:40.744816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] validate_networks() for [('43830c38-a8ce-46a3-987b-c1e3ab9df63c', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:51:41.928758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:41.973378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:41.983548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:41.990563 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3835d2c-939b-4712-b1d7-2ea3f9e289a9 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1879 microversion: 2.32 time: 2.440578 Aug 25 12:51:41.995734 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1227/2381] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:39 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1879 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:42.014946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:42.019771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:42.063338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:42.064356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:42.065215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:42.066706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:42.067654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:42.069905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:42.531063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:42.564989 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3452bab-23cc-4e64-915b-b069a8b0f9c1 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1277 microversion: 2.1 time: 0.559306 Aug 25 12:51:42.566700 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1228/2382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:41 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1277 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:42.594582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:42.596874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:42.632502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:42.636143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:42.639158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:42.651063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:42.652439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:42.653615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:42.948537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:42.978864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-87b07bb6-cc3a-4fae-838e-4a79e6ed5def tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1271 microversion: 2.1 time: 0.402978 Aug 25 12:51:42.994072 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1229/2383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:42 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:43.002894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:43.004526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:43.031260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:43.041927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:43.046465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:43.047642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:43.051871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:43.054910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:43.055592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:43.152006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:45.115425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:45.146411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57baf5ea-c187-4b0f-9e07-f833e04942d4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1516 microversion: 2.1 time: 2.150266 Aug 25 12:51:45.150728 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1230/2384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:42 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1516 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:45.173201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:45.180753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:45.243424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:45.244078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:45.249390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:45.254836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:45.256161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:45.260143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:46.031804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:51:46.032775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:51:46.033754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:51:46.035674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:51:46.044420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:51:46.115794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:46.135926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:46.141712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:46.146191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:46.149033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:46.151647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:46.251686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Getting quotas for project 9fcc4efcc4bb4e33b110b6c8c2fea54d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:46.291179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Getting quotas for user 90c8cd80349d47fba0afe81f8f93923c and project 9fcc4efcc4bb4e33b110b6c8c2fea54d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:46.337997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:51:46.343511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:51:46.527998 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d68a1d2-c051-413c-85bf-d71e27a331bc tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.142141 Aug 25 12:51:46.545298 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1155/2385] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 6161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:51:46.554383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:46.564136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:46.605493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:46.607107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:46.608439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:46.609956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:46.610877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:46.613412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:47.702136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:47.769177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:47.780173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:47.789762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-194730f4-e174-4c60-ad7f-083135f12977 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2829 microversion: 2.32 time: 2.628690 Aug 25 12:51:47.794600 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1231/2386] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:51:45 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2829 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:47.823668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:47.826115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:47.863824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:47.866665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:47.871610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:47.879096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:47.882044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:47.883464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:48.136733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:48.281548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:48.744794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:48.786017 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-518554b2-9234-40ab-8b0a-0e8a282a620f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 2.237407 Aug 25 12:51:48.801313 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1156/2387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:46 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:48.824540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:48.826048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:48.864895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:48.873254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:48.874621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:48.881648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:48.883359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:48.885863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:49.395374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:49.422189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=54 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:49.429040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ee96c01-460d-4fad-9e5c-a4f2ccdf2173 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1212 microversion: 2.1 time: 0.624975 Aug 25 12:51:49.435003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1157/2388] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:48 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1212 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:49.447746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:49.449203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:49.466434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:49.467899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:49.469192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:49.471021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:49.473221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:49.474693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:49.538819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:49.565018 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9357be2b-0347-4e20-855f-71498ad3a688 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1313 microversion: 2.1 time: 1.767016 Aug 25 12:51:49.567056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1232/2389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:47 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1313 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:49.835893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:49.837180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:49.841443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:49.871278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:49.872263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:49.876995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:49.888853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:49.892418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:49.893221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.098933 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d28bb68-bd03-4859-8107-2c8643690525 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.660770 Aug 25 12:51:50.099957 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1158/2390] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 12:51:49 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6/os-interface => generated 1829 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:51:50.228597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f2c4e09-1f00-41cd-83bf-c076f6858936 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: .version_select at 0x7fc6c6ccd940>, body: {"keypair": {"name": "tempest-keypair-1733048702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiV13OUAKQWqMASVGGDMk5Viu3W7F10QNa6axtwRq2eIEaG55o9P+Ox0J6T0SHfOlA39RewMs8FmF6SSJseEeJbwh1cSF0INqsm2tPOkD4gKd9TPBbWiIHBLn5AgJC3+Q=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:50.316927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f2c4e09-1f00-41cd-83bf-c076f6858936 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:51:50.356949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f2c4e09-1f00-41cd-83bf-c076f6858936 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for user 3566ed81b8cd452f8e1427269170f661 and project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:51:50.463584 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f2c4e09-1f00-41cd-83bf-c076f6858936 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.242628 Aug 25 12:51:50.465823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1159/2391] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:51:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:50.511650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:50.516615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:50.558334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.560375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.562277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:50.564393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:50.566701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:50.568187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:51.065408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:51.089091 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-747ab80a-3282-469f-bf99-5557805cbe08 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1274 microversion: 2.1 time: 0.612261 Aug 25 12:51:51.090858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1160/2392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:50 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1274 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:51.119261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:51.121019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:51.136105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:51.137954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:51.139784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:51.141859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:51.144331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:51.145757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:51.837821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:51.886224 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47c02f9f-d964-4176-8de3-76738e69987f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 2.054830 Aug 25 12:51:51.890662 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1233/2393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:49 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:52.129729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:52.135051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:52.185036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.185963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.188706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.190189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.216206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.217190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:52.638042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:52.673023 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc48bb2f-98e8-4169-9118-3871956680eb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1274 microversion: 2.1 time: 0.550124 Aug 25 12:51:52.681620 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1234/2394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:52 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1274 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:52.948017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:52.953188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:52.983134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:52.992428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:52.996943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.001427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.005204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.006081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.360059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:53.412881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a106f622-6b07-4bf9-b3bf-ce5938775ef3 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1313 microversion: 2.1 time: 2.319517 Aug 25 12:51:53.415733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1161/2395] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:51 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1313 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:53.731213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:53.736746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:53.766979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.767930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.769804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:53.784899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:53.785818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:53.786629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:54.803430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:54.854283 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9a5acfd-1699-4819-9a94-d55346a7fc73 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1274 microversion: 2.1 time: 1.132372 Aug 25 12:51:54.856286 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1162/2396] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:53 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1274 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:54.874786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:54.882612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:54.904619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:54.905439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:54.906759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:54.910866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:54.912828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:54.914385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:55.564340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:55.589789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2a50990-96eb-42ce-9705-59614ce3da1e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 2.655136 Aug 25 12:51:55.591140 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1235/2397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:52 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:55.604479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae995c7-76d8-421e-97de-2f781b807e2d", "tag": "0ec599f1-bbde-407a-a6f2-9236d9ba168f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:51:55.630733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:55.632000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:55.633047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:55.660024 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] Creating event network-changed:0ec599f1-bbde-407a-a6f2-9236d9ba168f for instance 0ae995c7-76d8-421e-97de-2f781b807e2d on n-h1-850468-18 Aug 25 12:51:55.670012 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d3ffc6b2-69f9-480b-a6cc-61b75c865a7d req-155c30f7-d3bf-48bc-a70d-7169477c04dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075892 Aug 25 12:51:55.671756 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1236/2398] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:51:55.902877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:55.906521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:55.977716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:55.978584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:55.979576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:55.985414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:55.986503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:55.997329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:56.200902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:51:56.333067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:56.361184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd176be7-0dd2-4306-8f74-802b3eb0cd9d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1334 microversion: 2.1 time: 1.502061 Aug 25 12:51:56.376930 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1163/2399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:54 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1334 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:56.632337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:56.633590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:56.666498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:56.668862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:56.669700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:56.671103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:56.671937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:56.673670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:57.248226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:57.271798 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e7c62de-017f-492a-b03e-92e6e053a473 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 1.379756 Aug 25 12:51:57.277291 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1237/2400] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:55 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:51:57.407586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:57.409066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:57.427799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:57.428881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:57.429946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:57.431656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:57.432717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:57.433663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:57.903983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:57.940611 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40a771aa-9e30-4793-84a4-dd147c8c8e52 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 1.316468 Aug 25 12:51:57.943699 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1164/2401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:56 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:58.325993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:58.330679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:58.347492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.349152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.350857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.353010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:58.354261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:58.355015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:58.638597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:51:58.708429 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d1334cb-5101-4bc0-8319-913c3082c640 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1334 microversion: 2.1 time: 1.310010 Aug 25 12:51:58.734228 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1238/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:57 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1334 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:51:59.000520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:51:59.002906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:51:59.047128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:59.050802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:59.054216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:51:59.059562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:51:59.061564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:51:59.065132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:00.290163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:00.328150 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21ee2cbb-2c86-4f62-9d08-73e1c594f70d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 2.019173 Aug 25 12:52:00.341655 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1165/2403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:58 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:52:00.384965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:00.931268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1988497091", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:01.092786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:02.260593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:02.310156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5187278-0913-4498-b0aa-f9dc48aadc9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 3.320298 Aug 25 12:52:02.314776 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1239/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:51:58 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 3329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:02.346767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:02.353249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:02.409011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:02.416662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:02.417911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:02.422009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:02.424361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:02.427836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:04.160492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:04.181247 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7edc6957-b2bc-4894-b064-7a60e3bd4943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.862999 Aug 25 12:52:04.183379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1240/2405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:02 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:04.192960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd", "tag": "0d273443-238b-4198-9a30-ee9ee66984f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:04.217202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:04.218623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:04.222439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:04.251626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] Creating event network-changed:0d273443-238b-4198-9a30-ee9ee66984f4 for instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd on n-h2-850468-18 Aug 25 12:52:04.262086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ad99bb41-617b-4b1a-b2df-289e1ae2ef54 req-5c388bbb-4add-4611-8cb6-6bca250c0a5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076260 Aug 25 12:52:04.264287 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1241/2406] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:04.274671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:04.277502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:04.291025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:04.292332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:04.293473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:04.295074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:04.296310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:04.297397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:04.969653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:04.991922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:04.992928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:04.993604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:04.994349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:04.995145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:04.997445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0a5debb-1663-43b6-9b11-1fc14cc5437f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 0.730474 Aug 25 12:52:05.007091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1242/2407] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:04 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:05.009017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=7 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:05.070304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.070978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.071793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.082889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.094653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.096097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.212208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:05.245553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:05.333195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:05.350393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "tag": "866fcb99-5974-4d0f-84c9-547637dd0877"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:05.362560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:05.381856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.383161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.384299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.414404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] Creating event network-changed:866fcb99-5974-4d0f-84c9-547637dd0877 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:52:05.429391 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2cba50b4-1488-4f62-9447-27e06f842cb0 req-ab8ef128-5705-42a5-9d4f-51d10bff4268 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416601 Aug 25 12:52:05.432329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1243/2408] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:05.501596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:05.507647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:05.589705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.591389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.592642 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-305341af-2f04-4da6-b538-6853078c57cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.248719 Aug 25 12:52:05.593393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.595978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.598973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1166/2409] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:05.600717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.603260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.619933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:05.623170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:05.654111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.661459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.662710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:05.664761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:05.668659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:05.669960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:06.609620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:06.668468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:06.685305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:06.696498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d78e906c-ae2e-4a7d-a407-0ea6dbacf6e0 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 1.260794 Aug 25 12:52:06.698967 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71e04b40-5f61-4f90-926b-7b0fd109858c tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.097601 Aug 25 12:52:06.700483 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1244/2410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:05 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:06.705526 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1167/2411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:05 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:06.717168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-400416060", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aece9742-1add-4f59-b848-e633a3e7299f"}], "security_groups": [{"name": "tempest-securitygroup--759451247"}], "key_name": "tempest-keypair-1733048702", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:06.730562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2da5beff-2305-4689-8c7b-5d570fccfecb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:06.732211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2da5beff-2305-4689-8c7b-5d570fccfecb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:07.211825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2da5beff-2305-4689-8c7b-5d570fccfecb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:07.244848 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2da5beff-2305-4689-8c7b-5d570fccfecb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1193 microversion: 2.1 time: 0.535091 Aug 25 12:52:07.246103 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1168/2412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:06 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1193 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:07.267178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:07.269773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:07.293761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:07.298731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:07.301007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:07.303271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:07.316803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:07.318689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:07.734325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] validate_networks() for [('aece9742-1add-4f59-b848-e633a3e7299f', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:08.728831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:08.764734 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64da02c9-3ad8-4cbd-8fc5-2f166a70b1b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 1.508588 Aug 25 12:52:08.788974 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1169/2413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:07 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:08.822755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae995c7-76d8-421e-97de-2f781b807e2d", "name": "network-vif-plugged", "status": "completed", "tag": "0ec599f1-bbde-407a-a6f2-9236d9ba168f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:08.857320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:08.858725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:08.859921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:08.905647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] Creating event network-vif-plugged:0ec599f1-bbde-407a-a6f2-9236d9ba168f for instance 0ae995c7-76d8-421e-97de-2f781b807e2d on n-h1-850468-18 Aug 25 12:52:08.935332 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-63d22230-c383-454a-8761-f5d2fa1539c4 req-45b27012-73ff-4288-8684-bc5b261126d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143420 Aug 25 12:52:08.937758 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1170/2414] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:08.959384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:08.962793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:08.983285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:08.985084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:08.988104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:08.990336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:08.991848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:08.993341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:10.667301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:10.700385 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c3c3a6f1-74a8-4e39-a0ff-bbb386673aa8 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1325 microversion: 2.1 time: 1.748475 Aug 25 12:52:10.710552 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1171/2415] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:08 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1325 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:10.722051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:10.725615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:10.759433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:10.760667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:10.762020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:10.770326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:10.771460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:10.772419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.019396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:12.020422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:12.021156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:12.022268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:12.023384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:12.086048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.087093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.087899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.089632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.090431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.091278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.204959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:12.226955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Getting quotas for user 3566ed81b8cd452f8e1427269170f661 and project e70e6ee291dd4ae9bf42d43caa89f82b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:12.312804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:12.320978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:12.515994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92e26fa5-a44c-45f4-bc24-f7de3d23ff01 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.811157 Aug 25 12:52:12.517422 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1245/2416] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 5816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:12.540751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:12.542013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:12.571785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.572824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.573682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.575132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.576033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.576988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.641622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:12.736424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0fab87b3-776f-4816-81a9-4049122b84bb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 2.032413 Aug 25 12:52:12.742023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1172/2417] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:10 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:12.762612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "tag": "6d42af78-3184-47e2-a375-1bae7d81bc40"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:12.839909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.841551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:12.843032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:12.889874 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] Creating event network-changed:6d42af78-3184-47e2-a375-1bae7d81bc40 for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:12.914535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ba9d53d3-2212-4237-bfcb-20f4204fa15c req-27cd52b9-2708-41e7-9a68-c287e90dd3aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168465 Aug 25 12:52:12.924578 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1173/2418] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:12.941352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:12.943459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:12.985221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:12.987747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:13.000854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:13.002828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:13.003616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:13.004582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:14.582459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:14.608751 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e09953f6-2300-4396-a259-2353ad19d214 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1293 microversion: 2.1 time: 2.077101 Aug 25 12:52:14.610690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:14.617578 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1246/2419] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:12 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1293 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:14.653836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:14.658488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:14.681281 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42b7e646-79d3-4dcf-9ad5-54ca1428fbe0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 1.750733 Aug 25 12:52:14.682638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1174/2420] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:12 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:14.693729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:14.694966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:14.698219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:14.700629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:14.709633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:14.715710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:14.720491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:14.736635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:14.754062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:14.762022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:14.775782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:14.777793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:14.785874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:14.789381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:15.151700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:15.246003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:15.272443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-82d08faa-f2a3-4916-aee1-2c756aebf407 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1249 microversion: 2.1 time: 0.583498 Aug 25 12:52:15.277480 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1175/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:14 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1249 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:15.325960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd", "name": "network-vif-plugged", "status": "completed", "tag": "0d273443-238b-4198-9a30-ee9ee66984f4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:15.403749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:15.407851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:15.411547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:15.455046 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] Creating event network-vif-plugged:0d273443-238b-4198-9a30-ee9ee66984f4 for instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd on n-h2-850468-18 Aug 25 12:52:15.484839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4ed678a2-0a38-4d5c-a957-701013d75472 req-c5497a44-f717-41d1-af57-d4885a549614 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175883 Aug 25 12:52:15.487638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1176/2422] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:15.498786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:15.500926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:15.516070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:15.517775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:15.519370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:15.521221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:15.522916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:15.524902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:16.156025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:16.200621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08097315-1fa7-4f3f-b988-6ea8ad715528 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.577656 Aug 25 12:52:16.205663 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1247/2423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:14 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:16.225004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:16.229226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:16.264170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:16.274884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:16.276255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:16.278730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:16.284924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:16.286288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.221848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:17.292842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:17.363359 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-045585a0-07fa-47c2-bb7b-ba6d07361479 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.870863 Aug 25 12:52:17.380717 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1177/2424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:15 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:17.389697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:17.390910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:17.423347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.424323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.425702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.427203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.428155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.428970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.455578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:17.489034 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-991b6dd7-eaab-4ba4-af1d-5670f59fbd87 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1293 microversion: 2.1 time: 1.266943 Aug 25 12:52:17.490860 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1248/2425] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:16 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1293 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:17.506056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6", "tag": "12dfa86c-93f8-4132-88d8-d197235d0320"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:17.546574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.551306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.552311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.579445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] Creating event network-changed:12dfa86c-93f8-4132-88d8-d197235d0320 for instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 on n-h1-850468-18 Aug 25 12:52:17.592997 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-adcb7a79-0234-4451-81db-e3e80ae730cf req-52d883d5-29c0-4e95-8d3d-27b01fdc030f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098289 Aug 25 12:52:17.595040 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1249/2426] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:17.606847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:17.608612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:17.628412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.630658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.632067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:17.634854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:17.636598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:17.638190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.430796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.467061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59cb2f08-bd9a-445d-aca1-a82535e95428 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1316 microversion: 2.1 time: 1.084095 Aug 25 12:52:18.469011 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1178/2427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:17 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1316 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:18.491337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:18.497620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:18.516271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:18.517445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.518390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.522078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.526703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.528189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.532855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.582106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-06ba7e8d-11ac-4f6a-a082-412625f2967c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 0.979431 Aug 25 12:52:18.587974 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1250/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:17 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:18.598383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:18.605940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "tag": "7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:18.648225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.649843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.654312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.719355 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] Creating event network-changed:7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:18.731982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-81081ab4-6c6a-4f3c-b348-fd578512ef49 req-6aba7978-707b-4ac4-8c0a-2fe343a15728 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139790 Aug 25 12:52:18.734446 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1251/2429] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:18.749693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:18.752247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:18.770374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.776347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.777654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:18.779088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:18.779994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:18.784983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:19.307322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:19.341881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e44289c1-c3fa-4948-b3be-91e94da83d09 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1303 microversion: 2.1 time: 0.870575 Aug 25 12:52:19.343487 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1179/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:18 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1303 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:19.356167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:19.371235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:19.394768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:19.395991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:19.396820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:19.407371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:19.408396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:19.409358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.583781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:20.606255 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a9fd445-c756-45ba-a7ef-aa106b204d62 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.868452 Aug 25 12:52:20.639318 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1252/2431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:18 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:20.653529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97959f94-081c-4b45-8d31-13f454696e66 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1412725709", "metadata": {"": ""}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97959f94-081c-4b45-8d31-13f454696e66 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action HTTP/1.1 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 107 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1412725709", "metadata": {"": ""}}} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1412725709', 'metadata': {'': ''}}}} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'': ''} Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:20.664977 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:20.675004 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:20.681444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97959f94-081c-4b45-8d31-13f454696e66 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:20.682572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97959f94-081c-4b45-8d31-13f454696e66 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action" status: 400 len: 170 microversion: 2.1 time: 0.038740 Aug 25 12:52:20.690112 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1253/2432] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Aug 25 12:52:20 2022] POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action => generated 170 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:20.700563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:20.702208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:20.708741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:20.720875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.722801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.724360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.726143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.727426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.728742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.859048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:20.883074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7913741-f39e-4287-8144-06cb5535dc7c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1293 microversion: 2.1 time: 1.535961 Aug 25 12:52:20.896159 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1180/2433] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:19 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1293 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:20.896159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:20.897343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:20.910731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.912039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.913089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:20.915795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:20.918513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:20.919827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:21.858384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:21.898637 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44c9ba9e-b5cb-425d-826b-4ac706773f65 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1503 microversion: 2.1 time: 1.205451 Aug 25 12:52:21.911559 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1254/2434] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:20 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1503 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:21.931645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:21.933267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:21.985232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:21.986643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:21.994390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:21.996042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:21.996920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:21.997739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:22.000686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:22.036927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe522a39-c378-492a-a354-18658ee2c0cb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1370 microversion: 2.1 time: 1.147133 Aug 25 12:52:22.038780 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1181/2435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:20 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1370 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:22.051155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:22.052534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:22.090021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:22.091036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:22.106590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:22.111736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:22.113727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:22.145817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:22.151438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:22.274743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:23.008868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:23.034610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ac71fb5-a500-447e-ac7d-3bf966b8f62b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.120347 Aug 25 12:52:23.042298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:23.061404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1255/2436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:21 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:23.077912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "tag": "8c161384-577f-4b39-b0df-55a8557ee90f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:23.102121 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d7de3d74-01f6-4997-9fb8-87faa8bcdb76 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.054115 Aug 25 12:52:23.103844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1182/2437] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:22 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:23.118039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:23.121392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:23.150250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:23.151279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:23.152290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:23.153532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:23.155589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:23.158256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:23.161634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:23.168373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:23.169332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:23.202554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] Creating event network-changed:8c161384-577f-4b39-b0df-55a8557ee90f for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:23.233036 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ef16f14e-4c3e-439f-a5c8-4add2a9faefa req-34c36a66-0431-4478-bb99-9e0f9a1e12f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181015 Aug 25 12:52:23.239354 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1256/2438] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:23.273532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-472745710"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:23.275114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:23.300090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:23.305955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:23.309835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:23.311909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:23.312209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:23.313031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:23.928406 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.network.security_group_api [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Adding security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 to port 0d273443-238b-4198-9a30-ee9ee66984f4 Aug 25 12:52:23.945298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:24.009497 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9a8bfdc-af06-4de7-a66a-60692a4cf432 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1293 microversion: 2.1 time: 0.903388 Aug 25 12:52:24.017164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1183/2439] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:23 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1293 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:24.036458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:24.050746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:24.065008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:24.066353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:24.067559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:24.069933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:24.071199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:24.072354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.156394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:25.195575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42ee250c-d042-483e-b71e-823ba5c9845e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.175404 Aug 25 12:52:25.219465 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1184/2440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:24 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:25.219465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:25.219465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:25.230069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.231455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.233077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:25.234687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:25.235941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:25.238763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.216734 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d03df868-f0c7-47d6-af5a-be88c6325a32 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action" status: 202 len: 0 microversion: 2.1 time: 2.971729 Aug 25 12:52:26.225795 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1257/2441] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:23 2022] POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action => generated 0 bytes in 2983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:26.238269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:26.240802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:26.268314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:26.275854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:26.277445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.279679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:26.281272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:26.287366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.818013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:26.836105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce124283-8826-44e3-86e5-cabb97058bc4 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1370 microversion: 2.1 time: 1.632227 Aug 25 12:52:26.849395 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1185/2442] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:25 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1370 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:26.859340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:26.902149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:26.917407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:26.918732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:26.965587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] Creating event network-changed:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:52:26.994553 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9e62ca9d-8f68-4393-9f60-d91c32584a0e req-ce84ec85-8833-4031-985d-f7d18c08b2e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142250 Aug 25 12:52:26.995648 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1186/2443] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:27.019493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:27.032056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:27.070847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.072215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.074071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.075516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.076429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.077244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:27.840468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:27.872839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:27.883189 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e20fe262-9624-4264-964e-f97a98ba2cc5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1293 microversion: 2.1 time: 0.881701 Aug 25 12:52:27.885995 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1187/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:26 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1293 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:27.903379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1843069f-0922-48f9-a9e9-c39852a0bd81 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-290702057", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:27.915904 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6ba0013c-84d0-43fd-9a07-6a17ad449744 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.687763 Aug 25 12:52:27.921286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1258/2445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:26 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1843069f-0922-48f9-a9e9-c39852a0bd81 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action HTTP/1.1 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 618 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-290702057", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-290702057', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:52:27.934419 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:52:27.939539 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:27.950033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c28e6820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:27.950273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1843069f-0922-48f9-a9e9-c39852a0bd81 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:27.952473 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1843069f-0922-48f9-a9e9-c39852a0bd81 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action" status: 400 len: 938 microversion: 2.1 time: 0.061320 Aug 25 12:52:27.953911 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1188/2446] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Aug 25 12:52:27 2022] POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action => generated 938 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:27.966959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd", "tag": "0d273443-238b-4198-9a30-ee9ee66984f4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:27.994638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:27.995683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:27.996893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.036596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] Creating event network-changed:0d273443-238b-4198-9a30-ee9ee66984f4 for instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd on n-h2-850468-18 Aug 25 12:52:28.057999 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c6f8b1f6-fe04-4e27-b83c-81ccd90ce444 req-562d6a00-6582-42ad-9320-1edd14a5f659 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099491 Aug 25 12:52:28.064047 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1189/2447] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:28.092329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6", "name": "network-vif-plugged", "status": "completed", "tag": "12dfa86c-93f8-4132-88d8-d197235d0320"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:28.135612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:28.137225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:28.138519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:28.191807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] Creating event network-vif-plugged:12dfa86c-93f8-4132-88d8-d197235d0320 for instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 on n-h1-850468-18 Aug 25 12:52:28.219540 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-eb267276-16e0-40ed-91ca-e986ab6a2977 req-5c6fdd6b-e4dc-4f63-bee8-b76143e85060 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149249 Aug 25 12:52:28.227362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1190/2448] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:28.476559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1391151247", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:28.734236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] validate_networks() for [('9dc932d5-bde2-4a36-abc4-9eecafa781ce', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:29.881989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use.", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:52:29.882957 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.882957 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50 HTTP/1.1 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: exception: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '26b5ab33-eac3-4b73-973b-4bf0ed02fc50'} Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:52:29.886582 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] Aug 25 12:52:29.897182 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:29.907019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 400 to user: Security Group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 in use. Aug 25 12:52:29.907019 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f02ef781-a424-496d-8f57-900ed4d1f392'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:29.910960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eac1f786-676b-4973-966c-9f6513f5fcc6 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50" status: 400 len: 185 microversion: 2.1 time: 1.970900 Aug 25 12:52:29.913009 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1259/2449] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:27 2022] DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50 => generated 185 bytes in 1991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:29.923545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:29.926747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:29.939744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.941556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.942870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:29.944709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:29.946227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:29.947489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:31.184025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:31.208182 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01e44403-2d15-432d-a37e-75f6910d3164 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1370 microversion: 2.1 time: 1.292423 Aug 25 12:52:31.208853 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1260/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:29 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1370 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:31.218420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:31.222915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:31.246588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:31.248094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:31.249335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:31.251162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:31.252425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:31.254018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.030268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:33.049955 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-10bdefd0-fdab-4928-b738-21e8b9779349 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.838377 Aug 25 12:52:33.051604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1261/2451] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:31 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:33.060655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:33.062470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:33.078609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.079532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.080607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.080607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.083804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.084663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.104328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:33.105731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:33.106975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:33.107947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:33.108881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:33.140275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.141266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.142124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.144772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.145759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.146635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.189029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Getting quotas for project 16a0d5a0420e47fd81ef568bc3b67a8c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:33.202682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Getting quotas for user 78048f0fdaeb4a5ca5c1e9f76cedba18 and project 16a0d5a0420e47fd81ef568bc3b67a8c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:33.232452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:33.238814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:33.354845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-350775b5-3fb2-476b-bc7e-abcb2c3dc75a tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.124427 Aug 25 12:52:33.357017 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1191/2452] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:33.396782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:33.402930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:33.418484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.419453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.420655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:33.421755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:33.422688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:33.423419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.163417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:34.198924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e112ac8d-4c52-4e44-ba64-d10256867902 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 0.823504 Aug 25 12:52:34.224631 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1192/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:33 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:34.242728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:34.247334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:34.260782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:34.291505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.292440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.293398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.294458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.297162 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18d1ab61-b385-443c-b807-b664fe5c6fd8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1473 microversion: 2.1 time: 1.243235 Aug 25 12:52:34.299116 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1262/2454] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:33 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1473 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:34.304962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.305931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.311056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "name": "network-vif-plugged", "status": "completed", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:34.336226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.337330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.338428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.420420 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] Creating event network-vif-plugged:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:52:34.441379 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-270dbe1c-52d6-465c-944a-381a298b5749 req-3159593a-951b-4807-9902-616260f4772d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137539 Aug 25 12:52:34.452552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1263/2455] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:34.500608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:34.509156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:34.548478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.553780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.557155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.561661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.567322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.568320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.731280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b747d9d-a66c-4cb6-ba7c-16ae1f759bf1 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action" status: 202 len: 0 microversion: 2.1 time: 0.499417 Aug 25 12:52:34.736342 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1193/2456] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:34 2022] POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:34.762594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:34.767286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:34.785419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.786632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.787612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:34.790376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:34.791365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:34.792681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:35.655516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:35.680786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-451a79f7-1276-4305-9f36-e9587ce505f6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1370 microversion: 2.1 time: 1.222702 Aug 25 12:52:35.683180 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1264/2457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:34 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1370 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:35.695038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:35.697130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:35.711780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:35.713501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:35.714887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:35.717112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:35.718336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:35.719424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:35.791411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:35.812000 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a805d0b7-5c31-4f35-9db3-fb6db1190803 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.069605 Aug 25 12:52:35.836797 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1194/2458] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:34 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:35.857576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-102666701", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:35.872525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:35.953548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:35.979374 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40c45bf0-cdec-49d6-a93e-49b1a3e306d6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1276 microversion: 2.1 time: 0.292896 Aug 25 12:52:35.979720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:35.982699 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1265/2459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:35 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:35.991212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:35.992387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.005315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.006761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.007745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.009291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.010159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.011005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.689519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:36.708502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52654976-b12b-409a-9412-1fdfde520fe8 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1573 microversion: 2.1 time: 0.725285 Aug 25 12:52:36.710263 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1266/2460] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:35 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1573 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:36.719160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:36.720772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:36.741324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.742773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.743881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.747244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:36.749288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:36.750200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:36.757382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:37.775265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:37.788555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b84f759-3bd7-44dd-b5ff-cbb2098892cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.076050 Aug 25 12:52:37.790177 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1267/2461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:36 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:37.800953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb2d2f95-18b8-489a-9ef4-152291f1d991 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb2d2f95-18b8-489a-9ef4-152291f1d991 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action HTTP/1.1 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 285 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:37.809530 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb2d2f95-18b8-489a-9ef4-152291f1d991 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb2d2f95-18b8-489a-9ef4-152291f1d991 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action" status: 400 len: 619 microversion: 2.1 time: 0.020053 Aug 25 12:52:37.820401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1268/2462] 10.222.0.60 () {60 vars in 1279 bytes} [Thu Aug 25 12:52:37 2022] POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:37.827055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:37.827055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:37.837746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.838894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.838894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:37.839813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:37.840644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:37.841224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.250863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:39.254119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:39.255086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:39.256278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:39.257654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:39.285381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.286806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.289959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.292797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.294642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.295930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.349399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:39.350515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.362480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:39.395666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:39.397977 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7eb7f6b5-6962-4ecc-bb27-0410266946c0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1564 microversion: 2.1 time: 1.576530 Aug 25 12:52:39.401349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1269/2463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:37 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1564 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:39.428265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:39.432529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.434907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.454839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.456995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.458308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.460400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.461669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.462941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.573753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9548a7e8-8b82-44ba-8aea-863ab3e78375 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.734255 Aug 25 12:52:39.588376 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1195/2464] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:39.600792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.601989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.616552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.617675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.618978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.621359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.623362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.623669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.777990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:39.841075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e57693b1-f738-48ec-b2dd-63e809242ce1 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1282 microversion: 2.1 time: 0.419123 Aug 25 12:52:39.842324 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1270/2465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:39.878162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:39.878732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:39.918434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.923270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.924533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:39.925944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:39.934506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:39.935634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.670908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:40.700489 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33de0fae-9965-4b20-a876-710a5e29dd58 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1573 microversion: 2.1 time: 1.109833 Aug 25 12:52:40.701581 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1196/2466] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1573 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:40.723642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:40.725389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:40.746182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.757421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.758250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.759959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:40.761179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:40.762268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:40.956602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:40.986238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1449da9-ec95-4ad4-a79d-b6b5c688c13f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.141981 Aug 25 12:52:40.987834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1271/2467] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:39 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:41.006045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.010887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:41.037826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.039490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.041318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.053919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.055279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.056562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.538309 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80f4c3a0-8e00-47f6-bfd5-161ffd0b0149 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.548187 Aug 25 12:52:41.539664 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1272/2468] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-interface => generated 284 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:41.557993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:41.559329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:41.585867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.597815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.599173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.600873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.605420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.606882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.673061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:41.693563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:41.694378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:41.695067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:41.827518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'flavor' on Instance uuid a2b90470-49be-46b0-a25b-d20330f96448 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:52:41.950458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'system_metadata' on Instance uuid a2b90470-49be-46b0-a25b-d20330f96448 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:52:42.028506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:42.063176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf8ee1df-c2c0-4a8b-b5ca-f0dc45bcf025 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.359610 Aug 25 12:52:42.066513 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1197/2469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:40 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:42.080097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:42.088792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:42.101868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'metadata' on Instance uuid a2b90470-49be-46b0-a25b-d20330f96448 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:52:42.111048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.112048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.112987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:42.114414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:42.121274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:42.122097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.421735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:43.480404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-375bd917-4b3d-48a7-9c2f-561dca69e8bc tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1324 microversion: 2.1 time: 1.402389 Aug 25 12:52:43.506723 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1198/2470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:42 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1324 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:43.546283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:43.552284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:43.588831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.595261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.600783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.604553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:43.608349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:43.616049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:43.766382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:43.899932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.scheduler.client.report [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Deleted allocations for instance a2b90470-49be-46b0-a25b-d20330f96448 Aug 25 12:52:43.968376 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de155b9b-ad8a-46f3-8df6-100bd18d118f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448" status: 204 len: 0 microversion: 2.1 time: 2.424133 Aug 25 12:52:43.973298 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1273/2471] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:41 2022] DELETE /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 => generated 0 bytes in 2432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:43.996899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.000493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:44.047930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.061257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.063077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:44.064538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.065466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.067265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:44.889629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:44.926053 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4e070b0-064c-4c63-8fe6-bd3ed409d71c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.403945 Aug 25 12:52:44.927648 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1199/2472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:43 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:44.952716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:44.954175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:44.966453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.967507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.968528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:44.970117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:44.971842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:44.971842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.514760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:45.542169 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d56b8bda-9f61-4eed-bc2f-2d074f7aa105 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1571 microversion: 2.1 time: 1.566051 Aug 25 12:52:45.544605 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1274/2473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:43 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1571 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:45.566517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:45.570323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:45.597110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.597959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.598763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:45.600173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:45.601043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:45.601879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.446269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:46.484326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:46.489526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:46.492317 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-899f871f-2c15-4676-b8f8-f05befededca tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2948 microversion: 2.32 time: 1.557855 Aug 25 12:52:46.512569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1200/2474] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:52:44 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2948 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:46.538860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:46.551285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:46.573669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.574627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.577295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.582304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.583686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.584908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.613529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:46.629864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f1e3b25d-c9d6-4cba-8c51-5e393472b0a1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.082325 Aug 25 12:52:46.631833 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 12:52:46.632014 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1275/2475] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:45 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 HTTP/1.1 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a2b90470-49be-46b0-a25b-d20330f96448'} Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:46.637143 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 12:52:46.647193 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:46.647954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:46.647954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:46.651819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:46.653664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5da982ea-ae8f-4756-967c-9ad2cb742e1e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448" status: 404 len: 111 microversion: 2.1 time: 0.138710 Aug 25 12:52:46.655033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1201/2476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:46 2022] GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:52:46.667306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:46.685403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.685807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.686729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.688194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.689083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.690226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.697160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.703628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.704930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.756768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] Creating event network-changed:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:52:46.795201 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1de25777-bc79-4fb0-a9a8-2646192e32bf req-1d9acf08-0d6f-4ee0-b6e3-e488ed1872d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119280 Aug 25 12:52:46.811392 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1202/2477] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:46.832806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-355090223"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:46.840851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:46.858991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.860379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.861527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:46.863503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:46.865802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:46.866951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:47.582210 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-798fc5d1-c930-4ccc-8800-f72f5617550e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action" status: 202 len: 0 microversion: 2.1 time: 0.763772 Aug 25 12:52:47.587824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1203/2478] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:46 2022] POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:52:47.623870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-338509740"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:47.630145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:47.654176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:47.655436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:47.656098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:47.657622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:47.669010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:47.670559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:48.590362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:48.609079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72e749c5-6d27-471d-a12e-cee9c211b016 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1324 microversion: 2.1 time: 1.974359 Aug 25 12:52:48.610757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1276/2479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:46 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1324 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:49.036081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1560847538", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:49.161232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:49.165039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Adding security group c9699a1f-a88b-424d-914c-e303d3c717f4 to port 0d273443-238b-4198-9a30-ee9ee66984f4 Aug 25 12:52:49.321916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:49.380451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:50.494754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:50.495752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:50.496760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:50.497595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:50.498374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:50.520717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.521655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.522470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.524358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.525255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.526099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.576068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:50.589681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:50.624036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:50.630407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:50.730113 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e757d1ca-84fe-4110-8459-b8b6cb694db9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.115842 Aug 25 12:52:50.742595 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1277/2480] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:50.742595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:50.743027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:50.757067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.757982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.758816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:50.765367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:50.770414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:50.773190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.250078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a808f89-cb62-4153-b8dc-fae2e4d8c496 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.516329 Aug 25 12:52:51.251046 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1278/2481] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 12:52:50 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6/os-interface => generated 1829 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:52:51.262452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-422921537", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:51.295547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:51.398506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:52:51.699174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc6b171c-ef17-4562-a659-f1d0ab5fc783 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action" status: 202 len: 0 microversion: 2.1 time: 4.096663 Aug 25 12:52:51.704396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1204/2482] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:47 2022] POST /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd/action => generated 0 bytes in 4116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:52:51.733965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1038070090"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:51.742548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:51.771911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.773627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.775603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.777929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:51.780039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:51.783008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:51.944342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Cannot 'createImage' instance 0ae995c7-76d8-421e-97de-2f781b807e2d while it is in task_state image_pending_upload Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action HTTP/1.1 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 85 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1038070090"}} Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'createImage' instance 0ae995c7-76d8-421e-97de-2f781b807e2d while it is in task_state image_pending_upload Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1038070090'}}} Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d in task_state image_pending_upload. Cannot snapshot while the instance is in this state. Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:52:51.947877 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 0ae995c7-76d8-421e-97de-2f781b807e2d while it is in task_state image_pending_upload Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 0ae995c7-76d8-421e-97de-2f781b807e2d while it is in task_state image_pending_upload Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 409 to user: Cannot 'createImage' instance 0ae995c7-76d8-421e-97de-2f781b807e2d while it is in task_state image_pending_upload {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2603db46-7fe9-482c-8e3d-6a956bebe993 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action" status: 409 len: 165 microversion: 2.1 time: 0.241758 Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1205/2483] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:52:51 2022] POST /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d/action => generated 165 bytes in 247 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:52:51.963956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-plugged", "status": "completed", "tag": "6d42af78-3184-47e2-a375-1bae7d81bc40"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:51.999017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.002163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.007701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.037877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] Creating event network-vif-plugged:6d42af78-3184-47e2-a375-1bae7d81bc40 for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:52.050496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0e90ca99-5819-4aa6-8475-02492df8ac3f req-89b6ef1a-35f6-4088-910c-07cc5b996d69 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093638 Aug 25 12:52:52.053071 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1206/2484] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:52.063250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:52.065913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:52.080105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.081321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.082651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.084186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.085802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.087086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.713081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:52.732709 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5c70d48-4192-4a6a-bdc4-0387d148094b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 0.676827 Aug 25 12:52:52.734483 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1207/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:52 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:52.745089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d53d28e6-e70b-4861-9408-96017126c642", "tag": "a4728c70-5a9a-484c-b9f1-b30c7f10007a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:52.770754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.771544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.772344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.802166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] Creating event network-changed:a4728c70-5a9a-484c-b9f1-b30c7f10007a for instance d53d28e6-e70b-4861-9408-96017126c642 on n-h2-850468-18 Aug 25 12:52:52.813977 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ca740cf2-b821-40da-93a9-9eb6b30014cf req-d2b3c5bf-e330-4bac-968c-63893dbfae81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076311 Aug 25 12:52:52.815526 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1208/2486] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:52.841221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:52.844679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:52.861658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.863322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.864189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:52.865882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:52.867348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:52.868884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.439372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:52:53.444371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:52:53.449079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:52:53.453446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:52:53.468493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:52:53.523834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.525451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.527181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.533993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.540459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.542110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.669530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:52:53.690443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:52:53.768868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:53.804059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:52:53.808766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:52:53.811717 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86225ac1-91cc-4b5c-8f1f-30e8c69ffc0b tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1324 microversion: 2.1 time: 0.992613 Aug 25 12:52:53.813676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1209/2487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:52 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1324 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:53.831070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:53.836567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:53.859596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.864770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.866490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:53.868918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:53.871081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:53.872146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:54.041154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-733353dd-570e-443f-8fc4-5351acd20688 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.787000 Aug 25 12:52:54.042408 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1279/2488] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:52:54.064861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c271f310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:54.219607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:54.252652 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-289a2579-c120-4a3a-8681-8dc3ad3ee01a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1271 microversion: 2.1 time: 0.435810 Aug 25 12:52:54.254521 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1210/2489] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:53 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1271 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:54.275137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e5702b4c-1803-4205-b6ea-b097fb5f456e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c25f6dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:54.731676 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e5702b4c-1803-4205-b6ea-b097fb5f456e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/images/6948583d-a197-4bd3-ae4d-ddfe0d5700af" status: 204 len: 0 microversion: 2.1 time: 0.474147 Aug 25 12:52:54.733051 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1211/2490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:54 2022] DELETE /compute/v2.1/images/6948583d-a197-4bd3-ae4d-ddfe0d5700af => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:54.758510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:54.759674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:54.783320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:54.785039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:54.785553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:54.786850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:54.787682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:54.788702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:55.819231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:55.835047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e94fe7e1-6293-4f46-8e18-650096b76c4a tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.094895 Aug 25 12:52:55.839377 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1212/2491] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:54 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:55.847331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:55.848979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:55.862849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:55.864369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:55.865568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:55.867565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:55.868964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:55.870391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:55.903422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use.", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:52:55.905941 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.905941 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4 HTTP/1.1 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: exception: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'c9699a1f-a88b-424d-914c-e303d3c717f4'} Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:52:55.912104 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] Aug 25 12:52:55.922280 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:52:55.939356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 400 to user: Security Group c9699a1f-a88b-424d-914c-e303d3c717f4 in use. Aug 25 12:52:55.939356 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-2511bd32-ac86-465d-bb58-4d63f5eab011'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:52:55.939356 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac2fcf2c-db06-47f0-83e5-e7f344de1eac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4" status: 400 len: 185 microversion: 2.1 time: 1.883581 Aug 25 12:52:55.944139 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1280/2492] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:52:54 2022] DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4 => generated 185 bytes in 1901 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:52:55.954197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-plugged", "status": "completed", "tag": "8c161384-577f-4b39-b0df-55a8557ee90f"}, {"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-plugged", "status": "completed", "tag": "7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:55.980589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:55.984460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:55.984460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:56.022474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Creating event network-vif-plugged:8c161384-577f-4b39-b0df-55a8557ee90f for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:56.023571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] Creating event network-vif-plugged:7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:52:56.034892 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-aed1dd50-e4cc-4350-b7e6-778b588db931 req-93397a1e-51c4-418f-845c-36a6f0688b2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087156 Aug 25 12:52:56.037575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1281/2493] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:56.056102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:56.057701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:56.075050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:56.076083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:56.077052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:56.078558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:56.080165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:56.081823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:56.101189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:56.146249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71e78fd1-9d8a-449d-8b41-8b1752df60ea tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1216 microversion: 2.1 time: 0.305068 Aug 25 12:52:56.148337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1213/2494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:55 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1216 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:56.160005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:56.161738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:56.176894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:56.177724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:56.178498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:56.180023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:56.181126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:56.181804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.153943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:57.175639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:57.181328 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e1d8df0-8986-4102-a2d3-7e6db1428571 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1540 microversion: 2.1 time: 1.135200 Aug 25 12:52:57.182714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1282/2495] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:56 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1540 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:57.191446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd", "tag": "0d273443-238b-4198-9a30-ee9ee66984f4"}, {"name": "network-changed", "server_uuid": "a2b90470-49be-46b0-a25b-d20330f96448", "tag": "3bfde850-c6ae-4adc-8908-3484c296ad84"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:57.224876 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7c8954b9-e313-4149-b81f-034924343a04 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1324 microversion: 2.1 time: 1.074059 Aug 25 12:52:57.233681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.244247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1214/2496] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:56 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1324 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:57.254084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.255432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.260615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:57.267769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.290956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.292348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.293564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.295409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.298652 n-d-850468-18 devstack@n-api.service[122701]: /opt/stack/nova/nova/db/main/api.py:1842: SAWarning: Multiple rows returned with uselist=False for eagerly-loaded attribute 'Instance.extra' Aug 25 12:52:57.298652 n-d-850468-18 devstack@n-api.service[122701]: instances = query_prefix.all() Aug 25 12:52:57.300996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.302355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.327433 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Creating event network-changed:0d273443-238b-4198-9a30-ee9ee66984f4 for instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd on n-h2-850468-18 Aug 25 12:52:57.329839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] Creating event network-changed:3bfde850-c6ae-4adc-8908-3484c296ad84 for instance a2b90470-49be-46b0-a25b-d20330f96448 on n-h2-850468-18 Aug 25 12:52:57.359213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ab4019db-0a89-46c5-8e6c-ba3dcddf37fe req-6625e219-19c5-4bfc-87cf-803220d0f0bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.173744 Aug 25 12:52:57.371269 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1283/2497] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:57.391606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:57.393169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.410378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.411459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.412726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.414372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.415693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.418051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.492060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:52:57.501216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:52:57.700233 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3c99b96-e2e4-47d9-a43e-a062deaa7508 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 204 len: 0 microversion: 2.1 time: 0.325693 Aug 25 12:52:57.702740 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1284/2498] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:52:57 2022] DELETE /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:52:57.716233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:57.724650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:57.726435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.744028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.746023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.747210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.748899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.751080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.753403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.754174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1423d23a-8ad7-4d03-abd4-0b8fa7c23eda tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1271 microversion: 2.1 time: 0.507379 Aug 25 12:52:57.770296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1215/2499] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:57 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1271 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:57.770296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:57.770296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:57.780848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.784952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.786311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:57.788591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:57.789996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:57.791099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.031736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:58.049071 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02bb1148-5437-411d-9401-49c603d37621 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1278 microversion: 2.1 time: 0.291260 Aug 25 12:52:58.052049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1216/2500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:57 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:58.061187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:58.062205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:58.078207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.080768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.081900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.083310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.084200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.085047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.704935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:58.720821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc0cdbbd-0f70-42b3-b663-01676c7d95c0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1355 microversion: 2.1 time: 1.015300 Aug 25 12:52:58.721995 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1285/2501] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:57 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1355 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:58.744936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53d28e6-e70b-4861-9408-96017126c642", "name": "network-vif-plugged", "status": "completed", "tag": "a4728c70-5a9a-484c-b9f1-b30c7f10007a"}, {"server_uuid": "0ae995c7-76d8-421e-97de-2f781b807e2d", "name": "network-vif-plugged", "status": "completed", "tag": "0ec599f1-bbde-407a-a6f2-9236d9ba168f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:52:58.766431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.767441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.769923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.796728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Creating event network-vif-plugged:a4728c70-5a9a-484c-b9f1-b30c7f10007a for instance d53d28e6-e70b-4861-9408-96017126c642 on n-h2-850468-18 Aug 25 12:52:58.797805 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] Creating event network-vif-plugged:0ec599f1-bbde-407a-a6f2-9236d9ba168f for instance 0ae995c7-76d8-421e-97de-2f781b807e2d on n-h1-850468-18 Aug 25 12:52:58.816601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-dee38b71-0f04-47c9-bd14-2d746b7b7869 req-fc2a02cf-22b9-45f0-ac0d-0c47ec7286fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080045 Aug 25 12:52:58.817975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1286/2502] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:52:58.828962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:58.830986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:58.848797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.849620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.850519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:58.852335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:58.853439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:58.854715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:59.169502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:52:59.186437 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf3b358d-025b-46cb-99ad-de8794493727 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 200 len: 1645 microversion: 2.1 time: 1.131302 Aug 25 12:52:59.188184 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1217/2503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:58 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 1645 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:52:59.221297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:52:59.222793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:52:59.235882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:59.237658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:59.238611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:52:59.240402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:52:59.241143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:52:59.242427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:00.061137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:00.095917 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2e857da-20a5-4f51-bd45-1b7f65dbaef5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1540 microversion: 2.1 time: 1.274164 Aug 25 12:53:00.097734 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1287/2504] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:58 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1540 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:00.113589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:00.115444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:00.161887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:00.162826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:00.164334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:00.165364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:00.166193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:00.167012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:01.725424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:01.738096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:01.747884 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-99393b34-e302-4a4c-abe7-59c16fab4a2e tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1324 microversion: 2.1 time: 2.554857 Aug 25 12:53:01.749686 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1218/2505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:52:59 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1324 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:01.820888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:01.826416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:01.880265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:01.886144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:01.887040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:01.889039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:01.890383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:01.891772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.297721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:02.318115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dcb33a25-87ec-45f9-a6cf-34d9c9b397a0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1278 microversion: 2.1 time: 0.529194 Aug 25 12:53:02.325981 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1219/2506] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:01 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1278 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:02.336969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.338206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:02.351335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.352348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.353193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.355241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.355498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.356775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.370481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:02.389989 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01497493-81c4-4435-9c64-1ba28bbaca03 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 2.288058 Aug 25 12:53:02.391961 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1288/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:00 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:02.405351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.407167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:02.424819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.426363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.427421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.429015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.432000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.433461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.468724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd HTTP/1.1 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd'} Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:02.472537 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:02.481753 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-086b2f8c-902b-4446-99fc-948587d789ec tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 404 len: 111 microversion: 2.1 time: 0.083503 Aug 25 12:53:02.488592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1289/2508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:02 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:02.498549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd", "name": "network-vif-deleted", "tag": "0d273443-238b-4198-9a30-ee9ee66984f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:02.520613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.521597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.522443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.556014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] Creating event network-vif-deleted:0d273443-238b-4198-9a30-ee9ee66984f4 for instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd on n-h2-850468-18 Aug 25 12:53:02.567715 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8f8fb017-1238-4b10-bf58-02847b1d1dfb req-e795e425-b37b-4e1e-992b-c7229129f269 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077117 Aug 25 12:53:02.568905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1290/2509] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:02.581460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:02.582798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:02.599023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.600463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.602005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:02.603630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:02.604453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:02.605324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.422057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:03.440463 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c33d7f94-80a2-4c19-8e98-2b1f8b245da4 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1806 microversion: 2.1 time: 1.111944 Aug 25 12:53:03.442046 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1220/2510] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:02 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1806 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:03.451391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b90470-49be-46b0-a25b-d20330f96448", "name": "network-vif-deleted", "tag": "3bfde850-c6ae-4adc-8908-3484c296ad84"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:03.471271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.472239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.473068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.491912 n-d-850468-18 devstack@n-api.service[122700]: /opt/stack/nova/nova/db/main/api.py:1842: SAWarning: Multiple rows returned with uselist=False for eagerly-loaded attribute 'Instance.extra' Aug 25 12:53:03.491912 n-d-850468-18 devstack@n-api.service[122700]: instances = query_prefix.all() Aug 25 12:53:03.497863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] Creating event network-vif-deleted:3bfde850-c6ae-4adc-8908-3484c296ad84 for instance a2b90470-49be-46b0-a25b-d20330f96448 on n-h2-850468-18 Aug 25 12:53:03.508997 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6dfe40be-2e76-4b5c-81e7-534513854698 req-449053df-d62e-489e-958a-ebf03781ed23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064377 Aug 25 12:53:03.511256 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1221/2511] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:03.522952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5631bb82-a8ad-4a74-8bd8-a8774c19324e tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2d68790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:03.591263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:03.609223 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0693f878-faaf-4d30-a41b-74feed6a4f6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1522 microversion: 2.1 time: 1.037766 Aug 25 12:53:03.610301 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1291/2512] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:02 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1522 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:03.620871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:03.622061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:03.633283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:03.652454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.653985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.654849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.656280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:03.657223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:03.658092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:03.758872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:04.427312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:04.446035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-643f7d1a-3b6e-4564-8bc4-38cefb844e10 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1521 microversion: 2.1 time: 0.833565 Aug 25 12:53:04.447640 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1292/2513] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:03 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1521 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:04.458267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:04.460224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:04.473527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.474805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.476162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:04.477881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:04.479083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:04.480449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.113860 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5631bb82-a8ad-4a74-8bd8-a8774c19324e tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50" status: 202 len: 0 microversion: 2.1 time: 1.600154 Aug 25 12:53:05.114918 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1222/2514] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:03 2022] DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50 => generated 0 bytes in 1603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:05.125454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:05.128341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:05.141912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.143551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.144367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.145673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.146628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.147363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.367704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:05.399982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe7ddf51-69fa-4f80-b51f-2c10978eaed5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.947958 Aug 25 12:53:05.402022 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1293/2515] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:04 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:05.412366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:05.414442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:05.441683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.442696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.443470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.444934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.445839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.446675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.508475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44342859-5610-496e-a716-44222149233e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8/ips" status: 200 len: 219 microversion: 2.1 time: 0.103894 Aug 25 12:53:05.524230 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1294/2516] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:53:05 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8/ips => generated 219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:05.536709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:05.538296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:05.557602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.559169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.560569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.562423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:05.563991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:05.567125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:05.623332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:05.773383 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba5f5266-6a87-4675-b744-cdf89c4a6bc6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 204 len: 0 microversion: 2.1 time: 0.246072 Aug 25 12:53:05.775351 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1295/2517] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:05 2022] DELETE /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:05.789311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4456e1f-f1c9-4d8c-800d-99b609642ca6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-326393848", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4456e1f-f1c9-4d8c-800d-99b609642ca6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 242 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-326393848", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-326393848', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9dc932d5-bde2-4a36-abc4-9eecafa781ce'}]}}} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:05.801460 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:05.812401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4456e1f-f1c9-4d8c-800d-99b609642ca6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:05.836735 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4456e1f-f1c9-4d8c-800d-99b609642ca6 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.033201 Aug 25 12:53:05.836735 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1296/2518] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:05 2022] POST /compute/v2.1/servers => generated 175 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:05.836735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d80bc5e2-1de9-437d-81db-f07c9517ec8c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2a1b9d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.002435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.022461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88511583-2ef9-4f7c-aac8-cef3100027ec tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.904675 Aug 25 12:53:06.024024 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1223/2519] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:05 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:06.060649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae995c7-76d8-421e-97de-2f781b807e2d", "name": "network-vif-unplugged", "status": "completed", "tag": "0ec599f1-bbde-407a-a6f2-9236d9ba168f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:06.070502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:06.082798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.083731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.084635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.110133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] Creating event network-vif-unplugged:0ec599f1-bbde-407a-a6f2-9236d9ba168f for instance 0ae995c7-76d8-421e-97de-2f781b807e2d on n-h1-850468-18 Aug 25 12:53:06.119808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f44951e7-d015-4dc3-b1cb-2b84dfbf291a req-1938333d-01d4-4699-b8aa-14f4414777f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073237 Aug 25 12:53:06.121484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1224/2520] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:06.131974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.133108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:06.145916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.146741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.147679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.149097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.150087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.150893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.212638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:06.371991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e05a4958-5c62-470c-81d1-4ee8eedcfbd9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "DELETE /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 204 len: 0 microversion: 2.1 time: 0.247909 Aug 25 12:53:06.373481 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1225/2521] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:06 2022] DELETE /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:06.385142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.386494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:06.398768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.399603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.400483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.401875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.402755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.403584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.831112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d80bc5e2-1de9-437d-81db-f07c9517ec8c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4" status: 202 len: 0 microversion: 2.1 time: 1.007931 Aug 25 12:53:06.832477 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1297/2522] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:05 2022] DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4 => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:06.851911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.853435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:06.853728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: 5b622bdb-fd17-47cc-be79-efb30e6d701f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:06.866149 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] HTTP exception thrown: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. Aug 25 12:53:06.879750 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61a0c10c-ec2c-4028-bfb2-7b92b27049b2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1528 microversion: 2.1 time: 0.503274 Aug 25 12:53:06.881135 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1226/2523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:06 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1528 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5b622bdb-fd17-47cc-be79-efb30e6d701f/metadata HTTP/1.1 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': '5b622bdb-fd17-47cc-be79-efb30e6d701f'} Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:06.886590 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:06.895765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:06.895765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:06.895765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. Aug 25 12:53:06.895765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:06.896348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:06.899286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 404 to user: Instance 5b622bdb-fd17-47cc-be79-efb30e6d701f could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:06.901514 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf4dd828-0040-4c3a-8811-31cbd6487020 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/5b622bdb-fd17-47cc-be79-efb30e6d701f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.058462 Aug 25 12:53:06.916732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1298/2524] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 12:53:06 2022] GET /compute/v2.1/servers/5b622bdb-fd17-47cc-be79-efb30e6d701f/metadata => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:06.929907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.930821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.931384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:06.931637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.932935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:06.952455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.953890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.955862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.957838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:06.958911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:06.959888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:06.967814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] Creating event network-changed:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h1-850468-18 Aug 25 12:53:06.982596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0648a24d-7655-4f09-9303-483e7aa63710 req-dd085400-9178-4c80-819f-1c59765f12e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099799 Aug 25 12:53:06.984472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1227/2525] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:06.997776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:07.000607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:07.014205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.014880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.015501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.016849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.018202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.019171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.529189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.538809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:07.546774 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82883c6b-eed0-42de-a9a7-7b64a6dae3a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1812 microversion: 2.1 time: 0.626351 Aug 25 12:53:07.547871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1299/2526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:06 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1812 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:07.556379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e7e3432f-70fe-41dc-b653-5521628eae4f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.567626 Aug 25 12:53:07.557616 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1228/2527] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:06 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:07.558666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aab267fc-f40b-4773-91be-df62ab2386b0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'create', calling method: .version_select at 0x7fc6c6c4e3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-204850280", "description": "tempest-description-2032897814"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:07.568543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee9fca29-bc9e-416a-94be-a8a1e74ffa35 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-101771234", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee9fca29-bc9e-416a-94be-a8a1e74ffa35 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 498 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-101771234", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-101771234', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9dc932d5-bde2-4a36-abc4-9eecafa781ce'}]}}} Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:53:07.577848 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:07.584671 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:07.589237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee9fca29-bc9e-416a-94be-a8a1e74ffa35 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:07.590830 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee9fca29-bc9e-416a-94be-a8a1e74ffa35 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030597 Aug 25 12:53:07.591929 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1229/2528] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:07.602804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:07.604240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:07.619367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.622561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.623491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.625101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:07.626106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:07.627649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:07.982977 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aab267fc-f40b-4773-91be-df62ab2386b0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.432391 Aug 25 12:53:07.984187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1300/2529] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 12:53:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:07.995107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-637362a6-8250-4bdb-9ad8-934ff1013a4f tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-595953571", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-637362a6-8250-4bdb-9ad8-934ff1013a4f tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 499 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-595953571", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-595953571', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9dc932d5-bde2-4a36-abc4-9eecafa781ce'}]}}} Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:53:08.004936 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-637362a6-8250-4bdb-9ad8-934ff1013a4f tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-637362a6-8250-4bdb-9ad8-934ff1013a4f tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.023566 Aug 25 12:53:08.013890 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1301/2530] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:07 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:53:08.022499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.023696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.026748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:08.038908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.040458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.041415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.042882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.044295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.045116 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b4c2eef6-653e-463a-ac8f-04047c05ffb5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.451005 Aug 25 12:53:08.045559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.057057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1230/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:07 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:08.075655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a9eae68-ea4f-4b7e-a2d7-f84c822f9206 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Action: 'update', calling method: .version_select at 0x7fc6c6aa4ee0>, body: {"security_group": {"name": "tempest-sg-hth-1619310401", "description": "tempest-description-hth-412636639"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:08.412564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:08.430109 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97ef6e32-9553-42a2-a008-34ae040ac585 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 200 len: 1528 microversion: 2.1 time: 0.415753 Aug 25 12:53:08.431224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1302/2532] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 1528 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:08.441556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92859dcf-38c5-43fa-b26c-26bf039645f0 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-604294144", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92859dcf-38c5-43fa-b26c-26bf039645f0 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 753 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-604294144", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-604294144', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9dc932d5-bde2-4a36-abc4-9eecafa781ce'}]}}} Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:53:08.450356 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:53:08.456158 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:53:08.461895 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.461895 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.461895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92859dcf-38c5-43fa-b26c-26bf039645f0 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:08.461895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92859dcf-38c5-43fa-b26c-26bf039645f0 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020263 Aug 25 12:53:08.461895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1303/2533] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:08 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 25 12:53:08.545439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a9eae68-ea4f-4b7e-a2d7-f84c822f9206 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "PUT /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975" status: 200 len: 217 microversion: 2.1 time: 0.483053 Aug 25 12:53:08.546929 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1231/2534] 10.222.0.60 () {60 vars in 1290 bytes} [Thu Aug 25 12:53:08 2022] PUT /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975 => generated 217 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:08.553087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3839f20-6247-45ce-9725-c797e9eaef59 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763293249", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3839f20-6247-45ce-9725-c797e9eaef59 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 1265 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763293249", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9dc932d5-bde2-4a36-abc4-9eecafa781ce"}]}} Aug 25 12:53:08.562905 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-763293249', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9dc932d5-bde2-4a36-abc4-9eecafa781ce'}]}}} Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.567917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:53:08.570291 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:53:08.574397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 25 12:53:08.574397 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.578961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c268676-0cbb-431e-a8e4-49805d4ed322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2c19f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.579254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3839f20-6247-45ce-9725-c797e9eaef59 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:08.579254 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3839f20-6247-45ce-9725-c797e9eaef59 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.035700 Aug 25 12:53:08.579254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1304/2535] 10.222.0.60 () {60 vars in 1148 bytes} [Thu Aug 25 12:53:08 2022] POST /compute/v2.1/servers => generated 2221 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 25 12:53:08.602851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.604176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.616937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.618065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.618909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.620325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.621221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.622029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.690148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c268676-0cbb-431e-a8e4-49805d4ed322 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975" status: 200 len: 217 microversion: 2.1 time: 0.124237 Aug 25 12:53:08.692370 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1232/2536] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975 => generated 217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:53:08.702287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.703596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.717671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] HTTP exception thrown: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb/metadata/test2 HTTP/1.1 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb', 'id': 'test2'} Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:08.721941 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 404 to user: Instance e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-085a78e6-21be-497d-9c22-7b810df827a9 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.030837 Aug 25 12:53:08.730085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1233/2537] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/e9fa68e6-2199-4cb1-9e8e-6d8f550ac8cb/metadata/test2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:08.747628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:08.752261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:08.765176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.766203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.767097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:08.769513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:08.770602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:08.771403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:09.798078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:09.818358 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79c3dfd7-e9d0-49c5-a932-df38051b64ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1812 microversion: 2.1 time: 1.223491 Aug 25 12:53:09.822069 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1305/2538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1812 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:09.849089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ca6795f-66f9-45ef-ba57-3f90ad2f6909 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2a88dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:10.225578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:10.243737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00d8f34b-809d-4bc7-89cb-99ec1951df4a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 1.514467 Aug 25 12:53:10.245921 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1234/2539] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:08 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:10.263953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:10.272548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:10.302724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.303364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.304233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.305631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.307339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.309136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.388504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:10.614059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e88ea8ad-19e4-43d8-86fc-d1117c572516 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 204 len: 0 microversion: 2.1 time: 0.364182 Aug 25 12:53:10.620772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1235/2540] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:10 2022] DELETE /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:10.640190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516c777e-b658-4e2a-9d24-4901a53feea4", "tag": "e0357310-887d-45ab-bc81-15892fddaca4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:10.670478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.671408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.672478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.704148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] Creating event network-changed:e0357310-887d-45ab-bc81-15892fddaca4 for instance 516c777e-b658-4e2a-9d24-4901a53feea4 on n-h1-850468-18 Aug 25 12:53:10.716650 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5e2304d4-f6a2-468b-98d5-40e673047478 req-5a3b48a9-e768-41d1-af1b-532269e6406e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089077 Aug 25 12:53:10.718008 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1236/2541] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:10.730671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:10.731942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:10.743839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.744722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.745550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:10.746903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:10.748969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:10.749939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.321091 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ca6795f-66f9-45ef-ba57-3f90ad2f6909 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975" status: 202 len: 0 microversion: 2.1 time: 1.496652 Aug 25 12:53:11.322291 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1306/2542] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:09 2022] DELETE /compute/v2.1/os-security-groups/5aae8821-74ae-42f7-93a3-51c038860975 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:11.331507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:11.333068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:11.347790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.348834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.349704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.351368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.352384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.353207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.385186 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d HTTP/1.1 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d'} Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:11.388499 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fefd6771-409c-4079-84ab-34cf5fabb6c6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 404 len: 111 microversion: 2.1 time: 0.067193 Aug 25 12:53:11.397614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1307/2543] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:11 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:11.411094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae995c7-76d8-421e-97de-2f781b807e2d", "name": "network-vif-deleted", "tag": "0ec599f1-bbde-407a-a6f2-9236d9ba168f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:11.430279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.431153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.431995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.458013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] Creating event network-vif-deleted:0ec599f1-bbde-407a-a6f2-9236d9ba168f for instance 0ae995c7-76d8-421e-97de-2f781b807e2d on n-h1-850468-18 Aug 25 12:53:11.469839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b52e47a3-153d-43d6-ad38-4db26f713f7a req-50dc518a-c7ee-43b2-a73e-595b86c256d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062499 Aug 25 12:53:11.470637 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1308/2544] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:11.481131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:11.482608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:11.496368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.497333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.498193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.499531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.500473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.501283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.545875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:11.564375 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5ffb77a8-b1c4-41eb-8088-cd77bdb64971 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.844176 Aug 25 12:53:11.567141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1237/2545] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:10 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:11.577235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:11.579457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:11.594971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.596682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.597551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:11.598936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:11.599826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:11.600687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.233873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.243294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:12.256745 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-49fd5aed-d5c9-4b8c-8f0a-f50a8f26d657 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1527 microversion: 2.1 time: 0.783659 Aug 25 12:53:12.258379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1309/2546] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:11 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1527 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:12.267737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:12.269606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.292546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.293623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.294735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.296372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.297305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.298100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.467791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.480079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c380e661-db34-4d00-8e1a-1e61408ee56d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1812 microversion: 2.1 time: 0.910877 Aug 25 12:53:12.486425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1238/2547] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:11 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1812 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:12.498215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:12.499446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.512966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.513825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.514561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.515770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.517130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.518467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.560249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd HTTP/1.1 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd'} Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:12.563878 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e427f261-4e9d-4018-a92c-a94e63ba1de9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 404 len: 111 microversion: 2.1 time: 0.078376 Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1239/2548] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:12 2022] DELETE /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:12.580139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6116ac72-5364-4e94-95fb-e7ccc0d4f2de tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'create', calling method: .version_select at 0x7fc6c2e4e790>, body: {"keypair": {"name": "tempest-keypair-2101641616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEROUIouQjyPHxheC8tkKo0j3q+DDTSl3RCL9MF3VKcLM40YjkIQX5plkgiMFmeHR1eUyHkLKSxIBpM1c+LM4HIqljPqDI02jYQVuUhfzXqYnN1QwYB7UV9Fv0ZTgnpfjg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:12.618163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6116ac72-5364-4e94-95fb-e7ccc0d4f2de tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:12.631904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6116ac72-5364-4e94-95fb-e7ccc0d4f2de tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for user 8a26316f4ba04e8598ae218980ef72f0 and project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:12.685751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6116ac72-5364-4e94-95fb-e7ccc0d4f2de tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114820 Aug 25 12:53:12.687444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1240/2549] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:53:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:12.698423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:12.700438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.720415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.722081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.722929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.724349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.725207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.726339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.760266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd HTTP/1.1 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd'} Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:12.764045 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Instance cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d90c41f1-4d37-4834-96df-e3bf3158b86d tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd" status: 404 len: 111 microversion: 2.1 time: 0.077790 Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1241/2550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:12 2022] GET /compute/v2.1/servers/cb6e3495-2b9c-4660-8e4a-5e2f3bf095cd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:12.786255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:12.800308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.800308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.800308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.802047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:12.804151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:12.804507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:12.815148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:12.866989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:12.881687 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7c06ffc-7748-416e-8772-c890e73fc268 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.621349 Aug 25 12:53:12.883584 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1310/2551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:12 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:12.893204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c25d9ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.040480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:13.041850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group c9699a1f-a88b-424d-914c-e303d3c717f4 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:13.042932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.042932 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4 HTTP/1.1 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'c9699a1f-a88b-424d-914c-e303d3c717f4'} Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:13.047586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] Aug 25 12:53:13.057547 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.068169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group c9699a1f-a88b-424d-914c-e303d3c717f4 does not exist Aug 25 12:53:13.068169 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f23061bc-a038-4156-a8dc-33508899fd00'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:13.068169 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-047bfd2e-44f0-490f-81ed-70c6ce296a51 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4" status: 404 len: 194 microversion: 2.1 time: 0.180618 Aug 25 12:53:13.068169 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1311/2552] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:12 2022] DELETE /compute/v2.1/os-security-groups/c9699a1f-a88b-424d-914c-e303d3c717f4 => generated 194 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:13.077730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-deleted", "tag": "6d42af78-3184-47e2-a375-1bae7d81bc40"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:13.100439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.101328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.102364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.126268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] Creating event network-vif-deleted:6d42af78-3184-47e2-a375-1bae7d81bc40 for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:53:13.138972 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fd0b8763-def9-4f85-ace9-3c60b49453c6 req-3f4aa71b-394d-4469-81fc-bd72d5e67ae2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068382 Aug 25 12:53:13.141513 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1312/2553] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:13.155584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c25d98b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.253470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:13.255488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:13.256749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:13.258234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.258234 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.278422 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fcb353a-ae34-4184-b640-8a22be1cedef tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.506860 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50 HTTP/1.1 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '26b5ab33-eac3-4b73-973b-4bf0ed02fc50'} Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:13.280647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group 26b5ab33-eac3-4b73-973b-4bf0ed02fc50 does not exist Aug 25 12:53:13.298132 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-cd32686e-5d06-4078-aacb-d3dc7b25c64b'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:13.306991 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1242/2554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:12 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:13.307161 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1adef286-75a9-4760-a168-c2aa5b58a7b3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50" status: 404 len: 194 microversion: 2.1 time: 0.157882 Aug 25 12:53:13.316500 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1313/2555] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:13 2022] DELETE /compute/v2.1/os-security-groups/26b5ab33-eac3-4b73-973b-4bf0ed02fc50 => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:13.319926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.322273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:13.336096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.337658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.338925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.339152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c271f280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.341118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.342436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.343877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.492494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:13.494857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:13.506848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.506848 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768 HTTP/1.1 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2b3826bd-dd3a-4fdd-9652-3124dc0bd768'} Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:13.513672 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group 2b3826bd-dd3a-4fdd-9652-3124dc0bd768 does not exist Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-715776fe-d6fc-4e87-9c39-fd5974037f57'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a1a074c-0032-4417-af4c-a1485a63a5cb tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768" status: 404 len: 194 microversion: 2.1 time: 0.191790 Aug 25 12:53:13.523874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1314/2556] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:13 2022] DELETE /compute/v2.1/os-security-groups/2b3826bd-dd3a-4fdd-9652-3124dc0bd768 => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:13.533175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:13.536215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:13.561882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.567286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.568630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:13.569971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:13.570857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:13.571770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.343679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78048f0fdaeb4a5ca5c1e9f76cedba18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a0d5a0420e47fd81ef568bc3b67a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:14.368047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b97e1f6-a248-4953-a3ad-a23fbc6a80c5 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 200 len: 1527 microversion: 2.1 time: 1.064233 Aug 25 12:53:14.370817 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1243/2557] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:13 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 1527 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:14.406490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6c78a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:14.420482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:14.440566 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54fa8550-ece3-4d1c-ae63-7665ea4c9e57 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1791 microversion: 2.1 time: 0.916583 Aug 25 12:53:14.442141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1315/2558] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:13 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1791 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:14.452946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-unplugged", "status": "completed", "tag": "8c161384-577f-4b39-b0df-55a8557ee90f"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:14.473099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.488379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.489890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.508927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:14.509552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.security_group_api [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group d0b791e3-b759-4078-b53f-90379b8e00c3 not found {{(pid=122700) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:14.510096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.510096 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3 HTTP/1.1 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: exception: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd0b791e3-b759-4078-b53f-90379b8e00c3'} Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:14.512170 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group d0b791e3-b759-4078-b53f-90379b8e00c3 does not exist Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-23f6d2d7-6a00-482a-b013-64ebbfc2f8c5'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:14.520695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64971675-84bb-47e1-b02b-9cc5fea36d7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3" status: 404 len: 194 microversion: 2.1 time: 0.141446 Aug 25 12:53:14.529670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1244/2559] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:14 2022] DELETE /compute/v2.1/os-security-groups/d0b791e3-b759-4078-b53f-90379b8e00c3 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:14.529670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:14.529670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:14.534861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] Creating event network-vif-unplugged:8c161384-577f-4b39-b0df-55a8557ee90f for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:53:14.540447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.541049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.541516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.542308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.543659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.544555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.547742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7c5c01cf-e523-4ccc-8cfa-fdd859575a94 req-a97d9296-9002-4a6a-b30f-6b838eff40d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102504 Aug 25 12:53:14.550743 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1316/2560] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:14.567026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:14.569141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:14.593592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.593592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.593592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:14.599193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:14.600140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:14.602054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.284214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:15.303742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9ce7881-37bf-48db-99a5-b8b217c7057a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.781145 Aug 25 12:53:15.306063 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1245/2561] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:14 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:15.317307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2c17280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.570137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:15.580709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG neutronclient.v2_0.client [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist", "detail": ""}} {{(pid=122700) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:15.581862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.security_group_api [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 not found {{(pid=122700) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:15.583116 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.583116 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65 HTTP/1.1 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: exception: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'aec5b1b3-31db-4980-bf27-66f68ab5ac65'} Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:15.588039 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group aec5b1b3-31db-4980-bf27-66f68ab5ac65 does not exist Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: Neutron server returns request_ids: ['req-d2d15e7f-b4bb-48ff-a9f2-302b58cb31fd'] {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:15.596912 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3ecd8ee-594b-4cff-9edd-72cd3141e9c3 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65" status: 404 len: 194 microversion: 2.1 time: 0.282342 Aug 25 12:53:15.607486 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1246/2562] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:15 2022] DELETE /compute/v2.1/os-security-groups/aec5b1b3-31db-4980-bf27-66f68ab5ac65 => generated 194 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:15.607690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7a07599-f629-4b11-8fa8-8ce2926ad2bf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 1.049499 Aug 25 12:53:15.607690 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1317/2563] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:14 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:15.613497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d53d28e6-e70b-4861-9408-96017126c642", "name": "network-vif-deleted", "tag": "a4728c70-5a9a-484c-b9f1-b30c7f10007a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:15.644973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.646173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] [instance: d53d28e6-e70b-4861-9408-96017126c642] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:15.658797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.659964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.660865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.671137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.672013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.672846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.674296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.675154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.676159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.716338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] Creating event network-vif-deleted:a4728c70-5a9a-484c-b9f1-b30c7f10007a for instance d53d28e6-e70b-4861-9408-96017126c642 on n-h2-850468-18 Aug 25 12:53:15.731769 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] HTTP exception thrown: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Request method failure captured: Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 HTTP/1.1 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3CKD1JZfxKMwwz0jc9KibxxC--nzY3zxU_k4QhydiDZ4tpRRa0gdLgAzBAa_91nu0WRTpK1WJfH4DxQPIO7G5yp2i9njST9db47E8gazpnJTPJJ2RJcasmEWB5rVZrXUdcq9f5lJBg2SBHaLE-31SzBRZMPyHqherfuBnveoa-o6kI Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/16a0d5a0420e47fd81ef568bc3b67a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 16a0d5a0420e47fd81ef568bc3b67a8c Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1114975358 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 78048f0fdaeb4a5ca5c1e9f76cedba18 Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1114975358-project Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd53d28e6-e70b-4861-9408-96017126c642'} Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.735223 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] Returning 404 to user: Instance d53d28e6-e70b-4861-9408-96017126c642 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:15.747085 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-624f5607-4adc-4e62-8231-47b7ac432c06 tempest-ServerMetadataNegativeTestJSON-1114975358 tempest-ServerMetadataNegativeTestJSON-1114975358-project] 10.222.0.60 "GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642" status: 404 len: 111 microversion: 2.1 time: 0.113155 Aug 25 12:53:15.749452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6a94bcb2-a6ff-406c-8f74-768b54167a7b req-f8a88e45-a8d2-4368-ac59-2d903d9b772c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148790 Aug 25 12:53:15.750521 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1247/2564] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:15.755348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1318/2565] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:15 2022] GET /compute/v2.1/servers/d53d28e6-e70b-4861-9408-96017126c642 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:15.766592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c6b23430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.769457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.771051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:15.795262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.796625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.797026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.798336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.799287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.800013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.868102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 12:53:15.869264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Neutron security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 12:53:15.870230 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.870230 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 HTTP/1.1 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3b4f3daa-3c97-4d70-a3aa-30feb514daa8'} Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 12:53:15.874166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Security group 3b4f3daa-3c97-4d70-a3aa-30feb514daa8 does not exist Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-f12d256a-d346-40d0-8e40-a9680fc4c8ee'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:15.886621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7193054-e144-45d4-ada0-b616ff6fdd3c tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8" status: 404 len: 194 microversion: 2.1 time: 0.118906 Aug 25 12:53:15.903006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1319/2566] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:15 2022] DELETE /compute/v2.1/os-security-groups/3b4f3daa-3c97-4d70-a3aa-30feb514daa8 => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:15.905138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:15.906077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:15.943813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.949023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.949951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:15.961271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:15.962567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:15.963512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:16.024024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:16.219214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b6cdc9e-af62-40f2-89a4-9ca71dcf9e7f tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 204 len: 0 microversion: 2.1 time: 0.321883 Aug 25 12:53:16.226852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1320/2567] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:15 2022] DELETE /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:16.240324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:16.242157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:16.255308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:16.256466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:16.257303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:16.260009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:16.272160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:16.273559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.059135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:17.075670 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d989120b-a529-48bb-9dff-b148ab1a4fc0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1676 microversion: 2.1 time: 1.323424 Aug 25 12:53:17.076950 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1248/2568] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:15 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1676 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:17.087757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:17.089417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:17.102411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.103931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.105223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.107989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.109136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.110330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.254014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:17.267253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8dc7c215-39bb-4158-982d-84000bc7f3b9 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1645 microversion: 2.1 time: 1.036208 Aug 25 12:53:17.269201 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1321/2569] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:16 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1645 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:17.277581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:17.279229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:17.305757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.306675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.307846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.309764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.310608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.311461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.851519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:17.880379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0dd20120-65d7-4450-90c3-faf882869bec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.801683 Aug 25 12:53:17.881913 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1249/2570] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:17 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:17.893622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-unplugged", "status": "completed", "tag": "7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:17.899506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:17.915683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:17.917094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:17.918213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:17.926906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4452d47b-a4df-4a8a-a24c-fedd23bdfed6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.655612 Aug 25 12:53:17.946832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] Creating event network-vif-unplugged:7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:53:17.956278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1322/2571] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:17 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:17.969246 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b405ba52-18e9-4811-93ae-e8594471b8ba req-57402bcd-a9f8-41ac-83e3-2d9cf44bc498 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076017 Aug 25 12:53:17.971636 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1250/2572] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:17.981912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-984553359", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:17.985987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645c3612-08b0-4e63-a69d-5d6167acb782"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:17.998476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:18.021834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.024789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.026054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.027736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.029378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.030567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.216015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] validate_networks() for [('fabf892b-f355-4faa-8957-7370362aa48d', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:18.837369 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e16b84ac-78b7-464e-ac9e-c188b4c1ad98 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.862218 Aug 25 12:53:18.839021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1251/2573] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 12:53:17 2022] POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:18.886372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-deleted", "tag": "8c161384-577f-4b39-b0df-55a8557ee90f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:18.915460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:18.918557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:18.919897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:18.960414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] Creating event network-vif-deleted:8c161384-577f-4b39-b0df-55a8557ee90f for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:53:18.980451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-524d3c04-8d27-4e36-8307-a7acc6b6a223 req-819e4fc1-938e-4669-9900-3fcb9970c645 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134684 Aug 25 12:53:18.982426 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1252/2574] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:18.996923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:18.998933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:19.030035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:19.031718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:19.035604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:19.052824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:19.056998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:19.059776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.745547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:20.774176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ce62339-7972-4134-846f-d4cf1892d26f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1655 microversion: 2.1 time: 1.787415 Aug 25 12:53:20.796157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1253/2575] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:18 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1655 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:20.819128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:20.819625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:20.833334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.834855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.836091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:20.838065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:20.839382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:20.840703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.269172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:21.270010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:21.272612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:21.272612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:21.273031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:21.323819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.325455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.326461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.327981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.334568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.335669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.416461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:21.462234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:21.500164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for user 8a26316f4ba04e8598ae218980ef72f0 and project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:21.574228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:21.591438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:21.633050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:21.668494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78fbc8e7-b90d-4c56-8838-56edc5beef29 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1645 microversion: 2.1 time: 0.874052 Aug 25 12:53:21.675839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1254/2576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:20 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1645 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:21.707215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:21.711425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:21.745951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.747141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.754152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.756220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.759460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.765286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.895461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e988b1aa-f1b5-4625-9a05-629e7395ac39 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.925882 Aug 25 12:53:21.900890 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1323/2577] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:21.938939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:21.949174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:21.976688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.977958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.979633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:21.982528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:21.983847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:21.985029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:22.646349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:23.192549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:23.244383 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-800f4610-82f3-402c-b669-9bac30cc6aed tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 1.566350 Aug 25 12:53:23.258387 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1255/2578] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:21 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:23.275461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516c777e-b658-4e2a-9d24-4901a53feea4", "name": "network-vif-plugged", "status": "completed", "tag": "e0357310-887d-45ab-bc81-15892fddaca4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:23.282672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:23.327719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.329786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.331298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.334938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1eeaa603-1fa0-48cd-9ced-2f1841cb3513 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 1.431589 Aug 25 12:53:23.348161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1324/2579] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:21 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:23.359383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:23.365632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:23.396672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.397595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.398475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.400070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.405857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] Creating event network-vif-plugged:e0357310-887d-45ab-bc81-15892fddaca4 for instance 516c777e-b658-4e2a-9d24-4901a53feea4 on n-h1-850468-18 Aug 25 12:53:23.409092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.410020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.426110 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-29004364-483c-4a45-974c-fac449894f55 req-060e9ba7-0f75-47db-870d-c51729f5a00f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160083 Aug 25 12:53:23.429531 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1256/2580] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:23.444717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-597f65b1-c0e0-44d0-8c57-470855f2f96d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:23.448715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-597f65b1-c0e0-44d0-8c57-470855f2f96d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:23.544033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:23.548876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:23.551207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:23.551207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lazy-loading 'fault' on Instance uuid 572ee41e-718b-49dd-9343-c24431e0e1d8 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:23.965070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-597f65b1-c0e0-44d0-8c57-470855f2f96d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:23.985992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.032824 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72b55a96-a417-463a-a45d-b05fe51bea70 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 200 len: 1303 microversion: 2.1 time: 0.694589 Aug 25 12:53:24.040561 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-597f65b1-c0e0-44d0-8c57-470855f2f96d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1224 microversion: 2.1 time: 0.607887 Aug 25 12:53:24.062151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1257/2581] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:23 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1224 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:24.062906 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1325/2582] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:23 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 1303 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:24.104692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572ee41e-718b-49dd-9343-c24431e0e1d8", "name": "network-vif-deleted", "tag": "7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb"}, {"server_uuid": "0920b852-6d75-4301-ac86-f5421b17a5aa", "name": "network-vif-deleted", "tag": "9b871e64-753c-4e68-ac11-633b445b3c30"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:24.113568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:24.115199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:24.151914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.171373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.189771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.191540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.194076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.198093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.200949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.204442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.209400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.312555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Creating event network-vif-deleted:7c241ce0-f58b-4f13-9e52-53d3ff4bb3cb for instance 572ee41e-718b-49dd-9343-c24431e0e1d8 on n-h1-850468-18 Aug 25 12:53:24.325497 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] Creating event network-vif-deleted:9b871e64-753c-4e68-ac11-633b445b3c30 for instance 0920b852-6d75-4301-ac86-f5421b17a5aa on n-h2-850468-18 Aug 25 12:53:24.354000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.354835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.355260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.363554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lazy-loading 'fault' on Instance uuid 0920b852-6d75-4301-ac86-f5421b17a5aa {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:24.371116 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0ef643fe-5f29-4224-b59e-33521b25b912 req-80384664-92d9-4e6e-b8d4-1f7e765bcc3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.301381 Aug 25 12:53:24.373396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1258/2583] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:24.389953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:24.394975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:24.430399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.431682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.433800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.437178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.438615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.440353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.507083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c8cd80349d47fba0afe81f8f93923c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcc4efcc4bb4e33b110b6c8c2fea54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:24.526319 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6543cef2-22a1-4691-ace5-e6e5a43855ac tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 200 len: 1304 microversion: 2.1 time: 0.460845 Aug 25 12:53:24.556723 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1326/2584] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:24 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 1304 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:24.575485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:24.576781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:24.600866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.603320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.604979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:24.606695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:24.608206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:24.609296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.123947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:25.155668 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-484d2511-60e1-4637-be39-2c42a29c9f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 0.596991 Aug 25 12:53:25.190249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:25.197925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1327/2585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:24 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:25.212500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:25.214219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:25.225228 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-238bcd8f-ca77-45fc-b59d-aacdedc49b73 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1320 microversion: 2.1 time: 0.846745 Aug 25 12:53:25.228056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1259/2586] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:24 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1320 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:25.228977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.230451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.231941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.234102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.235540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.237618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.249020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:25.250317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:25.291327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.293409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.298209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.317634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.319611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.327958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.396988 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 HTTP/1.1 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '572ee41e-718b-49dd-9343-c24431e0e1d8'} Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:25.401538 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cd9a2b7-9db8-4d21-b530-dad4c8c5b7fc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 404 len: 111 microversion: 2.1 time: 0.177379 Aug 25 12:53:25.417051 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1260/2587] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:25 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:25.545666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:25.572688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:25.573765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] [instance: 0920b852-6d75-4301-ac86-f5421b17a5aa] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:25.613227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.614525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.615788 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6de157bc-7b2d-4975-9347-9eac0bb221f3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1220 microversion: 2.1 time: 0.384541 Aug 25 12:53:25.618135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.620665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1328/2588] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:25 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1220 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:25.628385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.629853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.631093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.679809 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] HTTP exception thrown: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Request method failure captured: Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa HTTP/1.1 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_e4Wn0jf19xuZRlRXrOONEaLxxtJSAn1us7O-JN2CJEQksBfj9SlwK2C67lwal8fq9ErswEBJvbhJbwj4BJ9A9SOAf0RDJyJiJDys93mTUbAaLjsE5GYNo6CGDsxTMdj-dhgOW8PR4OdOe5dX-zkW-LEmJSTjKom-3MnKdvyePWmo Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9fcc4efcc4bb4e33b110b6c8c2fea54d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 9fcc4efcc4bb4e33b110b6c8c2fea54d Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437831926 Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 90c8cd80349d47fba0afe81f8f93923c Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupsTestJSON-1437831926-project Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0920b852-6d75-4301-ac86-f5421b17a5aa'} Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:25.683832 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:25.694134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Returning 404 to user: Instance 0920b852-6d75-4301-ac86-f5421b17a5aa could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:25.695109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "name": "network-vif-plugged", "status": "completed", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:25.696948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5f1d69f-b837-46dd-840c-0f2c27adfbb0 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa" status: 404 len: 111 microversion: 2.1 time: 0.122308 Aug 25 12:53:25.699010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1261/2589] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:25 2022] GET /compute/v2.1/servers/0920b852-6d75-4301-ac86-f5421b17a5aa => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:25.713313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53b97e84-b95c-42c2-8f0e-6520e9dbdd90 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c2f51040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:25.743103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:25.743953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:25.752802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:25.801400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] Creating event network-vif-plugged:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h1-850468-18 Aug 25 12:53:25.824808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3b695459-c17c-438a-823f-fa464b566bf7 req-7a5f336d-cd57-48cb-8f07-6f222f457a10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148225 Aug 25 12:53:25.831161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1329/2590] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:26.239603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:26.279334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:26.311852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:26.317666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:26.319124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:26.321581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:26.325343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:26.327705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:26.342931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53b97e84-b95c-42c2-8f0e-6520e9dbdd90 tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/ac9f4a06-1427-409e-823a-00717387dace" status: 202 len: 0 microversion: 2.1 time: 0.637105 Aug 25 12:53:26.346559 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1262/2591] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:25 2022] DELETE /compute/v2.1/os-security-groups/ac9f4a06-1427-409e-823a-00717387dace => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:53:26.368190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:26.370045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:26.407142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:26.417089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:26.418205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:26.424322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:26.432016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:26.433291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.304308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:27.351356 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-112599d7-17b8-4649-9934-a4c2dfddca6a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1501 microversion: 2.1 time: 1.002356 Aug 25 12:53:27.358650 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1263/2592] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:26 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1501 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:27.374024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-346876ff-6194-4ad1-8074-f0b20a693d0a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] Calling method '.version_select at 0x7fc6c265f940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:27.538449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:27.566967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8759d198-218a-4a3b-8997-36c8a044fa41 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 1.368772 Aug 25 12:53:27.591429 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1330/2593] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:26 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:27.615099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:27.616894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:27.629300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.630776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.632044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.633787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:27.635024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:27.636265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:27.676305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:28.470280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:28.491042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3311727-28b2-43bb-966c-6fed402b13b6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1282 microversion: 2.1 time: 0.897215 Aug 25 12:53:28.493141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1331/2594] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:27 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1282 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:28.503619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:28.505816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:28.518935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:28.520719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:28.521971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:28.523771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:28.525364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:28.526911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.375717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:29.403084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54c01935-4fdd-433b-96bd-17099a72e182 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1501 microversion: 2.1 time: 0.907263 Aug 25 12:53:29.429001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1332/2595] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:28 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1501 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:29.458535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.464139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:29.486761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.488344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.490160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.492005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:29.493281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:29.494426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:29.961847 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-346876ff-6194-4ad1-8074-f0b20a693d0a tempest-SecurityGroupsTestJSON-1437831926 tempest-SecurityGroupsTestJSON-1437831926-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/c956454e-61ec-441d-86a5-c27980ae54bb" status: 202 len: 0 microversion: 2.1 time: 2.600241 Aug 25 12:53:29.969160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1264/2596] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 12:53:27 2022] DELETE /compute/v2.1/os-security-groups/c956454e-61ec-441d-86a5-c27980ae54bb => generated 0 bytes in 2604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:29.991277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:29.996009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:30.050030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.050952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.051805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.053312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.058357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.059924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.198735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:53:30.447995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:30.533210 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34ee2314-1d3f-4900-9adf-1379634529f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 204 len: 0 microversion: 2.1 time: 0.566371 Aug 25 12:53:30.535317 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1265/2597] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:53:29 2022] DELETE /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:53:30.549192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:30.551494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:30.563459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:30.567998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.569286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.570950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.573093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.574195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.575110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.795035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:30.826121 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b77647d7-dd43-40cb-aee9-f362f799a0b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1313 microversion: 2.1 time: 1.384025 Aug 25 12:53:30.834015 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1333/2598] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:29 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1313 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:30.852588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:30.854182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:30.871980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.873515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.874613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:30.876331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:30.878131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:30.879252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:31.039845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:31.080169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e727f2c-a123-403f-bc5c-80c64fbef498 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1282 microversion: 2.1 time: 0.541724 Aug 25 12:53:31.100079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1266/2599] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:30 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1282 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:31.398965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:31.545666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:31.883199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:31.889271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:31.928001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:31.928959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:31.929770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:31.931117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:31.932000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:31.951360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.396471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:32.434436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-133c7f9b-974f-4927-87c5-61704ea036ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1507 microversion: 2.1 time: 1.598043 Aug 25 12:53:32.440932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1334/2600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:30 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1507 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:32.459006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:32.460040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:32.490898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.491542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.494800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.496282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:32.498978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:32.505032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:32.916558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:32.954672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-090a81e9-e5e8-42f5-9ad4-5a4fdf5a8fdf tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1282 microversion: 2.1 time: 0.506778 Aug 25 12:53:32.961843 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1335/2601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:32 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:33.336962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:33.364526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-379811577", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:33.365422 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d395b38e-c1f6-4071-bda7-728b6cf69428 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1463 microversion: 2.1 time: 1.492841 Aug 25 12:53:33.367332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1267/2602] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:31 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1463 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:33.510144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:33.512671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:33.514031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:33.515164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:33.516550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:33.540647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.543500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.544777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.546518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.549175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.550263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.596163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Getting quotas for project ccf648b9836b4eb588e6d48f2ad5c979. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:33.609513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Getting quotas for user a8086637e390483cbf8fe637abc4e0d6 and project ccf648b9836b4eb588e6d48f2ad5c979. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:33.648580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:33.655769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:33.713706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:33.718574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:33.768749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.772849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.775752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.780896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.781911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.784908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.847271 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6a99f21-705d-419b-94e0-9bc91d627125 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.874291 Aug 25 12:53:33.848856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1336/2603] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:53:33.877469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:33.879369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:33.906275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.914840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.916529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:33.924225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:33.926048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:33.927442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:34.005444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:35.342634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:35.381810 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-926811d4-4817-4f04-97c1-1f2ac1a749fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1507 microversion: 2.1 time: 1.530334 Aug 25 12:53:35.383862 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1337/2604] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:33 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1507 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:35.394810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:35.396620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:35.420756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:35.422065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:35.422864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:35.430932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:35.432264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:35.433391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:36.031783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:36.077200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:36.084813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:36.087742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f2aed525-edee-4e40-9f10-696a79cb1d55 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1281 microversion: 2.57 time: 0.701006 Aug 25 12:53:36.108358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1338/2605] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:35 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1281 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:36.136442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:36.146295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:36.159370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:36.159587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:36.160265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:36.161938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:36.174362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:36.190275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.766537 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c170c288-31ed-40ab-a71c-3afb961cb92f tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1616 microversion: 2.1 time: 4.362923 Aug 25 12:53:37.771334 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1268/2606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:33 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1616 bytes in 4372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:37.779491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:37.780880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:37.821162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:37.822070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:37.824193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.839667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:37.842468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:37.844680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:37.998115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.041670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89bd7621-b6f9-4f4a-93b6-47095d55ad21 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 1.930825 Aug 25 12:53:38.054752 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1339/2607] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:36 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:38.064748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:38.073065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:38.102094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.103532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.104893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.119155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.121265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.122414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.447755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.458163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.488435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b221016c-6110-436e-81b9-c1bdb0aa9d3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1465 microversion: 2.1 time: 0.714574 Aug 25 12:53:38.493030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1269/2608] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:37 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1465 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:38.499294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.509573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.510456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516c777e-b658-4e2a-9d24-4901a53feea4", "name": "network-vif-deleted", "tag": "e0357310-887d-45ab-bc81-15892fddaca4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:38.514501 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6146c052-3503-494c-bae1-154ec07b8aa8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1335 microversion: 2.57 time: 0.456787 Aug 25 12:53:38.517925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1340/2609] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:38 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1335 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:38.555573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:38.556977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:38.574317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.578711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.581924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.582617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.583502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.584310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.584989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:38.588059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:38.589943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:38.649968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] Creating event network-vif-deleted:e0357310-887d-45ab-bc81-15892fddaca4 for instance 516c777e-b658-4e2a-9d24-4901a53feea4 on n-h1-850468-18 Aug 25 12:53:38.690084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-db9f4c12-a5e6-44bf-b1eb-332984e72235 req-9473f2bc-55c3-4aa7-a3ce-0a206088267e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190275 Aug 25 12:53:38.694256 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1270/2610] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:38.890260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77f6b482b5784340b298a855a843f9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d9c92ddaae4ef79be3aa8602b0e933', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:38.901754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] flavor_id is None. Assuming migration. {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 12:53:38.902731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:53:39.114279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:39.116075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:39.134904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.136199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.137105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.139776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.141186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.144346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.530486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-644dcd81-978f-40a8-99d2-d2dad823f6ef tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577/action" status: 202 len: 0 microversion: 2.1 time: 1.009585 Aug 25 12:53:39.533556 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1341/2611] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:53:38 2022] POST /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:53:39.543951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:39.545706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:39.562452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.564050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.565938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.567322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.568238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.569044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.838028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:39.895537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73af3c80-5dbf-40c7-88ed-dbd8fea29bc8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1465 microversion: 2.1 time: 0.355713 Aug 25 12:53:39.912372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1342/2612] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:39 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1465 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:39.934370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:39.938087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:39.953720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.954970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.958620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:39.960389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:39.961603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:39.962849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.444656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:40.473064 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8319f31b-2366-4025-914c-9bcfa4bcfd43 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 1.374060 Aug 25 12:53:40.475095 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1271/2613] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:39 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:53:40.501475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:40.503881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:40.520354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.521724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.522921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:40.524460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:40.525422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:40.526988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.020722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:41.040816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:41.044924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:41.047998 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-685dc57e-2616-4e5e-9b34-ba65991ec04b tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1335 microversion: 2.57 time: 0.570094 Aug 25 12:53:41.065579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1272/2614] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:40 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1335 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:41.094604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:41.100336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:41.111880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.113676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.114959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.116677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.117875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.118994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.224944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'flavor' on Instance uuid 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:41.390816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:41.417756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64eab906-3844-48f7-bb68-0f8c11c90f3f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1472 microversion: 2.1 time: 1.503307 Aug 25 12:53:41.420364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1343/2615] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:39 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1472 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:41.433934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:41.435744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:41.450801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.451582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.452493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.453870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.455890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.457093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.536743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.538118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.539171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.541284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'fault' on Instance uuid 516c777e-b658-4e2a-9d24-4901a53feea4 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:53:41.637752 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9756558-99b7-4b46-bbbc-bfbcd32c77fb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/action" status: 200 len: 32 microversion: 2.1 time: 0.569875 Aug 25 12:53:41.642966 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1273/2616] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:53:41 2022] POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/action => generated 32 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:53:41.653864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:41.658245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:41.688763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.691894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.693991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.697095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.698224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.701141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.833253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:41.866157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5925c06e-2837-4f2c-a6d8-c178e47b4cb1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 200 len: 1310 microversion: 2.1 time: 0.443554 Aug 25 12:53:41.873895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1344/2617] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:41 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:41.906266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:41.914347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:41.939016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.945709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.949409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:41.950755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:41.951732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:41.952535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.216215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:43.251224 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e65c306e-66a2-4167-a01e-6e885dbd35ed tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 1.603046 Aug 25 12:53:43.282903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1274/2618] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:41 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:43.293152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:43.297814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:43.312722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.315141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.316833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.318723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.319968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.321155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.428962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:43.469904 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5db10811-3552-4eea-8b27-81eaa02cb555 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 1.593506 Aug 25 12:53:43.471018 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1345/2619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:41 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:43.484017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:43.496635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:43.518704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.519861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.522890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.523428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:43.524381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:43.525190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:43.574409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:43.628761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:43.961969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:43.993585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:43.999666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:44.003919 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5413e599-2ba0-4a4a-a7ed-3b36cdfb4783 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1356 microversion: 2.57 time: 0.718391 Aug 25 12:53:44.006227 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1275/2620] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:43 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1356 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:44.021909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:44.023464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:44.039245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.042013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.043220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.044936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.045927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.046794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.104538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 HTTP/1.1 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '516c777e-b658-4e2a-9d24-4901a53feea4'} Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:44.111046 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 12:53:44.120766 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:53:44.129810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:53:44.131971 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c40f8f83-3c94-493d-8dc5-924215271a38 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 404 len: 111 microversion: 2.1 time: 0.122990 Aug 25 12:53:44.139899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1276/2621] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:44 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:53:44.169738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ebbe19-2715-4cab-815c-f179e403c17e", "tag": "8dc6579a-4bad-4308-a501-83c8f932b2c1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:44.224872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.225931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.225931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.277120 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] Creating event network-changed:8dc6579a-4bad-4308-a501-83c8f932b2c1 for instance 41ebbe19-2715-4cab-815c-f179e403c17e on n-h1-850468-18 Aug 25 12:53:44.326625 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e166b340-2bbe-44ec-ad33-fabc3ac1a36c req-a01c3a03-535c-4d9c-a162-6d71c47f34af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183616 Aug 25 12:53:44.328590 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1277/2622] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:44.349610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:44.363277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:44.394749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.397053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.398450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.400329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.401809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.403206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.622418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:44.623425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:44.625062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:44.626009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:44.628263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:44.837159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:44.853854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.855630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.857284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.859508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:44.861320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:44.866357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:44.934540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:44.969057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:44.988971 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b037675-b016-4246-b286-bb47dede9f00 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1472 microversion: 2.1 time: 1.516207 Aug 25 12:53:45.012308 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1346/2623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:43 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1472 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:45.025753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c504b8f9-c5e2-47d4-858e-734acb1a2c2e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "POST /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15/action" status: 202 len: 1137 microversion: 2.57 time: 0.687185 Aug 25 12:53:45.029581 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1278/2624] 10.222.0.60 () {62 vars in 1320 bytes} [Thu Aug 25 12:53:44 2022] POST /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15/action => generated 1137 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 12:53:45.034339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34bea911-9fa8-4f83-bcd8-1babbfa55e88 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: .version_select at 0x7fc6c201f8b0>, body: {"keypair": {"name": "tempest-key-209201129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTTSEaOaqrrAhsbdIlq2G/XvhS03QePCSzoggQbwm/mifF/sbjMZTG3IVZDYYXmBOTUNJcYSkuCGePydR6frKACV8mtjXhn41gbSJB2gBr7obX8YKA9e9rEZSsJQs4NrQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:45.050753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:45.052982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:45.094933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.098822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.100142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:45.105029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.109187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.112578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:45.138106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-34bea911-9fa8-4f83-bcd8-1babbfa55e88 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:45.171740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-34bea911-9fa8-4f83-bcd8-1babbfa55e88 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:45.296781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34bea911-9fa8-4f83-bcd8-1babbfa55e88 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.263878 Aug 25 12:53:45.301234 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1347/2625] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:53:45 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:45.322625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:45.323970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:45.348488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.350035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.351632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:45.353912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:45.355346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:45.356556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.539277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:47.556418 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-16fc713e-cf61-4614-b1ea-641b3a244fad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 2.524412 Aug 25 12:53:47.557704 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1279/2626] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:45 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:47.571421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:47.573352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:47.600289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.602390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.603706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.606146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.608643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.610069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.618107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:47.633501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:47.688931 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-497e859d-8eef-4c25-90dc-a31cb3ff3f27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 2.366886 Aug 25 12:53:47.690797 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1348/2627] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:45 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:47.700397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3caf7de-856c-4f88-87b1-9ff47735bac8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '.version_select at 0x7fc6c201f1f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:47.709345 n-d-850468-18 devstack@n-api.service[122701]: WARNING oslo_db.sqlalchemy.utils [None req-a3caf7de-856c-4f88-87b1-9ff47735bac8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 25 12:53:47.727475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3caf7de-856c-4f88-87b1-9ff47735bac8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.034559 Aug 25 12:53:47.731688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1349/2628] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:53:47 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:47.742401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:47.744338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:47.758218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.759890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.761133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:47.762786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:47.764008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:47.765285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:48.053096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:48.077887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:48.082322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:48.085924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bcf524f-f876-4ea0-a7d7-749da3e41525 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.525662 Aug 25 12:53:48.101295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1280/2629] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:47 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:48.625196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-398308874", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "ef214124-4ee1-42f1-920d-e679782f8d83"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:48.809727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] validate_networks() for [('ef214124-4ee1-42f1-920d-e679782f8d83', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:49.341830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:49.367656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57d3f727-b27e-479b-aa1e-04a4136c782b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1472 microversion: 2.1 time: 1.633081 Aug 25 12:53:49.369165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1350/2630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:47 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1472 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:49.387099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1448829456", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-key-209201129", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:49.520020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:50.656913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:53:52.193210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:52.194889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:52.195565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:52.196163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:52.196880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:52.214170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.214874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.215503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.216671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.217317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.218400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.253615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:52.261741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for user 375f73ecadcd45aab0148803e57c19b6 and project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:52.288815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:52.294406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:52.382904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce4e0dd3-5c72-4bf5-b47e-f6dc088644ba tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.279434 Aug 25 12:53:52.384081 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1281/2631] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:52.393765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:52.395470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:52.417534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.418693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.421181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.422242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.423011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.424643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.928962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:52.929840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:52.930744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:52.935523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:52.936997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:52.961792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.963367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.965032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:52.967259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:52.970217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:52.976157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:53.031739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:53.050314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:53.090151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:53.101843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:53.424546 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b9c8be9-f537-4488-aaaa-4c79e40a8d34 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.050887 Aug 25 12:53:53.436910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1351/2632] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:53.446739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:53.450077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:53.475032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:53.475976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:53.476894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:53.478212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:53.479069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:53.479858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.059865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:54.101007 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6843be9-8941-4c3f-8220-fa6158f25427 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 1.706410 Aug 25 12:53:54.102346 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1282/2633] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:52 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:54.117199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:54.123367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:54.154044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.161907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.163573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.165503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.167031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.168102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.594366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:54.621565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:54.643372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:54.652797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb17fe07-63e6-47b1-b21e-4894b8bcbb80 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 1.195544 Aug 25 12:53:54.662062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:54.662932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1352/2634] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:53 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:54.671724 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e61d298-07e0-4cdc-ae80-18e233656385 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.566749 Aug 25 12:53:54.680174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1283/2635] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:54 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:53:54.696063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2129555300", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "2b533d77-bacf-4957-ade4-d3cfc06699ab"}, {"uuid": "daee9cbd-dae4-41d7-bfc9-794c302ba3f9"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:54.698296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:54.700532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:54.730932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.736179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.743378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.745789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:54.747140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:54.758092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:54.946826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] validate_networks() for [('2b533d77-bacf-4957-ade4-d3cfc06699ab', None, None, None, None, None), ('daee9cbd-dae4-41d7-bfc9-794c302ba3f9', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:56.240904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:56.260580 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4480a8c2-ebe5-4fcb-945d-2811174ad12e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1477 microversion: 2.1 time: 1.594455 Aug 25 12:53:56.262666 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1353/2636] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:54 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1477 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:56.274343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-139795688", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "ef214124-4ee1-42f1-920d-e679782f8d83"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:56.460064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] validate_networks() for [('ef214124-4ee1-42f1-920d-e679782f8d83', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:53:58.231762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:58.232898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:58.233537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:58.234321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:58.235101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:58.254617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.255407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.256292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.257843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.267530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.268942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.307382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:58.319471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for user 375f73ecadcd45aab0148803e57c19b6 and project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:58.343883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:58.348519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:58.445661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:53:58.447208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:53:58.448704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:53:58.449952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:53:58.450893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:53:58.453460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a06f237b-8bf3-4152-b91f-307591fbeacc tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187590 Aug 25 12:53:58.456383 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1354/2637] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:58.483733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:58.487994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:58.498518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.504177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.505091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.510907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.515550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.516774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.523317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.525233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.526405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.528294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.529877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.531092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.577999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Getting quotas for project bd445c58c0b544a480e2aa0c5afd1cf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:53:58.589739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Getting quotas for user 6fe40285fc75459f9d8549db4f166b51 and project bd445c58c0b544a480e2aa0c5afd1cf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:53:58.622064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:53:58.627255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:53:58.744830 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e644486-89ec-4ecb-8a7c-66d6718dd271 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.068777 Aug 25 12:53:58.748391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1284/2638] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:53:58.760769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:58.761991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:58.769645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:58.780938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.781909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.784374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.786956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.787967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.790611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.797578 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3c03f80-f634-4e8b-9dc7-5d792c321ca5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1286 microversion: 2.1 time: 0.336686 Aug 25 12:53:58.799290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1355/2639] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:58 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1286 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:58.849021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:58.854385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:58.869198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.870470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.871293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:58.872992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:58.873960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:58.874700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.571673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:59.594880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c45f64cb-75ce-4087-93d7-493058f3a230 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 0.843872 Aug 25 12:53:59.597470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1285/2640] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:58 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:59.608650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.610287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.628787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.630217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.634107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.637060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.638774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.639935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.647414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:53:59.666442 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b60734f-cf94-4de9-8687-36275c3964b7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 0.832116 Aug 25 12:53:59.688236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1356/2641] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:58 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:53:59.697281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ebbe19-2715-4cab-815c-f179e403c17e", "name": "network-vif-plugged", "status": "completed", "tag": "8dc6579a-4bad-4308-a501-83c8f932b2c1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:53:59.717128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.719042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.720597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.758001 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] Creating event network-vif-plugged:8dc6579a-4bad-4308-a501-83c8f932b2c1 for instance 41ebbe19-2715-4cab-815c-f179e403c17e on n-h1-850468-18 Aug 25 12:53:59.769436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-eb096c5e-6b09-4c6c-8805-91087ed80511 req-5fcfa15a-d837-44f2-a849-a2d7e3e194cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079786 Aug 25 12:53:59.770765 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1357/2642] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:53:59.780976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:53:59.783564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:53:59.794363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.795207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.795768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:53:59.796976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:53:59.797476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:53:59.798035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:00.036213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:00.066066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:00.071292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:00.074717 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b1691de8-bacd-44da-b396-a9618870e516 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.474924 Aug 25 12:54:00.077329 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1286/2643] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:00.098763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1618922848", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "451", "networks": [{"uuid": "ef214124-4ee1-42f1-920d-e679782f8d83"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:00.334048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] validate_networks() for [('ef214124-4ee1-42f1-920d-e679782f8d83', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:54:01.108599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:01.160661 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fae875a2-7542-4791-a6b7-9e95b38d5cbf tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1477 microversion: 2.1 time: 1.384775 Aug 25 12:54:01.164358 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1358/2644] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:53:59 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1477 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:01.179879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:01.182386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:01.200054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.201050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.202020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.203572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.205158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.206105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.441592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:01.470410 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1178201d-1b68-42db-83fa-b5b1d1ec6843 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1265 microversion: 2.1 time: 0.291970 Aug 25 12:54:01.471710 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1359/2645] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:01 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:01.509740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:01.513316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:01.525512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.526857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.528040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.530071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.531547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.533000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.802549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:01.843879 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97dedaab-fc4b-4469-adf1-b9c95d7e669f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1286 microversion: 2.1 time: 0.357067 Aug 25 12:54:01.853926 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1360/2646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:01 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1286 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:01.877386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:01.886387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:01.909872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.910787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.911806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:01.913640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:01.914567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:01.915378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.788643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:02.814595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1398c175-4959-4203-a075-d9a52a70faea tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1324 microversion: 2.1 time: 0.955084 Aug 25 12:54:02.816545 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1361/2647] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:01 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1324 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:02.863506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:02.865496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:02.879732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.881152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.883635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:02.885527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:02.886687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:02.888522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.160213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:54:03.161169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:54:03.161901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:54:03.163057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:54:03.164079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:54:03.170169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:03.206263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.207662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.209720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.216199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.217416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.218212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.258602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:54:03.289486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Getting quotas for user 375f73ecadcd45aab0148803e57c19b6 and project 1b2c96d9879849169ffd1da4664f4704. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:54:03.348279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:54:03.356490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:54:03.521931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4480d3ad-72df-4bd5-96dd-6e0509d8e5e3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.436271 Aug 25 12:54:03.527332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1287/2648] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:54:03.549893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.558267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:03.560262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:03.571366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-465ef604-b67b-45e6-a803-833cbb705cfb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 0.715681 Aug 25 12:54:03.572314 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1362/2649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:02 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:03.577807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:03.578447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:03.588790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.589811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.592222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.593851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.594819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.598116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.628633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.630363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.631275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.632717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.633602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.634397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.849227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.899447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.906023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:03.910009 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9eccb52c-a540-4da2-9489-260d8d293930 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.379387 Aug 25 12:54:03.915555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1288/2650] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:03 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:03.938560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:03.940706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:03.963976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.966996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.968001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:03.970524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:03.971322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:03.972144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.284831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:04.305940 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53a04a89-06d0-4583-a4f7-7f773705340e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1271 microversion: 2.1 time: 0.384546 Aug 25 12:54:04.308157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1289/2651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:03 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1271 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:04.319728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:04.321596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:04.336151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.337847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.339733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.341692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.342989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.345108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.719977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:04.745202 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-03eca491-6e43-47fb-9621-a8182ea71741 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1477 microversion: 2.1 time: 1.171170 Aug 25 12:54:04.746563 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1363/2652] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:03 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1477 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:04.758140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:04.759920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:04.775530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.776886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.777947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:04.779996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:04.781388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:04.783146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.023337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:05.064652 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-028debe6-85c7-4fe3-94af-69e018e423dd tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1225 microversion: 2.1 time: 0.315161 Aug 25 12:54:05.072966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1364/2653] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:04 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:05.091950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.094648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.119169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.120872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.122265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.132020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.134120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.135040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.246433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:05.264843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce41de96-3134-4c07-95eb-976c8b4855cd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.953484 Aug 25 12:54:05.266138 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1290/2654] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:04 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:05.279216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:05.280454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:05.294478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.296520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.297229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:05.299128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:05.299955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:05.300773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.529184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:06.545423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:06.608557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a48d8d2a-4840-4805-8177-9e6c71a64b99 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1521 microversion: 2.1 time: 1.532463 Aug 25 12:54:06.615096 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1365/2655] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1521 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:06.629922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:06.631819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:06.654166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.656060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.658466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.661273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.663351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.665406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.669481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf7b115b-4f7e-49a2-8c41-6f6aecc62dcb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1735 microversion: 2.1 time: 1.398844 Aug 25 12:54:06.670607 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1291/2656] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:05 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1735 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:06.878542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a87fc7e-7fe8-4ae6-ab90-340524fca4de", "tag": "c1e8031f-5911-4fb8-8f32-5b446da1cada"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:06.897865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.899028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.899813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.920985 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] Creating event network-changed:c1e8031f-5911-4fb8-8f32-5b446da1cada for instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de on n-h1-850468-18 Aug 25 12:54:06.928681 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-77960a8a-4bcb-42db-9a78-d20d4ce4d026 req-bd1b2689-741e-473a-a64c-a4fe8fa324bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256076 Aug 25 12:54:06.930614 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1292/2657] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:06.950388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:06.952073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:06.975631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.978449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.979908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:06.981667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:06.984178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:06.987524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.124817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.170096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.181291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.184178 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36573c09-94b7-44b6-8493-5e239faa69a3 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.566491 Aug 25 12:54:07.194349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1366/2658] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:06 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:07.206145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:07.207865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:07.252683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.253806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.255052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.256720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.258372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.259581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.263284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.310672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3923a76-bb95-4bde-91b1-f5516944c34b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1271 microversion: 2.1 time: 0.377364 Aug 25 12:54:07.324957 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1293/2659] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:06 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1271 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:07.348782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:07.350544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:07.351341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:07.367174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.368510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.369837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.373157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.374424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.375587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.720181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:07.738762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-609fb1f4-3733-4abe-b562-524547dbdf50 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1279 microversion: 2.1 time: 0.411288 Aug 25 12:54:07.740529 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1294/2660] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:07 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1279 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:07.755972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:07.755972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:07.764753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.765878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.767555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:07.769252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:07.770537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:07.771752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.285404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:08.333139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:08.496986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:08.520721 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-69de6467-ffb1-4bd3-8e1a-41cfc0591d63 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1476 microversion: 2.1 time: 1.320912 Aug 25 12:54:08.537072 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1367/2661] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:07 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1476 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:08.548235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:08.548235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:08.574243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.575720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.576376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:08.577743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:08.580458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:08.581016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.144900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.158499 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b14e1502-c3da-45dc-82d9-b0ff59ccfea9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 1.415711 Aug 25 12:54:09.159339 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1295/2662] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:07 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:09.400821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.402229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.415630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.417217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.418298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.419765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.420763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.421871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.503067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.522658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e806748-c1a0-4e3f-82d3-2e8e60f50c0d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1521 microversion: 2.1 time: 0.993227 Aug 25 12:54:09.524349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1368/2663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:08 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1521 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:09.545331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.547226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.560607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.561513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.562333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.565124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.566173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.566960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.780336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.799056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.802264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.804808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f6313a8-b8f5-4e61-9011-6400c11d0cdd tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.267742 Aug 25 12:54:09.806182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1369/2664] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:09.815597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.816911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.829269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.831281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.832101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.833775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.834648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.835561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.889823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:09.906505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-468dc3d6-83b6-4599-9cdb-7fccce9fd85d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1715 microversion: 2.1 time: 0.745220 Aug 25 12:54:09.908892 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1296/2665] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1715 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:09.917751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:09.919000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:09.943286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.944207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.948439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:09.948439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:09.948439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:09.948439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.434380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:10.447220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:10.451482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b65ad2ce-1c1c-4f8d-b85b-b712bc5d03d1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1313 microversion: 2.1 time: 0.643621 Aug 25 12:54:10.452932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1370/2666] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:10.462951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c274471-1ce7-4c7f-b214-0b6054c6c030", "tag": "fdbc4273-4ebd-4c45-8593-f44be2e7a5f2"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:10.463979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-037898f9-91c2-4dff-a67b-a9be101fbc1d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.552663 Aug 25 12:54:10.465927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1297/2667] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:09 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:10.476380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1237194749"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:10.481435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:10.494876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.495780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.496683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.498060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.498998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.499814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.501997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.502881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.503651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.520643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] Creating event network-changed:fdbc4273-4ebd-4c45-8593-f44be2e7a5f2 for instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 on n-h1-850468-18 Aug 25 12:54:10.530249 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d3a011e4-24d8-485a-94b3-145ce14b949c req-e5b13c2f-9d8f-4783-b9b9-d4df6bbd4633 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075677 Aug 25 12:54:10.531765 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1371/2668] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:10.542161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:10.543497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:10.557646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.558990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.560085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.561708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.562848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.564545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.873079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:10.952749 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93d2514b-2fde-4c8b-bd9b-4763b0415a9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e/action" status: 202 len: 0 microversion: 2.1 time: 0.484113 Aug 25 12:54:10.953836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1298/2669] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:54:10 2022] POST /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 12:54:10.962845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:10.964471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:10.978632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.979517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.980388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:10.981729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:10.982927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:10.983825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.314892 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Cannot 'detach_volume' instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e while it is in vm_state rescued Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments/645c3612-08b0-4e63-a69d-5d6167acb782 HTTP/1.1 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'detach_volume' instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e while it is in vm_state rescued Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': '9ebe2ecb-f094-4493-93bb-30d4a4f3b17e', 'id': '645c3612-08b0-4e63-a69d-5d6167acb782'} Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e while it is in vm_state rescued Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:11.322442 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e while it is in vm_state rescued Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 409 to user: Cannot 'detach_volume' instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e while it is in vm_state rescued {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:11.333546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d88648e-9e43-4cc0-8c1c-78bf16061876 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments/645c3612-08b0-4e63-a69d-5d6167acb782" status: 409 len: 152 microversion: 2.1 time: 0.368839 Aug 25 12:54:11.336295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1299/2670] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 12:54:10 2022] DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments/645c3612-08b0-4e63-a69d-5d6167acb782 => generated 152 bytes in 379 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:54:11.346584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:11.348152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:11.365151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.366037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.366866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:11.368300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:11.369412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:11.370235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.229548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.243297 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11708ee9-16c0-4f7d-8c05-d740e76806f9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1476 microversion: 2.1 time: 1.709183 Aug 25 12:54:12.244832 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1372/2671] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:10 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1476 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:12.255164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.256977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.270139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.271722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.273001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.274803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.276180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.277388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.429995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.453209 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0aafd7e-01c4-4194-b736-1e8f302a8533 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 1.116468 Aug 25 12:54:12.460067 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1300/2672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:11 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:12.473545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-047e9689-d4e1-4f42-8f2e-57483a856060 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c2943b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.533731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.554599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.559459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:12.571251 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eaf9a012-8a30-4b34-b462-771e8fd43d14 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.315283 Aug 25 12:54:12.573190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1373/2673] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:12 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:12.584335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:12.586067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.615509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.617084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.618049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.620071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.621055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.621885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.803887 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc8b4d49-3fb1-4dd2-bfd2-4254135d9c85 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/action" status: 202 len: 0 microversion: 2.1 time: 0.228003 Aug 25 12:54:12.805808 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1374/2674] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:54:12 2022] POST /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:12.815968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.817735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.828260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.830258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.831727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.834218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.835834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.838217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.944621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-047e9689-d4e1-4f42-8f2e-57483a856060 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e" status: 204 len: 0 microversion: 2.1 time: 0.478936 Aug 25 12:54:12.946500 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1301/2675] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:12 2022] DELETE /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:54:12.961418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:12.962621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:12.977083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.977983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.979777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:12.981641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:12.982915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:12.984283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.239174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:13.304173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:13.694351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:13.701028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:13.717059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c260e17c-a285-47e5-ba85-e2392d8d07c0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.768034 Aug 25 12:54:13.719543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c427a63-695b-4f27-b12c-3f3dff6ee717 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1313 microversion: 2.1 time: 0.911687 Aug 25 12:54:13.720957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1375/2676] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:12 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1313 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:13.721705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1302/2677] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:12 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:13.730264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69de9f4-523f-466e-bb09-2e3368870ef2", "tag": "f9ce3799-062a-4add-9d4d-7e21287b9735"}, {"server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "name": "network-vif-unplugged", "status": "completed", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}, {"name": "network-changed", "server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:13.731917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce07a043-d36c-4e43-9fb0-4e67c7d64913", "tag": "576388b3-cfdc-4309-818f-1e216045e4ab"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:13.752389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.754125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.755540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.758649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.759673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.760699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.790219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] Creating event network-changed:576388b3-cfdc-4309-818f-1e216045e4ab for instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 on n-h1-850468-18 Aug 25 12:54:13.791584 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Creating event network-changed:f9ce3799-062a-4add-9d4d-7e21287b9735 for instance a69de9f4-523f-466e-bb09-2e3368870ef2 on n-h1-850468-18 Aug 25 12:54:13.792763 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Creating event network-vif-unplugged:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h2-850468-18 Aug 25 12:54:13.793749 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Creating event network-changed:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h2-850468-18 Aug 25 12:54:13.801153 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ed23a417-1b9b-4f75-9362-1842d215cd10 req-33cc0f43-48d5-471b-9b0e-88790295c2e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076697 Aug 25 12:54:13.802374 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1303/2678] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:13.816481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.817728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:54:13.818101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.832547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.833577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.834420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.835757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.836644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.837404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.845850 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ab3c5165-33d0-4e63-b572-8851b619ea19 req-5ee035b8-a889-413a-813c-33a3d9aaf88e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.121263 Aug 25 12:54:13.847462 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1376/2679] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:13.861345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aaf0e76e-f552-4636-8c10-996550fc5672 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c6c0b790>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.920486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-aaf0e76e-f552-4636-8c10-996550fc5672 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Image not found. Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aaf0e76e-f552-4636-8c10-996550fc5672 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e HTTP/1.1 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: exception: Image not found. Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e'} Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 25 12:54:13.926662 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e could not be found. Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aaf0e76e-f552-4636-8c10-996550fc5672 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Image not found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aaf0e76e-f552-4636-8c10-996550fc5672 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e" status: 404 len: 62 microversion: 2.1 time: 0.079646 Aug 25 12:54:13.937557 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1377/2680] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:54:13.951038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:13.952496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:13.979014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.981213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.982553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:13.984351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:13.985646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:13.986521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.733486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:14.755876 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76c0302e-613b-4046-b649-73feba291ef7 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1723 microversion: 2.1 time: 0.950862 Aug 25 12:54:14.761276 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1304/2681] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1723 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:14.774673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:14.776811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:14.794957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.796436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:14.797247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.797693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.799655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.801391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.803083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.816181 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ae3d66f-7a7e-4d35-8500-77d7f90b7371 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1476 microversion: 2.1 time: 0.876801 Aug 25 12:54:14.823253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1378/2682] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:13 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1476 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:14.834227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:14.835663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:14.851258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.852854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.854283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:14.858072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:14.861259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:14.862229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.040007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.056476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.059667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.062054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c250126c-f3fc-4dea-83d6-1f7f82b8ed2f tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.236457 Aug 25 12:54:15.068278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1379/2683] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:14 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:15.080925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.082713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.103119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.104657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.105798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.107463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.108739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.109511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.197413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.214180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00a675d4-6352-4d0b-93ab-06e7256ce700 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.449661 Aug 25 12:54:15.215646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1305/2684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:14 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:15.223253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.224853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.238423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.239928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.241192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.242593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.243470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.244322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.482101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.501773 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ebed429-5e69-4dea-940a-10ab30be5c7e tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1533 microversion: 2.1 time: 0.430491 Aug 25 12:54:15.502838 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1380/2685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1533 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:15.512331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.513585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.526782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.527659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.528771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.530218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.531107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.531910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.586541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:15.614325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22fa22de-02a9-408a-afe6-62b372321056 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.396516 Aug 25 12:54:15.616013 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1306/2686] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:15.808874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:15.811622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:15.827298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.828940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.831108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:15.834496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:15.835958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:15.837278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:17.120700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:17.140943 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5a8c327c-1e5b-485d-a46f-8b42e0bd4cd9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 1.635900 Aug 25 12:54:17.163315 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1381/2687] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:17.169167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:17.171286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:17.195951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:17.197835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:17.198733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:17.200490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:17.201363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:17.202174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:17.314189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:17.336165 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c5058b7-c980-4d8a-abeb-921c3656c1ea tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1723 microversion: 2.1 time: 1.537832 Aug 25 12:54:17.363541 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1307/2688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:15 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1723 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:17.374549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:17.377721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:17.398457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:17.399597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:17.400656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:17.402259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:17.403841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:17.405073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:17.935046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:17.981745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:17.983994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:17.986498 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-239154fa-2009-4f24-b2f3-9487717c36a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1365 microversion: 2.57 time: 0.619851 Aug 25 12:54:17.988051 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1308/2689] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:17 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1365 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:17.996885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:17.998277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:18.036895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:18.037826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:18.038666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:18.044912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:18.046259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:18.047556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.034652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:19.065696 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb155ea5-3e4d-4d54-a829-7278f9ef677a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 1.912330 Aug 25 12:54:19.069656 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1382/2690] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:17 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:19.085854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:19.087726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:19.105543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.108656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.110316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.112940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.119030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.120602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.325705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:19.338027 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd3e0337-e05d-4cb6-8bf3-9ce2e08b79f3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 1.348305 Aug 25 12:54:19.338830 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1309/2691] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:17 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:19.350365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:19.352384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:19.365963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.367359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.368502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:19.370124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:19.371078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:19.371638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.145679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.165899 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2babdfe0-daac-489d-a866-1b723bb790ad tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1539 microversion: 2.1 time: 1.093414 Aug 25 12:54:20.168334 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1383/2692] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:19 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1539 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:20.180282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a87fc7e-7fe8-4ae6-ab90-340524fca4de", "name": "network-vif-plugged", "status": "completed", "tag": "c1e8031f-5911-4fb8-8f32-5b446da1cada"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:20.199977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.200707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.201678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.216403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] Creating event network-vif-plugged:c1e8031f-5911-4fb8-8f32-5b446da1cada for instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de on n-h1-850468-18 Aug 25 12:54:20.224474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-258c83e2-f0b3-4233-a8eb-01311faae4a5 req-b68f354e-8cd3-4d80-91ab-2d7ac3981a76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054004 Aug 25 12:54:20.225428 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1384/2693] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:20.236066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:20.236066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:20.245843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.246540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.247288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.248836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.249502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.250463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.273847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.289943 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb944558-bd84-4fe8-b7f6-e09b875ec341 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.948715 Aug 25 12:54:20.292068 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1310/2694] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:19 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:20.303629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:20.305410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:20.320836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.322184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.322995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.324389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.325285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.326080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.827217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.835920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:20.836325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:20.847657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-88c42664-3b3f-4292-8112-121ba9984752 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.620158 Aug 25 12:54:20.849020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1385/2695] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:20 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:20.858626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:20.862163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:20.868447 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13a38389-ba2a-43f4-b4b3-74027dfc8b49 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1723 microversion: 2.1 time: 0.573221 Aug 25 12:54:20.871626 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1311/2696] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:20 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1723 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:20.873092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:20.875556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.878042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.879297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.880974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.882109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.883682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.887824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:20.890109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:20.913477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.914108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.929505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:20.931214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:20.932238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:20.934846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.043539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.057652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.062089 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ef0690b-f0cb-4c15-802c-03ea70fce8ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577/action" status: 204 len: 0 microversion: 2.1 time: 0.187669 Aug 25 12:54:21.063379 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1312/2697] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:54:20 2022] POST /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:54:21.071095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.072703 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-504c662e-d1ba-4a08-a774-06eecf156800 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1371 microversion: 2.57 time: 0.221792 Aug 25 12:54:21.073598 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1386/2698] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:20 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:21.073953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.075044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.081500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "tag": "93115bdd-4065-4aae-af25-3524f76ce265"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:21.092407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.093532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.094336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.096035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.096556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.096758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.097245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.097468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.097946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.114434 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] Creating event network-changed:93115bdd-4065-4aae-af25-3524f76ce265 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:54:21.120518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f2bd0815-d906-4771-88c8-4a67aa28637c req-aa47ad43-b6d6-4494-90d2-01179dd32f45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045053 Aug 25 12:54:21.121503 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1387/2699] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:21.129990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.130862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.138994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.139503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.139956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.140746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.141222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.141717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.444560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.460828 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58d9d5aa-7f5b-4d12-bd07-4ec2826e3ffa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.393822 Aug 25 12:54:21.461961 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1313/2700] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:21.474750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.479134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.480897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.490550 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93a6bf95-c236-4f3e-8c7b-ee30fd8b5a49 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.367086 Aug 25 12:54:21.491660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.491876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1388/2701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:21.492402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.492877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.493972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.494764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.496442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.499574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.501153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.518200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.521289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.521289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.521963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.522667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.523206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.889386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.908340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73dbb772-4096-4daa-9779-eeb9ce6eef6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1539 microversion: 2.1 time: 0.436234 Aug 25 12:54:21.918292 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1314/2702] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1539 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:21.919685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.920943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.925558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:21.934859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.936235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.938159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.939806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.940600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.941173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.943583 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7220a0f7-cd18-4e94-bc00-749646157a89 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.450060 Aug 25 12:54:21.945168 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1389/2703] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:21.955688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:21.957306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:21.969361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.970608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.971307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.972506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:21.973244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:21.974150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:21.983562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:22.331231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.338298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.351816 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31ffb0e3-1753-4ec5-ac4d-fc2405edd5ff tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.437985 Aug 25 12:54:22.355399 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1315/2704] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:22.370486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.373393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.386463 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a70b1222-8549-4967-b451-b94a8ad91acb tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1729 microversion: 2.1 time: 0.439428 Aug 25 12:54:22.388763 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1390/2705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:21 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1729 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:22.395881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.397472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.398242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "name": "network-vif-plugged", "status": "completed", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}, {"server_uuid": "a69de9f4-523f-466e-bb09-2e3368870ef2", "name": "network-vif-plugged", "status": "completed", "tag": "f9ce3799-062a-4add-9d4d-7e21287b9735"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:22.398556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.399521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.413994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.413994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.433103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.435822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.438024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.475572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Creating event network-vif-plugged:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h2-850468-18 Aug 25 12:54:22.475572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Creating event network-vif-plugged:f9ce3799-062a-4add-9d4d-7e21287b9735 for instance a69de9f4-523f-466e-bb09-2e3368870ef2 on n-h1-850468-18 Aug 25 12:54:22.488351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:54:22.522797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d3d34257-78b7-420c-b490-bfe61ae9b68e req-a89a2a22-b2ef-40cd-812b-5391e7fa4801 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131769 Aug 25 12:54:22.525680 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1391/2706] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:22.536539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.538263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.545389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.552700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.554155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.555018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.556458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.557585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.558137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.565206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.568316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.571052 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14295921-740d-44c2-a8cc-98be85d64147 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1371 microversion: 2.57 time: 0.213446 Aug 25 12:54:22.577136 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1316/2707] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:22.582810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.583983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.596385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.597464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.598389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.600102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.601156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.602060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.777154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12112326-a1e6-4698-a9dc-7ff660da8061 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248986 Aug 25 12:54:22.779524 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1392/2708] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:22.788095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.789387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.801945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.802877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.804767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.806024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.806989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.807613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.935402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:22.953003 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84593a9a-3062-4229-8f90-a7fa1d053961 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.378029 Aug 25 12:54:22.968181 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1317/2709] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:22.968181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:22.968181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:22.984630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.985940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.986978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:22.988658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:22.989781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:22.990846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.152354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:23.169430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61e3a474-66e4-48c5-8797-fd23bd3c6739 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.388565 Aug 25 12:54:23.171032 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1393/2710] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:23.184607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:23.186361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:23.202533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.203904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.206881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.207462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.208635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.209550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.372169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:23.415889 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0423d82-98a3-472d-b888-a76010e4d167 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1539 microversion: 2.1 time: 0.457509 Aug 25 12:54:23.418283 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1318/2711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:22 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1539 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:23.430268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:23.433694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:23.450986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.452999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.454449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.456271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:23.457723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:23.458846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:23.941389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:23.964341 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2b1411d-2c4a-49b9-9c66-841221ae179e tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.790506 Aug 25 12:54:23.969612 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1394/2712] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:23 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:23.989614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:23.991246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:24.007244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.008438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.009257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.010677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.011535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.012405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.076138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.094776 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8823f73-e3a3-44fd-a7f2-ca8d69c8b3ad tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.672843 Aug 25 12:54:24.095755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1319/2713] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:23 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:24.104394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:24.105601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:24.116727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.117610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.118405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.120092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.121439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.122660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.160478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.181996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.189384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.192270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5090a45-6149-4b5f-a07b-d8324a29a13a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1371 microversion: 2.57 time: 0.216717 Aug 25 12:54:24.194028 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1395/2714] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:23 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:24.217736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:24.219151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:24.232552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.233685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.234545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.236493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.237709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.238533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.516253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.533862 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1600e64-f603-4c90-a57a-1c45e4780649 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.435300 Aug 25 12:54:24.546218 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1320/2715] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:24 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:24.561332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:24.562968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:24.580247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.581526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.583484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.585630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.586564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.587381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.606514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.623526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0287a4ac-3419-498c-89e6-6fb22b981c1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.414295 Aug 25 12:54:24.625026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1396/2716] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:24 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:24.636901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ebbe19-2715-4cab-815c-f179e403c17e", "name": "network-vif-plugged", "status": "completed", "tag": "8dc6579a-4bad-4308-a501-83c8f932b2c1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:24.667146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:24.668069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:24.668976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:24.696777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] Creating event network-vif-plugged:8dc6579a-4bad-4308-a501-83c8f932b2c1 for instance 41ebbe19-2715-4cab-815c-f179e403c17e on n-h1-850468-18 Aug 25 12:54:24.706979 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1b2d06da-c751-4d9c-8593-aa59a0a58c7e req-0a91414c-e2ab-48b9-a183-8039db60683b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078663 Aug 25 12:54:24.708244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1397/2717] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:24.868027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:24.883290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfe60284-68be-4fbe-862f-7e0edf029997 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1539 microversion: 2.1 time: 0.331922 Aug 25 12:54:24.884931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1321/2718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:24 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1539 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:25.011200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.015310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:25.017490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.035654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.036637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.037466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.039307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.040541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.041131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.061278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.064364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.065669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.091222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] Creating event network-changed:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:54:25.101422 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-84230f3f-bbc3-4e20-8c40-ee1079725268 req-b7a56c1d-6e82-43e4-ba4f-ae3a65845dd9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103863 Aug 25 12:54:25.103091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1398/2719] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:54:25.143363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.143363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.154596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.155438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.156412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.159100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.160003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.160787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.562066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.581292 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a47b9893-e604-401a-b03b-83f5d0f1ca1f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.576534 Aug 25 12:54:25.582314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1322/2720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:25.596539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.598320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.611003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.612667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.613484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.615144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.616395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.617484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.669054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.687321 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-17a7af95-72e7-4d5b-b9e5-fb891e94df14 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.556918 Aug 25 12:54:25.689702 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1399/2721] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:25.700863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.702798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.716650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.717667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.718288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.719209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.719937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.720577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.853767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.871663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.874969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:25.878595 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e92c4d2a-fe7e-4adc-be1d-390c58279b53 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1371 microversion: 2.57 time: 0.294040 Aug 25 12:54:25.880012 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1323/2722] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:25.889300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:25.894097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:25.910130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.911513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.914376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:25.916105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:25.917334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:25.919709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:26.313248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:26.354911 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bcdba29a-d4bd-4039-bc85-90a8a184d41a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.661239 Aug 25 12:54:26.359721 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1400/2723] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:26.376876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:26.377961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:26.406162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:26.407046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.413614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:26.415691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:26.420773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.424023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:26.768380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:26.795627 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ed6349d-78b7-45f2-9785-1e97e48e8de6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.913597 Aug 25 12:54:26.827589 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1324/2724] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:25 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:26.844536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:26.847371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:26.862603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:26.864828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.866296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:26.868025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:26.869301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:26.870438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.188167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.221454 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc1e2b1b-0241-469f-b338-ea298bbe1aef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1539 microversion: 2.1 time: 1.855657 Aug 25 12:54:28.222621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1401/2725] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:26 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1539 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:28.227546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.236065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.238203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.250671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b810f3d-38e0-4a37-b35f-9304b847d39f tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.420517 Aug 25 12:54:28.255067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.256536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.257751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.259454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.260702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.261855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.266635 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1325/2726] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:26 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:28.297220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.299235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.311072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.311804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.313039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.315355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.316936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.317693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.437082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.454987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.458283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.460830 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e40cd3b-af2d-46b5-b573-729996606b00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1371 microversion: 2.57 time: 0.192865 Aug 25 12:54:28.462148 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1326/2727] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:28.470799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:28.489500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.490324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.491374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.523753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] Creating event network-changed:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:54:28.536394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6892cb89-d11b-4fab-8df7-22e796a38dc2 req-6f82ea0e-b491-423c-9ff2-88ae36a70f89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072367 Aug 25 12:54:28.537573 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1327/2728] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:28.547832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:28.551275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.553785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.564348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a66ce8fd-0cd2-43f2-beaf-00e6a55da607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.337706 Aug 25 12:54:28.566257 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1402/2729] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:28.569967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.570519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.571269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.572777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.573641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.574452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.574970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:28.576520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:28.591634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.593003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.594060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:28.595711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:28.596666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:28.597483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.516666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:29.530965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3de8ee5-b096-4a79-825e-28f98957f6a3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.962781 Aug 25 12:54:29.532088 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1403/2730] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:29.541587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:29.543372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:29.561653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.561828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.562595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.564604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.565465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.566563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.570702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:29.588870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4be05c6f-3605-41a7-b368-b5ce34c02b67 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 1.049278 Aug 25 12:54:29.589870 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1328/2731] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:28 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:29.597231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:29.599963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:29.612888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.613858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.614685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:29.616034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:29.616931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:29.617827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.261646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.278170 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-502d1e1f-1cc7-47ca-8d95-688b42774c6f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1534 microversion: 2.1 time: 0.744042 Aug 25 12:54:30.279328 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1404/2732] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:29 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1534 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:30.288140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.288711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:30.289908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:30.302410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.303305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.304145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.305524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.306403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.307360 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af3e3812-b0bb-4d75-9013-446dc3d3b097 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.715448 Aug 25 12:54:30.307938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.309665 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1329/2733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:29 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:30.320838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:30.322007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:30.332028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.332819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.333415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.334177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.334785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.336151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.355578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:30.561863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.584007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.586790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:30.588861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c51ce0c8-5bf8-457f-85d2-f23945bff10c tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1356 microversion: 2.57 time: 0.307495 Aug 25 12:54:30.604165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1405/2734] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:30 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1356 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:30.604165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "tag": "b4f21784-7a97-4b3d-bc0f-2c0e889914b1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:30.621443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.622874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.623989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.651698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] Creating event network-changed:b4f21784-7a97-4b3d-bc0f-2c0e889914b1 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:54:30.663727 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-db6e418e-a418-4488-b9c4-9af66c68844c req-3e9a1be7-1cc4-49eb-be8a-526a4ce71ded service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070598 Aug 25 12:54:30.665244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1406/2735] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:30.676329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:30.677630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:30.692013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.692919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.694350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:30.695250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:30.698999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:30.699841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.010147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:31.026291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5bd25c8-733e-4c4b-900e-f2e84f47e8ec tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.714290 Aug 25 12:54:31.039606 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1330/2736] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:30 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:31.040342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:31.042536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:31.055899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.056823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.057602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.058923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.059845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.060681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.330925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:31.348839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-173b5a99-d8b4-4d0a-b56e-6f26c9ee3dc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.680844 Aug 25 12:54:31.350082 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1407/2737] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:30 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:31.359221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:31.360352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:31.373701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.374673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.375477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.377098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.378178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.379308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.417303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:31.541795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28874a1e-5537-4556-beba-c199c4bfd6d1 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "DELETE /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 204 len: 0 microversion: 2.57 time: 0.189169 Aug 25 12:54:31.542612 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1408/2738] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:54:31 2022] DELETE /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:54:31.553172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07a043-d36c-4e43-9fb0-4e67c7d64913", "name": "network-vif-plugged", "status": "completed", "tag": "576388b3-cfdc-4309-818f-1e216045e4ab"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:31.571569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.572513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.573238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.598067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] Creating event network-vif-plugged:576388b3-cfdc-4309-818f-1e216045e4ab for instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 on n-h1-850468-18 Aug 25 12:54:31.606786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-247c0524-28c5-448a-aef4-aa1dfe82c9b4 req-e80afd0c-688d-40c7-a92c-2e30b57911fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061630 Aug 25 12:54:31.607845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1409/2739] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:31.621187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:31.622434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:31.633936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.634824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.635620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.637035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.637900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.638689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.691764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:31.714370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a7dc572c-0205-4857-887d-011297217d59 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.684845 Aug 25 12:54:31.728160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1331/2740] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:31 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:31.728889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:31.730756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:31.737323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:31.751494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.752422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.753237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.754508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:31.755329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:31.756079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:31.796071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:32.034826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.056609 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d713973b-3676-4144-836c-2d136ff698fc tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1534 microversion: 2.1 time: 0.439744 Aug 25 12:54:32.056609 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1410/2741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:31 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1534 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:32.069137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:32.071816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:32.092061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.093106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.093940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.095931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.097064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.097898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.120609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.136169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da124994-2bcf-467a-8650-46f8534131ac tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.417656 Aug 25 12:54:32.136968 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1332/2742] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:31 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:32.145661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:32.146792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:32.158861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.159749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.160610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.161903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.162499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.163042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.638559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.662139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.667114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:32.670697 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a94b6697-52a7-4c76-a0f7-8790e930e62a tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.610020 Aug 25 12:54:32.671831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1411/2743] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:32 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:32.683254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:32.684996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:32.700280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.702888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.702888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:32.706182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:32.707838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:32.709840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.056542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:33.081468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7c099d08-2f57-48c9-a86d-08ec8963d6a4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.943094 Aug 25 12:54:33.082558 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1333/2744] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:32 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:33.092761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.094397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.113665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.114345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.114911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.115826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.116579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.117142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.139016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:33.156022 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f85a5182-cf21-4301-b01c-d88817fd40b4 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.481644 Aug 25 12:54:33.159001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1412/2745] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:32 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:33.183449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.184600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.200807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.201855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.202727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.204666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.205656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.206500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.519739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:33.536563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b395374-babf-4cb1-8bd8-eca8f021699f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.451697 Aug 25 12:54:33.543000 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1334/2746] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:33 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:33.547229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.553658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.567637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.568596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.569410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.570749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.571611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.572607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.577093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:33.595140 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82f27db2-5190-4c66-b173-9f69ba15b9ce tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1521 microversion: 2.1 time: 0.433279 Aug 25 12:54:33.597324 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1413/2747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:33 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:33.639071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.640083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.653187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.654637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.654957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.656395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.657481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.658261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.714987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:33.882302 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d0555871-06ef-4768-9baa-707475b5c20a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 204 len: 0 microversion: 2.1 time: 0.250056 Aug 25 12:54:33.888921 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1414/2748] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:33 2022] DELETE /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 12:54:33.890497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:33.901113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.902887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.910368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee0cd555-a191-490f-b04f-4429a1bf05cc tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.370697 Aug 25 12:54:33.911820 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1335/2749] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:33 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:33.921792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:33.923537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:33.933235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.934570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.935905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.936684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.936977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.938110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.939813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.940396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:33.941542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.942306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:33.943081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:33.943376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.130822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.193000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.196927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.199895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74b7d098-4608-436d-9f98-a4f264a5e12e tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.308640 Aug 25 12:54:34.211316 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1415/2750] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:33 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:34.213755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.215694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.237602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.238566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.239757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.241324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.242281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.243549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.352458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.369208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-661ab6d2-76fc-4d18-93a7-7b864e68cd9d tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1527 microversion: 2.1 time: 0.455064 Aug 25 12:54:34.370362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1336/2751] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:33 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1527 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:34.379936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.381117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.393835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.394834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.396593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.397684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.398563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.399358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.527562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.543679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-86fb9780-ec6e-4a61-ac73-e8298e7e0ef2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.337640 Aug 25 12:54:34.544807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1416/2752] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:34.576795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.577648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.591898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.592585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.593331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.594381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.595051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.595647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.638448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.649927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5bd8014e-e4a5-43ed-8667-273c7728d254 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.277973 Aug 25 12:54:34.650938 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1337/2753] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:34.830828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:34.848907 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eca75d94-9cca-4da2-807c-4e3713b63b50 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.276076 Aug 25 12:54:34.850277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1417/2754] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:34.956747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:34.957765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:34.970282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.971274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.972275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:34.973140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:34.974347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:34.975144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.234272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.250088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc0f2ab4-2f1f-4758-b191-4cb2a5df6943 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.301685 Aug 25 12:54:35.252167 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1338/2755] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:34 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:35.253749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:35.255039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.280239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.411267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.413991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:35.415182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:35.428284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.429249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.430082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.431439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.432420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.432998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.433196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.436441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.440220 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a47c90e5-2dcd-4e72-83a2-ce4d0bd584b4 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.193986 Aug 25 12:54:35.441207 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1418/2756] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:35 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:54:35.578072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:35.579936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:35.592180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.593165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.594068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.596136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.597201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.598026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.803886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.827766 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41315ff8-1f93-4a2c-84c5-780a8c5ddcc2 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1527 microversion: 2.1 time: 0.422084 Aug 25 12:54:35.829879 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1339/2757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:35 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1527 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:35.840295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c274471-1ce7-4c7f-b214-0b6054c6c030", "name": "network-vif-plugged", "status": "completed", "tag": "fdbc4273-4ebd-4c45-8593-f44be2e7a5f2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:35.869855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.870829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.871783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.897993 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] Creating event network-vif-plugged:fdbc4273-4ebd-4c45-8593-f44be2e7a5f2 for instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 on n-h1-850468-18 Aug 25 12:54:35.918168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2b41882a-954c-492e-b07e-20e91071dfbe req-9025c682-1915-477d-908f-33f1c3b31955 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085502 Aug 25 12:54:35.920023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1340/2758] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:35.932830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:35.935387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:35.954912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.956911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.958138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.961468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:35.962602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:35.964808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:35.965645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:35.975859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:35.997969 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-279b805f-4cb3-474d-b851-582c9449a706 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.425743 Aug 25 12:54:36.010961 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1419/2759] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:35 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:36.027980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.030067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.046754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.048573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.049921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.051369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.055221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.057602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.429386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.449348 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d82aee90-c86d-45d3-9f61-8be61c8b4301 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.527576 Aug 25 12:54:36.467340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1341/2760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:35 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:36.489284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.495079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.500225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.523126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.524674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.526121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.527650 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81361596-1794-4677-a1a9-da7dd974359f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.511941 Aug 25 12:54:36.528294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.529193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.530005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.543995 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1420/2761] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:36.568988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.570172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.584489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.585011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.585934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.587006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.595642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.597075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.809726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.832786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.837575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:36.838436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5d23db4-f78e-4609-bf65-b54cbb2725a8 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.290653 Aug 25 12:54:36.856158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1421/2762] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:36.887304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:36.889035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:36.908414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.909809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.910689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:36.916076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:36.917033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:36.918065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.465095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:37.483344 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c202d94c-03ec-4174-a8e9-5e32f1d82757 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.021972 Aug 25 12:54:37.496994 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1342/2763] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:37.510291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:37.511883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:37.531823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.532755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.533596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.535025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.535875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.536742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.739723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:37.756002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0738ee51-edca-470e-9d15-79da7a41c55f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1527 microversion: 2.1 time: 0.889014 Aug 25 12:54:37.757697 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1422/2764] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:36 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1527 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:37.768184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:37.769347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:37.781719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.783211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.784048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:37.785465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:37.786363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:37.787156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.068051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.083863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee885477-100a-4aed-9152-46dfe1702979 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1321 microversion: 2.1 time: 0.584244 Aug 25 12:54:38.086162 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1343/2765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:37 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:38.094326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:38.096335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:38.108644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.110252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.112477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.113582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.114454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.115272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.218910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.235782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de493dc2-b921-4027-bf60-02d61d614aa8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.475393 Aug 25 12:54:38.237227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1423/2766] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:37 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:38.246390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:38.247574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:38.271077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.272008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.273080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.274677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.275576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.276421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.466639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.484318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.488227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.490561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf5fec17-88e5-4f8e-a17d-cc38df573a09 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.251601 Aug 25 12:54:38.491631 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1424/2767] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:38 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:38.500553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ebbe19-2715-4cab-815c-f179e403c17e", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc6579a-4bad-4308-a501-83c8f932b2c1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:38.519742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.520697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.521540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.545588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] Creating event network-vif-unplugged:8dc6579a-4bad-4308-a501-83c8f932b2c1 for instance 41ebbe19-2715-4cab-815c-f179e403c17e on n-h1-850468-18 Aug 25 12:54:38.556024 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cde7ce93-a3a0-4c4c-be1b-226374cc69e2 req-bb9e7e3d-88ad-4c2f-a8d9-5930feeebf66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062022 Aug 25 12:54:38.557562 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1425/2768] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:38.568274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:38.569647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:38.583739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.584589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.587614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.587614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.587614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.588455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.601715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:38.618899 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-316518b0-0069-4436-81db-e9f6b1bde760 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.531791 Aug 25 12:54:38.632603 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1344/2769] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:38 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:38.790547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:38.791977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:38.804986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.806276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.807414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:38.809172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:38.810355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:38.813598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.026202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.052524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28913351-684b-45d6-955b-2555b7f88de6 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1485 microversion: 2.1 time: 0.269904 Aug 25 12:54:39.053566 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1345/2770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:38 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1485 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:39.065799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ebbe19-2715-4cab-815c-f179e403c17e", "name": "network-vif-deleted", "tag": "8dc6579a-4bad-4308-a501-83c8f932b2c1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:39.084558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.094501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.095992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.096709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.102135 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d29a6428-d716-4880-b92d-62f301ce59cb tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.542393 Aug 25 12:54:39.103645 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1426/2771] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:38 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:39.126104 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] Creating event network-vif-deleted:8dc6579a-4bad-4308-a501-83c8f932b2c1 for instance 41ebbe19-2715-4cab-815c-f179e403c17e on n-h1-850468-18 Aug 25 12:54:39.127261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.128957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.136634 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f9175276-dd15-4ef0-8139-a2c59251710e req-f9ec2a12-585c-4f33-831d-bc1e8f88bf25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079999 Aug 25 12:54:39.137922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1346/2772] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:39.141235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.142634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.144460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.146135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.147006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.147961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.285065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.286575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.299840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.300418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.301226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.302707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.303506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.304363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.414195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.430983 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12d043ec-a641-422d-92c0-a9585786f415 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1512 microversion: 2.1 time: 0.313929 Aug 25 12:54:39.432105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1427/2773] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:39.471912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.473130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.484868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.485808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.486650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.488008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.488949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.489739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.541864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.557120 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-056f4491-4733-4914-ba4d-27d43b4df4a6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.280186 Aug 25 12:54:39.557937 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1347/2774] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:39.566481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.567539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.580187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.581127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.581934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.583231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.584095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.584902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.701374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.716709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.718704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.721659 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43d1dcb6-c007-4b12-bd88-b2036d1c9a00 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.162025 Aug 25 12:54:39.722667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1348/2775] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:39.730394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.731613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.742410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:39.751807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.752729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.753201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.754386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.754839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.755518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.758030 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-286b81c4-e882-457a-a6d9-8c4906fb9b92 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1511 microversion: 2.1 time: 0.293668 Aug 25 12:54:39.759063 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1428/2776] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:39.799511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:39.800701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:39.812182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.812832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.813636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:39.814946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:39.815787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:39.816624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.160455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.180788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-60fcaccc-218a-43e4-80eb-81553d319b84 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.456208 Aug 25 12:54:40.190568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1349/2777] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:40.192302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.193620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:40.205754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.206619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.207465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.208670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.209472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.210283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.211610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.227849 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-584eea04-37ec-483c-ad0d-2b4dd5fff2f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1512 microversion: 2.1 time: 0.436399 Aug 25 12:54:40.229137 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1429/2778] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:39 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:40.241057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.243720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:40.245486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:40.247621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:40.261133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.262258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.263157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.264557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.265454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.266236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.334250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.350004 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df979401-5000-4851-a7a9-145284448ba7 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1309 microversion: 2.1 time: 0.165523 Aug 25 12:54:40.351077 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1350/2779] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:40.360583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.371857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.373645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:40.399221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.400152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.401001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.402455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.403318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.404287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.546942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.562479 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a70b315a-7955-435e-b5b3-f66b1c0ce722 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.330195 Aug 25 12:54:40.564338 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1430/2780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:40.597398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:40.600148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.601080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:40.610631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.611340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.612063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.613167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.613891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.614549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.741982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.755562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:40.758480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:40.758480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:40.962939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:40.979992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f640ae6d-080e-4643-8cb7-7ee8687742d6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.386903 Aug 25 12:54:40.981536 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1431/2781] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:40.990568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:40.992364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:41.003990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.005119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.005973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.007269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.008183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.008960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.068107 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d088806e-c5cc-4aed-a96f-13b5a58e199f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.714842 Aug 25 12:54:41.071823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1351/2782] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:41.114962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:41.125597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.127683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-398308874', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:41.137774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.138647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.139455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.140970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.141877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.142721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.148577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.165969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.169628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8086637e390483cbf8fe637abc4e0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf648b9836b4eb588e6d48f2ad5c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.172086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cba3a941-2598-4f81-8309-56ba04d9cb52 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 200 len: 1362 microversion: 2.57 time: 0.188721 Aug 25 12:54:41.173772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1432/2783] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:40 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:54:41.223361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:41.224880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:41.243822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.244756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.245662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.247297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.248010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.248676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.352462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:41.509032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.536982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.537956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.538697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.739266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:41.763708 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d418a8c6-b7f3-4130-8336-88990d65a32a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1328 microversion: 2.1 time: 0.550562 Aug 25 12:54:41.769342 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1433/2784] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:41 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1328 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:41.785310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:41.786332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:41.799963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.800875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.801647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.802984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.803831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.805236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.879191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:41.881084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:41.882217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:41.883604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lazy-loading 'fault' on Instance uuid 41ebbe19-2715-4cab-815c-f179e403c17e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:54:42.035404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:42.052987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5871ba01-bea1-4a3e-9c1d-54ab5438e877 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 200 len: 1314 microversion: 2.1 time: 0.280578 Aug 25 12:54:42.054095 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1434/2785] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:41 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:42.064677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:42.065660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:42.078511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.081183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.082633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.084211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.085103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.085921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.110158 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c4904c2-0c54-4dd5-b1b5-6d378272b125 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-398308874" status: 200 len: 1514 microversion: 2.1 time: 1.003422 Aug 25 12:54:42.113341 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1352/2786] 10.222.0.60 () {58 vars in 1261 bytes} [Thu Aug 25 12:54:41 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-398308874 => generated 1514 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:42.124067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:42.125825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:42.170431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.176978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.179168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:42.181259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:42.192464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:42.202014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.067974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.090233 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c4bf626-4616-4052-97ca-e38d50b167e0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.033947 Aug 25 12:54:43.092439 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1435/2787] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:42 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:43.098828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.114642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.123663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-90aaa207-24df-4924-a2d4-35515fa18b2b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 1.006608 Aug 25 12:54:43.127426 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1353/2788] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:42 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:43.132986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.135390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:43.144275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.147380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] [instance: acbb5616-fc0f-4087-9273-609687848c15] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.160875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.162016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.162853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.164401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.164658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.165273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.166054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.166485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.167611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.169082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.170535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.171741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.210427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] HTTP exception thrown: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Request method failure captured: Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 HTTP/1.1 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3DMSP7dqy2deS5WOX_HniSJcN-AqN2WuaB8Om0-DYx1co0oez256lxtitjBK0O9aozAM9eWEPhrsIfFiD6WCBpEkXwmYYSX5asD-qhf4HoFB1SzOjIuUcP4IGF_0TvZnrIfT6BTYkMbP1t8v_qxTjtpQk2tCqZxPVm2A1Mbtmx8np8 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.57 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ccf648b9836b4eb588e6d48f2ad5c979 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerShowV257Test-1478525297 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ccf648b9836b4eb588e6d48f2ad5c979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ccf648b9836b4eb588e6d48f2ad5c979"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccf648b9836b4eb588e6d48f2ad5c979"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ccf648b9836b4eb588e6d48f2ad5c979"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerShowV257Test-1478525297 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ccf648b9836b4eb588e6d48f2ad5c979 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerShowV257Test-1478525297 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerShowV257Test-1478525297-project Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: a8086637e390483cbf8fe637abc4e0d6 Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerShowV257Test-1478525297-project Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'acbb5616-fc0f-4087-9273-609687848c15'} Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:43.214804 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] Returning 404 to user: Instance acbb5616-fc0f-4087-9273-609687848c15 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:43.225137 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ecdee98-7469-4cc0-93dc-7f6ae4255616 tempest-ServerShowV257Test-1478525297 tempest-ServerShowV257Test-1478525297-project] 10.222.0.60 "GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15" status: 404 len: 111 microversion: 2.57 time: 0.085866 Aug 25 12:54:43.236898 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1354/2789] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/acbb5616-fc0f-4087-9273-609687848c15 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:54:43.247132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.249158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.279713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.281121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.285536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.286948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.287772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.288912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.389537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:43.416473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:43.541022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.556764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.557686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.558536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.636593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.653502 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-428b47db-ba3c-4e6c-8a56-b42f51a71529 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1509 microversion: 2.1 time: 0.414702 Aug 25 12:54:43.655858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1355/2790] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:43.667970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.669203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.688246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.691177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.692315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.693833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.694791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.696060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.729003 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e HTTP/1.1 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '41ebbe19-2715-4cab-815c-f179e403c17e'} Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.732076 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43bce11a-08b8-4980-ac8c-e08517cc0eef tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 404 len: 111 microversion: 2.1 time: 0.075867 Aug 25 12:54:43.741794 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1356/2791] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:43.745342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.746342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:43.759242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.760019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.760872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.762172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.762999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.763768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.863665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e90532eb-5db6-4035-90c7-ee11c41abf41 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.756661 Aug 25 12:54:43.865172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1436/2792] 10.222.0.60 () {58 vars in 1173 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:43.918757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:43.930735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:43.932403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.servers [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Removing options 'limit' from query {{(pid=122701) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 12:54:43.934236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:43.944581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.946098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.947141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:43.948920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:43.949979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:43.951087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.020048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:44.032251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.033453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.034109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.099553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:44.116604 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-766289a7-a1ca-4636-b96d-35a929cb302d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1509 microversion: 2.1 time: 0.378058 Aug 25 12:54:44.128219 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1357/2793] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:44.129294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1044622992", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:44.287100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] validate_networks() for [('fabf892b-f355-4faa-8957-7370362aa48d', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:54:44.307705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af304d04-2973-4a07-b2d5-a9c4b386a036 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.396034 Aug 25 12:54:44.309024 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1437/2794] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 12:54:43 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:54:44.328417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:44.337375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:44.353700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.355316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.356106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.357702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.358568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.359663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.832594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:44.846378 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b8b95b7d-b2f9-488a-b310-c3c6237963a9 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.530932 Aug 25 12:54:44.847407 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1438/2795] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:44 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:44.854984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:44.855807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:44.875797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.877341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.878333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.879795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:44.880704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:44.881524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:44.955218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:45.145554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9b6533c-2e10-438a-9dee-1a6509a8188e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 204 len: 0 microversion: 2.1 time: 0.295210 Aug 25 12:54:45.146925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1439/2796] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:54:44 2022] DELETE /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:54:45.159914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.161422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:45.175123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.176876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.178192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.179649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.180559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.181630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.407521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:54:45.409633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:54:45.411565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:54:45.413131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:54:45.414425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:54:45.435503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.438035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.439636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.441089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.442118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.442881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.476943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:54:45.490693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Getting quotas for user 8a26316f4ba04e8598ae218980ef72f0 and project 0fc6f7eecabd4ffc9752b60b91aa5a33. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:54:45.520669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:45.521549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:54:45.531426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:54:45.538078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4aa5dcc5-4ad2-4ff3-ade3-a6ec7244e646 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1471 microversion: 2.1 time: 0.389256 Aug 25 12:54:45.540137 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1440/2797] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:45.560811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.576437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:45.577854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:45.589359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.590359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.592045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.592937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.593782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.594992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.662867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9842b590-721f-4f08-9b06-7239c106e4b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.542811 Aug 25 12:54:45.665049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1358/2798] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:54:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:54:45.674212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.676029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:45.687551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.689633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.690680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.693394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:45.694277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:45.695076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:45.790868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:45.941283 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba9aa20d-10b7-4784-b855-a16c12537399 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.400365 Aug 25 12:54:45.942917 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1441/2799] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:45.957767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e59e5d5-6e4d-4adf-aa06-f591e472726a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:45.959089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e59e5d5-6e4d-4adf-aa06-f591e472726a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:46.103202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:46.107115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e59e5d5-6e4d-4adf-aa06-f591e472726a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:46.121835 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e59e5d5-6e4d-4adf-aa06-f591e472726a tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1225 microversion: 2.1 time: 0.176358 Aug 25 12:54:46.132171 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1442/2800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:46.132500 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-511b0bbd-ef12-44a4-913b-1bc8716d5b6b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1515 microversion: 2.1 time: 0.458242 Aug 25 12:54:46.132639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.143290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:46.143676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1359/2801] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:45 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:46.163744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.169210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.170465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.172272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.174643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.174853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:46.175673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.servers [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Removing options 'limit' from query {{(pid=122700) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 12:54:46.175892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.176900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.177113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:46.190412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.190412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.191450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.193898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.195186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.196255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.265239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:46.339662 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58cf9bd1-3080-49c8-9886-8fdff817ea4b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.193745 Aug 25 12:54:46.340702 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1360/2802] 10.222.0.60 () {58 vars in 1150 bytes} [Thu Aug 25 12:54:46 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:46.370124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.381979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:46.383072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:46.393480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.394405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.395234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.396792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.397763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.399620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.499255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:46.591719 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.234071 Aug 25 12:54:46.603384 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1361/2803] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 12:54:46 2022] GET /compute/v2.1/servers => generated 1010 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:46.606944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.609065 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56c15fe2-b45c-4cb4-94d1-c77ea973809e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003953 Aug 25 12:54:46.610689 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1362/2804] 10.222.0.60 () {56 vars in 886 bytes} [Thu Aug 25 12:54:46 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 12:54:46.618443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:46.619824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:46.632590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.634382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.635421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:46.636647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:46.637504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:46.638253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.049174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:47.066571 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-767fd175-7576-419b-838b-8e82a9c23478 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1463 microversion: 2.1 time: 0.454030 Aug 25 12:54:47.067955 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1363/2805] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:46 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1463 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:47.076601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.087138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:47.087515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:47.088714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:47.107832 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8aaf9ab6-20ee-46e4-9dd7-13ad4977e8ec tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.982097 Aug 25 12:54:47.110141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1443/2806] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:46 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:47.121169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.122461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:47.126518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.127273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.128004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.129507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.130527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.131235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.135996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.137109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.138005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.139118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.139970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.141119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.357091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:47.494423 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6ae85b6-37c1-454e-9388-38260bc2b023 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.424583 Aug 25 12:54:47.506005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1364/2807] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:47.531500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.532589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a1f5fd19-b9e5-4e6c-8ca7-95e8fd408768 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1616 microversion: 2.1 time: 0.416044 Aug 25 12:54:47.533911 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1444/2808] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1616 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:47.540486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:47.555233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.556493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:47.568266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.569140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.569920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.571065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.571916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.572664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.575446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.576465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.577180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.578496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.582453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.583241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.811737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:47.832032 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-04ed80ad-605a-485a-a0ef-ce95a28712c5 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1229 microversion: 2.1 time: 0.322754 Aug 25 12:54:47.834422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1365/2809] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1229 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:47.845779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.869843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:47.871144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.servers [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Removing options 'limit' from query {{(pid=122700) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 12:54:47.872473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:47.893741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.895628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.896575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.898134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.900153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.900356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:47.961003 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da0b13e9-6384-437d-9d4a-b281b33d247f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.123302 Aug 25 12:54:47.962114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1366/2810] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:47.975154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c31c1aa-819e-4258-9314-57bfc2e3c7da tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '.version_select at 0x7fc6c2a29c10>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:47.982772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c31c1aa-819e-4258-9314-57bfc2e3c7da tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:47.982772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c31c1aa-819e-4258-9314-57bfc2e3c7da tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:47.987359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c31c1aa-819e-4258-9314-57bfc2e3c7da tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.002787 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c31c1aa-819e-4258-9314-57bfc2e3c7da tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.038274 Aug 25 12:54:48.016158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:48.024604 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1367/2811] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:48.038108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b6a7b0b-7089-41bd-8890-bb9cb9c8bf9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1515 microversion: 2.1 time: 0.496779 Aug 25 12:54:48.040968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1445/2812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:47 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1515 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:48.075736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:48.093598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:48.096154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-398308874', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:54:48.130392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:48.131584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:48.132404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.136728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:48.144579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:48.146989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.170277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:48.192909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:48.269103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:48.270065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:48.270899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.272303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:48.285390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:48.286748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:48.676677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:54:48.765797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:49.002101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-025d629b-9005-48c8-8664-fb955d032fc8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-398308874" status: 200 len: 345 microversion: 2.1 time: 0.975471 Aug 25 12:54:49.021253 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1368/2813] 10.222.0.60 () {58 vars in 1240 bytes} [Thu Aug 25 12:54:48 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-398308874 => generated 345 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:49.030896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-870946985", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:49.041988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:49.077603 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-76c5ad1e-d498-4118-9b16-0dc23c5ebc17 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.931768 Aug 25 12:54:49.091073 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1446/2814] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:48 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:49.146097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:49.150401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:49.182610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.183844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.184845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.186457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.187907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.189614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.238824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:54:49.377397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:49.393123 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18beea5d-b6c7-4ee0-bf9d-20423db00dbe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1277 microversion: 2.1 time: 0.276467 Aug 25 12:54:49.394636 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1447/2815] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:49 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:49.405731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:49.423254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.424591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.425800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.481888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 12:54:49.613088 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-05043b69-6110-412e-87ee-1bedfd5e5110 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "POST /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.208902 Aug 25 12:54:49.620556 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1448/2816] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:54:49 2022] POST /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:49.645795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:49.647286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:49.681123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.682138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.683140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:49.685021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:49.688565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:49.690155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.567445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:54:50.569367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:54:50.576982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:54:50.578563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:54:50.579504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:54:50.598411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.599481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.600344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.601953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.602902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.603728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.615270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:50.646993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:54:50.656343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3088c13f-9b9b-40ae-894c-051d8f33c041 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1515 microversion: 2.1 time: 1.034186 Aug 25 12:54:50.657632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1449/2817] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:49 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1515 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:50.658227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:54:50.666234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:50.683003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:50.687914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:50.689071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:54:50.693551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:54:50.715704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.716747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.717705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.719921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.721604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.722822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.823848 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74d01224-c405-405e-bb1c-e922ddd210e2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800260 Aug 25 12:54:50.827049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1369/2818] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:54:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:54:50.846600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:50.847950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:50.860798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.862200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.863692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:50.865460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:50.868297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:50.869687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.784928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:51.808428 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9081da8f-f880-49f7-a47f-fd9addc4feac tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 1.148590 Aug 25 12:54:51.809620 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1450/2819] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:50 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:51.826956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:51.847005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:51.849356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:51.864052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.865401 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1cf349d2-2820-4e52-a802-dbf5da450653 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.034076 Aug 25 12:54:51.865717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.866489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1370/2820] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:50 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:51.867249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.869778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.871186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.875603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:51.884671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.885417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:51.897369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:51.905764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.906727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.908376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:51.909848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:51.910659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:51.911419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.198022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:52.212653 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa6554be-3a5b-4fb9-9be9-1cf71178dc7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1216 microversion: 2.1 time: 0.343813 Aug 25 12:54:52.214044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1371/2821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:51 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1216 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:52.228418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:52.243410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:52.245207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:52.258331 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a507a8a5-77e4-4a54-a922-100d3ecdc410 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1283 microversion: 2.1 time: 0.430917 Aug 25 12:54:52.262760 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1451/2822] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:51 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1283 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:52.269662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.270733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.271705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.273398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.274724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.275936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.631282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:52.685764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3206c61-e66b-4865-935e-b5a745cda8d2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 200 len: 1473 microversion: 2.1 time: 0.466064 Aug 25 12:54:52.687396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1372/2823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:52 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:52.862713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:52.866250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:52.889829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.891386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.892878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.895347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.897365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.899139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:52.903194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c274471-1ce7-4c7f-b214-0b6054c6c030", "name": "network-vif-deleted", "tag": "fdbc4273-4ebd-4c45-8593-f44be2e7a5f2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:52.934914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:52.948533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:52.949501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:53.019629 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] Creating event network-vif-deleted:fdbc4273-4ebd-4c45-8593-f44be2e7a5f2 for instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 on n-h1-850468-18 Aug 25 12:54:53.039335 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5a9c1c16-dcfa-47ce-bc28-2c49f92963ac req-8cf8b731-0c72-4904-8dc3-dd541d700c3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170367 Aug 25 12:54:53.041342 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1373/2824] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:53.067717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:53.077740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:53.136085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:53.138404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:53.139304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:53.140724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:53.141831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:53.147428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.746126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:54.792691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-55333c08-6fb8-4ad9-a624-fb69da630309 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 1.948386 Aug 25 12:54:54.804374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1452/2825] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:52 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:54.813831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:54.815835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:54.829235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.830862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.832235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.834554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.835998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.838333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.857485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:54.884257 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b34bfdf0-7ccd-4ceb-babe-f69dd68743a5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.839643 Aug 25 12:54:54.886336 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1374/2826] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:53 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:54.924095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:54.925766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:54.951687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.956673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.957616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:54.962807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:54.964443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:54.965362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.034998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:55.049845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8d2786c-cf61-4be7-99e6-efab189e6988 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1270 microversion: 2.1 time: 0.245011 Aug 25 12:54:55.057253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1453/2827] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:54 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:55.087585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.092176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:55.109525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.110256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.110889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.112207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.113203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.114077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.134212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 HTTP/1.1 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3c274471-1ce7-4c7f-b214-0b6054c6c030'} Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.136883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80c21178-e61b-4db7-8b3d-0c50d1ae8861 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 404 len: 111 microversion: 2.1 time: 0.072197 Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1454/2828] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:55 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:54:55.157436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "name": "network-vif-plugged", "status": "completed", "tag": "b4f21784-7a97-4b3d-bc0f-2c0e889914b1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:55.174377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.175227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.176055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.200448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] Creating event network-vif-plugged:b4f21784-7a97-4b3d-bc0f-2c0e889914b1 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:54:55.211452 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a641a9ad-f1b8-4a4f-b1f1-46621cfd7ed0 req-375d1957-8487-4cf1-962f-7f693c6bd67b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062949 Aug 25 12:54:55.212575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1455/2829] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:55.226187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730eaa8b-b270-44ea-bd56-4de7581671d1", "tag": "17d273b7-8827-4268-afa9-f74899d04c99"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:55.248775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:55.249653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:55.250494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:55.278129 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] Creating event network-changed:17d273b7-8827-4268-afa9-f74899d04c99 for instance 730eaa8b-b270-44ea-bd56-4de7581671d1 on n-h1-850468-18 Aug 25 12:54:55.286345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7226e1ed-7712-4694-9345-c3e43a36f968 req-ef33c175-89dd-4b21-bfc0-983f8b0a2669 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071014 Aug 25 12:54:55.287550 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1456/2830] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:55.442713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:55.464244 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74652c2c-5318-4221-9356-2cd5211b4c9f tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 0.550407 Aug 25 12:54:55.489580 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1375/2831] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:54 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:55.505235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3422585b-0202-4874-923b-123fd586bec0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '.version_select at 0x7fc6c264a9d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.548908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3422585b-0202-4874-923b-123fd586bec0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-key-209201129" status: 202 len: 0 microversion: 2.1 time: 0.057091 Aug 25 12:54:55.550304 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1376/2832] 10.222.0.60 () {58 vars in 1206 bytes} [Thu Aug 25 12:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-209201129 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:55.640873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:55.683429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-258e9d24-daaf-4c24-8e29-89f9a56b4da7 tempest-ComputeTenantNetworksTest-1477345899 tempest-ComputeTenantNetworksTest-1477345899-project] Calling method '.version_select at 0x7fc6c6c7e430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:55.795225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-715429907", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:55.906455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:54:56.114915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:54:56.308144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-258e9d24-daaf-4c24-8e29-89f9a56b4da7 tempest-ComputeTenantNetworksTest-1477345899 tempest-ComputeTenantNetworksTest-1477345899-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.018298 Aug 25 12:54:56.309270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1457/2833] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 12:54:55 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:56.322373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:56.323871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:56.337925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:56.338460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:56.338933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:56.340254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:56.341054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:56.341889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.020160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:57.038432 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81945e8d-c71a-4c61-bc64-bffbcd514fa6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 0.725901 Aug 25 12:54:57.040001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1458/2834] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:56 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:57.050454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:57.051615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:57.065113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.066545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.067482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.068905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.069816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.070998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.748295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:57.752581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:54:57.753422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:54:57.754208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:54:57.754980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:54:57.755786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:54:57.767673 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-03e14406-1195-4fca-a8a6-32ec572a0432 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 0.724571 Aug 25 12:54:57.768769 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1459/2835] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:57 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:57.778911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:57.779274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.779967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:57.780425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.781263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.783754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.785126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.786178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.794397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.795345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.796189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.798315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:57.799200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:57.800000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:57.826031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:54:57.834951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:54:57.866871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:54:57.872764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:54:57.975661 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c30e9f68-8bcc-43e0-83a8-b67b7849f7fd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188970 Aug 25 12:54:57.976867 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1377/2836] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 12:54:57.986604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7abcdb7d-97a8-46de-9170-59f4228f6235 tempest-ComputeTenantNetworksTest-1477345899 tempest-ComputeTenantNetworksTest-1477345899-project] Calling method '.version_select at 0x7fc6c1c96820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.254621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7abcdb7d-97a8-46de-9170-59f4228f6235 tempest-ComputeTenantNetworksTest-1477345899 tempest-ComputeTenantNetworksTest-1477345899-project] 10.222.0.60 "GET /compute/v2.1/os-tenant-networks/0a46c061-858b-49d3-bc74-92b6e983e92a" status: 200 len: 139 microversion: 2.1 time: 0.275953 Aug 25 12:54:58.255582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1378/2837] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 12:54:57 2022] GET /compute/v2.1/os-tenant-networks/0a46c061-858b-49d3-bc74-92b6e983e92a => generated 139 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:58.265341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:58.274041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.275148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:58.291131 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11b0c25a-32cd-4635-9aa2-d83bd177b455 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 0.519427 Aug 25 12:54:58.300862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.301915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.302922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.304379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.305482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.308333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.312746 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1460/2838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:57 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:58.331886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.332874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:58.345326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.346235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.347060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.348429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.349296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.350088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.419631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:54:58.626900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:58.650165 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6b79d0f-6e46-413a-ad9d-e74c49f250b4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 0.392406 Aug 25 12:54:58.652453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1379/2839] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:58 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:58.662806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "name": "network-vif-plugged", "status": "completed", "tag": "93115bdd-4065-4aae-af25-3524f76ce265"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:54:58.664306 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d7e3024-3da1-460b-b93d-24999fa72ce8 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "DELETE /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 204 len: 0 microversion: 2.32 time: 0.348472 Aug 25 12:54:58.666692 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1461/2840] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:54:58 2022] DELETE /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:54:58.680046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.684387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:58.687109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.689667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.691182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.712381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.713079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.714579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.716995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.718047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.718916 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] Creating event network-vif-plugged:93115bdd-4065-4aae-af25-3524f76ce265 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:54:58.719584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.733349 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1a9f4aec-9861-431d-97ae-3e972b4a3f68 req-a60a349c-c7ba-4805-ad3c-a047501c0c1a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077678 Aug 25 12:54:58.735726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1380/2841] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:54:58.755922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-598e3863-e92f-45fb-aa4e-ded17700169e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.759845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-598e3863-e92f-45fb-aa4e-ded17700169e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:58.878782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-598e3863-e92f-45fb-aa4e-ded17700169e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:54:58.890008 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-598e3863-e92f-45fb-aa4e-ded17700169e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1208 microversion: 2.1 time: 0.150529 Aug 25 12:54:58.891580 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1381/2842] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:58 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:54:58.911790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:58.919720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:58.932101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'services' on Instance uuid 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:54:58.941883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.942813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.943571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:58.945102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:58.946282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:58.947406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.085339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-942ccaa2-997e-48f0-be0b-2b50e9c885d8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments/645c3612-08b0-4e63-a69d-5d6167acb782" status: 202 len: 0 microversion: 2.1 time: 0.414945 Aug 25 12:54:59.086758 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1462/2843] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 12:54:58 2022] DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments/645c3612-08b0-4e63-a69d-5d6167acb782 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:54:59.109490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:54:59.111392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:54:59.125843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.126210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.127071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:54:59.128452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:54:59.129392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:54:59.130300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.451125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:00.508379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:00.513666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:00.525513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-590aa185-41b3-4281-9020-f336e0c4383f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2954 microversion: 2.32 time: 1.436155 Aug 25 12:55:00.544077 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1463/2844] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:54:59 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2954 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:00.575238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:00.576549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:00.612630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:00.613541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.614733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.614953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.616869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.617810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.618580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.651489 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cc145aa-3db9-4c71-a2d2-9a86366ea6d4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 1.750035 Aug 25 12:55:00.682680 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1382/2845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:54:58 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:00.697878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:00.713370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:00.741009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.747509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.748497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.749885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.750802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.751584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.890980 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69f09536-b485-4149-8714-1e6e52917fb9 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205503 Aug 25 12:55:00.899161 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1383/2846] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:55:00 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:00.923208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:00.930400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:00.962236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.963648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.967109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:00.975626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:00.977392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:00.978974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:02.267355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:02.290526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:02.305842 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0fa57734-f06c-4e10-aebf-e61ade1e4858 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 1.399971 Aug 25 12:55:02.309713 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1384/2847] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:00 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:02.325114 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64b5727c-4869-497d-aa12-d3ae8db25e66 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1334 microversion: 2.1 time: 1.769325 Aug 25 12:55:02.327043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1464/2848] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:00 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1334 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:02.345415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:02.347895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:02.349524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:02.350041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:02.374809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:02.384192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:02.385381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:02.387063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:02.388219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:02.389292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:02.390879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:02.401825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:02.402872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:02.404541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:02.405519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:02.406477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.035286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:04.088144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e082e5b6-4796-442a-a953-c7e3a4e6ad91 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 1.774620 Aug 25 12:55:04.093746 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1385/2849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:02 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:04.131751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:04.138060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:04.166353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.167813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.169194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.171074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.193722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:04.205264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.206509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.252011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a29ad89-02cb-426c-b004-8ad65654b189 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1308 microversion: 2.1 time: 1.916551 Aug 25 12:55:04.253214 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1465/2850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:02 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1308 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:04.291484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:04.300836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:04.337310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.352620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.353826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:04.362649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:04.376761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:04.382164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.099440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:06.131493 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b18f71de-8ea2-406c-bdff-55691a2ac155 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 1.868486 Aug 25 12:55:06.137751 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1466/2851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:04 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:06.156175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.163683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.191242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.192107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.196781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.198636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.199898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.201135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.298748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:06.326190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:06.330886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:06.334373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6aa790c4-e262-4bc3-9726-f2aaea31d38f tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2954 microversion: 2.32 time: 2.235473 Aug 25 12:55:06.335701 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1386/2852] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:04 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2954 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:06.377239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.389282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.393055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de68e19a-f663-47b6-a467-d34bf8068d3e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248851 Aug 25 12:55:06.404590 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1467/2853] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:55:06 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:06.422342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.424763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.425895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.427618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.429078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.429502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:06.430625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.430842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:06.448581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.449503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.450320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.451893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:06.452770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:06.471030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:06.551054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:07.439844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:07.455176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dc03bfbe-4b39-4a76-8004-15cef679fc6b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 1.102483 Aug 25 12:55:07.456317 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1387/2854] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:06 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:07.476161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "3bf0bb65-2dd9-487c-b142-b393435c60b9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:07.525333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:07.526294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:07.527359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:07.564216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:07.598795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef49b277-1b7e-4a08-b834-d42b8ad8209b tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1670 microversion: 2.1 time: 1.190007 Aug 25 12:55:07.599149 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] Creating event network-vif-unplugged:3bf0bb65-2dd9-487c-b142-b393435c60b9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:07.616200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1468/2855] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:06 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1670 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:07.647110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:07.650742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4c0610b4-4204-4a4a-a73d-2812aa820821 req-06a05a69-c135-4201-ad26-ecd2bd9cc772 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185391 Aug 25 12:55:07.652997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1388/2856] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:07.658174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:07.673711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:07.680510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:07.683912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:07.691558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:07.692699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:07.694333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:07.698595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:07.706044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:07.707375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:07.708488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:07.710031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:07.710304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:07.711456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:07.712550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:07.805008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=20 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:08.235709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:08.242039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:08.259296 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8bf9c883-884d-471f-a78f-580cb4b5ce08 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 0.640719 Aug 25 12:55:08.260814 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1469/2857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:07 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:08.269236 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7eb0fa04-76e5-4165-a403-6c1412121224 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1308 microversion: 2.1 time: 0.603314 Aug 25 12:55:08.271719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de10e4ed-cbc9-42dd-ab1f-008225eb7811", "tag": "f3743538-56b9-4952-ad48-f44fc5878662"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:08.273596 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1389/2858] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:07 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1308 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:08.285996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c6375b-030f-4c2f-8a26-79c4f77ba192", "tag": "c98e23dd-e986-420e-9817-6f7be2812234"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:08.308599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.309963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.310540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.311395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.312051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.313553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.344155 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] Creating event network-changed:f3743538-56b9-4952-ad48-f44fc5878662 for instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 on n-h1-850468-18 Aug 25 12:55:08.345802 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] Creating event network-changed:c98e23dd-e986-420e-9817-6f7be2812234 for instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 on n-h1-850468-18 Aug 25 12:55:08.356241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e0361b57-d3a3-49ae-887d-2f7d8759e59d req-c76b502d-fa2f-45df-8f21-0b170d41274d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079854 Aug 25 12:55:08.357047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a2401900-d3a2-410c-943e-3512ef92e4c2 req-772a1b7b-e1b2-40fb-bcc4-1d805b7dccc8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093540 Aug 25 12:55:08.358091 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1390/2859] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:08.358711 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1470/2860] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:08.373845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:08.376646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:08.378615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:08.380204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:08.387121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:08.391794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.393024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.395741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.397434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.398435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.399888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.400921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.401810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.407047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.408556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:08.409525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:08.410284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:08.885083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=24 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:09.114518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:09.120835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:09.142312 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-481b5332-501b-4185-9985-38166829298b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1521 microversion: 2.1 time: 0.774241 Aug 25 12:55:09.151607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:09.155515 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1391/2861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:08 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:09.166503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:09.168573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:09.170776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:09.181371 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89cb0225-12bc-469a-b86b-36d7b0ef97bd tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2933 microversion: 2.32 time: 0.809030 Aug 25 12:55:09.191036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1471/2862] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:08 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2933 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:09.200445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:09.204350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:09.229048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.235567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.238562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.239716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.241572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.242511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.243043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.243333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.244676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.246526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.251808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.252797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.292834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:09.333433 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9436df99-4c6e-44cf-a9aa-ddee88c45c0d tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e/ips" status: 200 len: 180 microversion: 2.1 time: 0.139810 Aug 25 12:55:09.335352 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1472/2863] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 12:55:09 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e/ips => generated 180 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:09.340369 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-24300ccb-87ea-49e9-94cd-6ddc337ad4fa tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182684 Aug 25 12:55:09.345090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:09.345414 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1392/2864] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:55:09 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:09.346912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:09.358298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.364052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:09.365655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.366844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.368557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.370235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:09.371665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.372814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.392039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.393403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.394577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:09.396167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:09.397280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:09.398115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:10.666169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:10.685430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee07dfd9-4033-454a-a9fe-7ccf1faa8893 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 1.347734 Aug 25 12:55:10.687145 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1473/2865] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:09 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:10.699973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:10.704447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:10.721011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.723121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.724487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:10.726277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.727595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.728851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:10.768389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:10.837686 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-448419aa-8f47-4589-a430-5aa8db72520b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 1.489361 Aug 25 12:55:10.841186 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1393/2866] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:09 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:10.859311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:10.862929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:10.892629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.898226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.900521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:10.911177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:10.912520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:10.913951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.038854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:55:11.482605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:11.491519 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b82e199-02c2-4d78-998d-c54ee1b4fcd0 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 204 len: 0 microversion: 2.1 time: 0.646452 Aug 25 12:55:11.492688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1394/2867] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:10 2022] DELETE /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:55:11.514325 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3523ab0e-1b00-424d-997e-fb58bf7a1a32 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1308 microversion: 2.1 time: 0.824096 Aug 25 12:55:11.529164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "866fcb99-5974-4d0f-84c9-547637dd0877"}, {"server_uuid": "730eaa8b-b270-44ea-bd56-4de7581671d1", "name": "network-vif-plugged", "status": "completed", "tag": "17d273b7-8827-4268-afa9-f74899d04c99"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "f7963a7b-7a3d-40a4-af83-c475625d89d9"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b7166a-7415-4c83-aec2-68510b37e32b"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "94d3aef5-5dce-46b9-bfd1-288869dbf5e0"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-unplugged", "status": "completed", "tag": "3d99ee29-74a8-4303-a784-e96e221ba3f3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:11.530883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1474/2868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:10 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:11.561956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:11.563352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:11.564283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:11.565022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.567582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:11.582920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:11.585097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:11.586663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.588660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:11.590275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:11.591417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.637330 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-unplugged:866fcb99-5974-4d0f-84c9-547637dd0877 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:11.638829 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-plugged:17d273b7-8827-4268-afa9-f74899d04c99 for instance 730eaa8b-b270-44ea-bd56-4de7581671d1 on n-h1-850468-18 Aug 25 12:55:11.643778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-unplugged:f7963a7b-7a3d-40a4-af83-c475625d89d9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:11.648465 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-unplugged:d0b7166a-7415-4c83-aec2-68510b37e32b for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:11.650370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-unplugged:94d3aef5-5dce-46b9-bfd1-288869dbf5e0 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:11.658536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] Creating event network-vif-unplugged:3d99ee29-74a8-4303-a784-e96e221ba3f3 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:11.697737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-afef4a93-e543-4d75-a05a-cc0cd462af88 req-d8b5f433-a860-4960-8926-0300d1357ed6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.201092 Aug 25 12:55:11.699404 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1395/2869] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:11.710921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:11.712144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:11.737190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:11.738381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:11.739453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:11.741313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:11.742516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:11.743559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.502616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:12.513277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:12.547706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:12.554069 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b741a693-d0b2-4f99-a77f-47a17440a906 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1498 microversion: 2.1 time: 1.009362 Aug 25 12:55:12.561165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1475/2870] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:11 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1498 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:12.568168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:12.575909 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21086b06-3a13-494f-8108-fab68996dbed tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2912 microversion: 2.32 time: 0.872628 Aug 25 12:55:12.580297 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1396/2871] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:11 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2912 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:12.582970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:12.592299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:12.593030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:12.598361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:12.626393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.627324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.630262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.632524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.633432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.637683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.638006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.640787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.642125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.645510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.650599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.651497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.770172 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e605668-028d-46d4-bae6-5a7c64248d9c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207081 Aug 25 12:55:12.780065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1476/2872] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:55:12 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:12.791035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:12.794050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:12.808452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.809414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.810251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:12.812272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:12.813504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:12.814334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:13.579210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:13.610994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-15802f2a-6b19-44ff-b8b0-a25854e28be8 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1676 microversion: 2.1 time: 1.027616 Aug 25 12:55:13.614294 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1397/2873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:12 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1676 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:13.632709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:13.635061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:13.654675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:13.656313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:13.660413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:13.662757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:13.664442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:13.665225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:13.727270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:13.741909 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-49a8a431-05b9-400f-9031-5ef86399ee0a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 0.959230 Aug 25 12:55:13.743021 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1477/2874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:12 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:13.771962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:13.779915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:13.794493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:13.795797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:13.797201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:13.799230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:13.800696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:13.801990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.385604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:14.402647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:14.405107 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-867eb577-9606-470c-8467-3ae5d5193c51 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 0.787731 Aug 25 12:55:14.406451 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1398/2875] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:13 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:14.428353 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-079c82f1-be36-4dda-a93b-11cae2a1c8fa tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1308 microversion: 2.1 time: 0.677800 Aug 25 12:55:14.429615 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1478/2876] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:13 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:14.441309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:14.457946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-deleted", "tag": "d0b7166a-7415-4c83-aec2-68510b37e32b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:14.469493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:14.471593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:14.482458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:14.483390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:14.485214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.487254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:14.488260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:14.489945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.491673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:14.493103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:14.494247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.518103 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] Creating event network-vif-deleted:d0b7166a-7415-4c83-aec2-68510b37e32b for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:14.530041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fb9838e4-1a6c-4c41-a390-9c4ece18e099 req-c7faac1e-2db5-407a-ab1a-8ee02d807842 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097622 Aug 25 12:55:14.533002 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1479/2877] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:14.568088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:14.570011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:14.588158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:14.589367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:14.590647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.592575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:14.594963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:14.596467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:14.729066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:14.979643 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ae698b7-6beb-4dc6-8180-604a2d1d26f8 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.570192 Aug 25 12:55:14.982856 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1399/2878] 10.222.0.60 () {58 vars in 1154 bytes} [Thu Aug 25 12:55:14 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:15.001876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:15.010334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:15.053530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.054560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.059323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.061109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.061732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.062486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.232503 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b216882f-8571-40fc-bdf5-d08ad65bab9e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.238532 Aug 25 12:55:15.234006 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1400/2879] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 12:55:14 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e/os-volume_attachments => generated 25 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:55:15.257619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:15.266254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:15.293888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.295323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.303343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.306487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:15.307496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:15.308437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:15.885519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:15.925522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:15.943962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:15.950839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7becd554-51c7-40f5-9df2-918c84f9c95e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2753 microversion: 2.32 time: 1.413342 Aug 25 12:55:15.978414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1480/2880] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:14 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2753 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:16.012996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:16.015315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:16.033460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:16.035096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:16.036421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:16.038269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:16.039575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:16.041185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.222419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:17.239666 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3960779f-9a67-446c-a11c-4050d253f243 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 1.258753 Aug 25 12:55:17.246766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1481/2881] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:15 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:17.255334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:17.272931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:17.279161 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-685c8ef8-001f-4614-992d-164970f367ab tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1676 microversion: 2.1 time: 2.042135 Aug 25 12:55:17.296861 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1401/2882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:15 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1676 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:17.307482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.308990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.309840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.331577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:17.332682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:17.352097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.353376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.354428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.356007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.357456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.358657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.374457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Going to try to start instance {{(pid=122701) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 12:55:17.485318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0b3e134-3cb4-4a58-bcdf-94d8c423b9b5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "POST /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.222954 Aug 25 12:55:17.486491 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1482/2883] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:17 2022] POST /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:17.499435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:17.503669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:17.515586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.516563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.517376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.518802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.519640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.520767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.585847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Cannot 'reboot' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action HTTP/1.1 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 28 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: {"reboot": {"type": "HARD"}} Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: exception: Cannot 'reboot' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '104aafde-b4b1-48c3-8268-e82a786c1945', 'body': {'reboot': {'type': 'HARD'}}} Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:55:17.592412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 409 to user: Cannot 'reboot' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3df86a7-ac10-4723-b488-7022feb25ab6 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action" status: 409 len: 145 microversion: 2.1 time: 0.107448 Aug 25 12:55:17.606245 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1483/2884] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:17 2022] POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:55:17.616689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:17.618268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:17.635845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.637890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.638657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:17.640223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:17.641622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:17.642478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:18.755069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:18.784594 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-228aa542-49f6-4244-8e1b-7ab002ec3817 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1325 microversion: 2.1 time: 1.481768 Aug 25 12:55:18.786647 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1402/2885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:17 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1325 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:18.840522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de10e4ed-cbc9-42dd-ab1f-008225eb7811", "name": "network-vif-plugged", "status": "completed", "tag": "f3743538-56b9-4952-ad48-f44fc5878662"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:18.876990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:18.878511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:18.879964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:18.902386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:18.945688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7333dc1e-2292-4f1d-a3bc-1846c1d8154b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1308 microversion: 2.1 time: 1.340550 Aug 25 12:55:18.951752 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1484/2886] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:17 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1308 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:18.955789 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] Creating event network-vif-plugged:f3743538-56b9-4952-ad48-f44fc5878662 for instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 on n-h1-850468-18 Aug 25 12:55:18.969643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-deleted", "tag": "f7963a7b-7a3d-40a4-af83-c475625d89d9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:18.975706 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f73fd0fb-1372-42da-9d2d-727d736117bc req-f8497008-db70-42a1-9227-68b67cebc78f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182062 Aug 25 12:55:18.986553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1403/2887] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:19.002649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.003739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.004377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:19.010350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:19.016953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:19.048237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.049599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.050621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:19.052325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.053513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.057287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:19.064919 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] Creating event network-vif-deleted:f7963a7b-7a3d-40a4-af83-c475625d89d9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:19.080877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ae15f9f2-1faf-49b7-9356-8868bcb304d3 req-6dd1a4a0-8878-44a5-a7f4-4fcc9e1f35f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126605 Aug 25 12:55:19.093906 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1485/2888] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:19.116980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:19.118490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:19.143379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.145390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.149349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:19.162550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:19.164023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:19.166072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.023355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:20.055145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:20.058730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:20.062122 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed2b4613-cb84-41ab-a9e7-f70e020afc8d tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2706 microversion: 2.32 time: 1.071100 Aug 25 12:55:20.064214 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1404/2889] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:18 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2706 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:20.077490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:20.084657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:20.099376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:20.100213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:20.116020 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9936b185-e574-43bc-ac39-c98a83900863 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1507 microversion: 2.1 time: 1.017169 Aug 25 12:55:20.119339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:20.134280 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1486/2890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:19 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1507 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:20.153313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.153313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.153761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.155056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.156355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.160016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.169806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:20.171583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:20.199630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.201393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.202685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.205901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.207418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.209042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.304804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Cannot 'rebuild' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action HTTP/1.1 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 65 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'rebuild' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '104aafde-b4b1-48c3-8268-e82a786c1945', 'body': {'rebuild': {'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5'}}} Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:20.309004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:20.327549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 409 to user: Cannot 'rebuild' instance 104aafde-b4b1-48c3-8268-e82a786c1945 while it is in vm_state rescued {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:20.332061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e303224-8240-4787-99ae-71a9b43da9ba tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action" status: 409 len: 146 microversion: 2.1 time: 0.255303 Aug 25 12:55:20.335223 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1405/2891] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:20 2022] POST /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945/action => generated 146 bytes in 268 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:55:20.348082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:20.349986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:20.365671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.367084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.368278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:20.370110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:20.373045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:20.374319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:21.601335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:21.618155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:21.619082 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b44694c5-08cf-4ece-b9b4-3f9b6614f7b9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 1.481413 Aug 25 12:55:21.622568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1487/2892] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:20 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:21.633900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:21.635374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:21.648207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:21.648921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:21.649915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:21.651275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:21.652064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:21.653441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:21.667619 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6aa09e07-7dd0-4b6a-aead-36002985f822 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1655 microversion: 2.1 time: 1.331677 Aug 25 12:55:21.673790 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1406/2893] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:20 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1655 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:21.683283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:21.685221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:21.705559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:21.706919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:21.707666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:21.709139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:21.711169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:21.712574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.144923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:23.168584 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79a7a688-f87a-4428-8ee8-52eadface25c tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1523 microversion: 2.1 time: 1.543161 Aug 25 12:55:23.170442 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1488/2894] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:21 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1523 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:23.181689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:23.183627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:23.200591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.202032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.210575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.212414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.213990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.215791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.233506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:23.263270 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f19ca6a-2a06-4300-8cae-ae18e101368c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1489 microversion: 2.1 time: 1.587086 Aug 25 12:55:23.274778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1407/2895] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:21 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1489 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:23.290078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c6375b-030f-4c2f-8a26-79c4f77ba192", "name": "network-vif-plugged", "status": "completed", "tag": "c98e23dd-e986-420e-9817-6f7be2812234"}, {"server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "name": "network-vif-unplugged", "status": "completed", "tag": "93115bdd-4065-4aae-af25-3524f76ce265"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:23.330479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:55:23.383643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.386718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.386718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.449590 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Creating event network-vif-plugged:c98e23dd-e986-420e-9817-6f7be2812234 for instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 on n-h1-850468-18 Aug 25 12:55:23.459289 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] Creating event network-vif-unplugged:93115bdd-4065-4aae-af25-3524f76ce265 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:55:23.481542 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0500e675-3c19-465b-9079-f84d03daa639 req-436bbd3c-d5b1-4b0a-a71f-39d08bb951ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.204452 Aug 25 12:55:23.482711 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1408/2896] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:23.504011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:23.512628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:23.548057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.549203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.550116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.552406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.565256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.566534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.670158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:23.699636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d9d2565-d493-4001-a655-0aceb412e87c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 204 len: 0 microversion: 2.1 time: 0.525085 Aug 25 12:55:23.708169 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1489/2897] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:23 2022] DELETE /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:55:23.731039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:23.735370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:23.756767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.762918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.766293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:23.768580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:23.769560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:23.770682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:24.580287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:24.650350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:24.710611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:24.727242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:24.730747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33b37b72-0186-4387-ad88-e69409c0d47e tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2545 microversion: 2.32 time: 1.241896 Aug 25 12:55:24.735615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1409/2898] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:23 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2545 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:24.769292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "name": "network-vif-deleted", "tag": "b4f21784-7a97-4b3d-bc0f-2c0e889914b1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:24.808289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:24.809347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:24.810263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:24.822239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:24.840635 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] Creating event network-vif-deleted:b4f21784-7a97-4b3d-bc0f-2c0e889914b1 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:55:24.850198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bf956555-175a-4c39-aaf8-5e6832fc329e req-a94e96b9-3e9b-4194-b76a-c1907176cbce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110806 Aug 25 12:55:24.851431 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1410/2899] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:24.866907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:24.869031 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90918690-b0eb-48dc-ace9-aac992e60cb0 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1507 microversion: 2.1 time: 1.156276 Aug 25 12:55:24.869695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1490/2900] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:23 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1507 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:24.870254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:24.884927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:24.886541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:24.887880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:24.889579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:24.891299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:24.892501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:24.900640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:24.902023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:24.927980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:24.933425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:24.935976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:24.940687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:24.943510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:24.954333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.201145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:25.224643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-239d8275-73be-46fb-890c-527368aa2af1 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1613 microversion: 2.1 time: 0.352233 Aug 25 12:55:25.226227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1491/2901] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:24 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1613 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:25.283197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:25.289109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:25.313501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.314866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.319210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.321594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.322954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.324191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.410586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:55:25.566900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:25.586076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7818d28f-797f-4c09-bc64-ff767603c445 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1312 microversion: 2.1 time: 0.731577 Aug 25 12:55:25.588337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1411/2902] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:24 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1312 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:25.618868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:25.620145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:25.629950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-deee808d-456a-4eaf-b826-f9176fe4cd02 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 204 len: 0 microversion: 2.1 time: 0.400451 Aug 25 12:55:25.635310 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1492/2903] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:25 2022] DELETE /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:55:25.641845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-715429907", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:25.649338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.650368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.652521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.655068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:25.659079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:25.661791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:25.794280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:55:26.179941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:26.194171 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f9e788c-4c52-4093-98b1-33f58d272e4e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1689 microversion: 2.1 time: 0.603975 Aug 25 12:55:26.195049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1412/2904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:25 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1689 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:26.202927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:26.205123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:26.217691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.219444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.221491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.223270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.224097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.225194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.592445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:26.611156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3e5c540-b01b-4333-aa58-1185eb6ca2f4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1529 microversion: 2.1 time: 0.413700 Aug 25 12:55:26.612942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1413/2905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:26 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1529 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:26.626486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:26.628155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:26.648675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.649784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.650624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:26.651946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:26.652903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:26.653673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.543094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.583769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.588417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:27.591771 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73dc5881-4971-45af-8ab6-7b3a24e0ec80 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 2498 microversion: 2.32 time: 0.976136 Aug 25 12:55:27.612284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1414/2906] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:26 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 2498 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:27.627398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:27.630800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:27.652910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.655407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.655836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.659403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.660694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.662047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.867270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:55:27.868437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:55:27.869493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:55:27.871650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:55:27.873447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:55:27.894698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.895615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.897258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.898637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:27.899493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:27.900287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:27.941684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:55:27.955296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:55:28.000870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:55:28.005877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:55:28.131617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a93d7305-414b-413b-9c2f-3315988cc86f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498443 Aug 25 12:55:28.133973 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1493/2907] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:55:28.145017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:28.146836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:28.173216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.174735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.186455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.190703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.191970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.193556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.315499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.322994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.326061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.329442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lazy-loading 'fault' on Instance uuid dfdb4df5-a95f-4c67-a87f-3260b04a3d8e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:55:28.624558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe40285fc75459f9d8549db4f166b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd445c58c0b544a480e2aa0c5afd1cf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:28.660413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-430f7925-669f-4fe7-bef6-5cb07754ac88 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 200 len: 1459 microversion: 2.1 time: 0.524064 Aug 25 12:55:28.662931 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1494/2908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:28 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 1459 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:28.705428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:28.708634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:28.730254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.731075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.732186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:28.733960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:28.737865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:28.738775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:29.050887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:29.077544 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-928d31fd-927f-40be-a44d-d3fd5f8cdec7 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1511 microversion: 2.1 time: 1.462844 Aug 25 12:55:29.080791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1415/2909] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:27 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1511 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:29.090784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-deleted", "tag": "866fcb99-5974-4d0f-84c9-547637dd0877"}, {"server_uuid": "dfdb4df5-a95f-4c67-a87f-3260b04a3d8e", "name": "network-vif-deleted", "tag": "93115bdd-4065-4aae-af25-3524f76ce265"}, {"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-deleted", "tag": "3bf0bb65-2dd9-487c-b142-b393435c60b9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:29.123484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:29.125075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:29.126359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:29.590267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Creating event network-vif-deleted:866fcb99-5974-4d0f-84c9-547637dd0877 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:29.591362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Creating event network-vif-deleted:93115bdd-4065-4aae-af25-3524f76ce265 for instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e on n-h1-850468-18 Aug 25 12:55:29.592438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] Creating event network-vif-deleted:3bf0bb65-2dd9-487c-b142-b393435c60b9 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:29.610074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1c67112e-bc17-431b-a9a0-e255b3c2f5bd req-f4f7aabc-cd3a-4834-b37e-48c90367d606 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.526535 Aug 25 12:55:29.611282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1416/2910] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:29.623043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:29.625974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:29.640172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:29.643369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:29.645036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:29.647490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:29.649229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:29.651864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.049375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:30.065881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-549c4af9-232a-4bd2-be57-0526393d3176 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1462 microversion: 2.1 time: 1.397771 Aug 25 12:55:30.067588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1495/2911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:28 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1462 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:30.091125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:30.093360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:30.115623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.116773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.118610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.121521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.122624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.123961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.874359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:30.900802 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10b87078-da83-49ad-bd1c-ce7e26ae1435 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1689 microversion: 2.1 time: 1.286964 Aug 25 12:55:30.916657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1417/2912] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:29 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1689 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:30.942221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:30.943608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:30.956498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.957708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.958952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:30.960523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:30.961609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:30.962708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.311777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.337401 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c14a043a-359f-4878-a8cf-f6fdafcc2acf tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1266 microversion: 2.1 time: 0.417433 Aug 25 12:55:31.338493 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1418/2913] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:30 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:31.373714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:31.375320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:31.395444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.397396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.398461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.400615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.402502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.404004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.559889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.577536 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-37128a0d-3129-4ae0-a85c-48656c0e84a4 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1529 microversion: 2.1 time: 1.507700 Aug 25 12:55:31.580172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1496/2914] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:30 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1529 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:31.601040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:31.611951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.613309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.servers [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Removing options 'limit' from query {{(pid=122701) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 12:55:31.615174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:31.617557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.618820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.619903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.621665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.622880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.623937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.627972 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eda95d25-462f-4975-a9c0-824741fd8d04 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.045280 Aug 25 12:55:31.629982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1497/2915] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 25 12:55:31 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:55:31.639583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:31.642409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:31.669094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.670052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.670840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.672326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.673164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.674016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.680177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.713647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:31.714997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e HTTP/1.1 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'dfdb4df5-a95f-4c67-a87f-3260b04a3d8e'} Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:31.716883 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:31.726754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:31.727770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:31.728788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9f0ebc5-d214-4709-82e2-c681a61a4efc tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.387752 Aug 25 12:55:31.729759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:31.732044 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-633b1974-cbf0-4ea9-a8a7-1a370a8b6c25 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 404 len: 111 microversion: 2.1 time: 0.099888 Aug 25 12:55:31.739316 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1498/2916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:31 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:31.742511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1419/2917] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:31 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:31.750847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:31.755608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:31.777564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "name": "network-vif-unplugged", "status": "completed", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:31.783630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.785759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.787213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.789497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.790795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.791979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.810522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.811507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.812389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.847461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] Creating event network-vif-unplugged:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:55:31.870575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-dc74db80-50f6-4f9d-8072-1d9aa339bc10 req-4ad7f277-0ec8-49ad-9ef1-927d1572fd0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123087 Aug 25 12:55:31.874964 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1420/2918] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:31.897043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:31.899861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:31.926288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.929776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.933482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:31.935346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:31.936587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:31.940710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.208733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:32.231317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:55:32.256777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:55:32.257536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:55:32.258405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:55:32.259501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:55:32.260642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:55:32.575662 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ef78a7f-5d05-4819-81d5-75225397d66b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192/action" status: 202 len: 0 microversion: 2.1 time: 0.833323 Aug 25 12:55:32.592871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1499/2919] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:55:31 2022] POST /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:32.631124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933a95df-0075-40d3-a47a-513ac45d4aa6", "name": "network-vif-deleted", "tag": "94d3aef5-5dce-46b9-bfd1-288869dbf5e0"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:32.671657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.672667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.673776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.731509 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] Creating event network-vif-deleted:94d3aef5-5dce-46b9-bfd1-288869dbf5e0 for instance 933a95df-0075-40d3-a47a-513ac45d4aa6 on n-h2-850468-18 Aug 25 12:55:32.755813 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3ab820b5-6634-4a69-a1e7-2362f6c1dd7b req-14ae3e25-dac3-4ad4-842d-d522b4859317 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134877 Aug 25 12:55:32.757561 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1500/2920] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:32.780108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:32.782380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:32.819028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.822987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.825484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.832581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:32.836383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:32.851419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:32.971017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:33.219631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:33.274913 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1718a35d-9688-4e7d-a12d-2535d7003941 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1511 microversion: 2.1 time: 1.396531 Aug 25 12:55:33.301453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1421/2921] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:31 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1511 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:33.329139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:33.334783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:33.370668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.371817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.378472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:33.379891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.380729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.381561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:33.689976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:33.727623 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2eba34d1-d0b3-49e3-9228-3cbed393f370 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1622 microversion: 2.1 time: 0.967531 Aug 25 12:55:33.730420 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1501/2922] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:32 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1622 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:33.753329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:33.758264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:33.773425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.774587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.776151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:33.777520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:33.778243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:33.779264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.135369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:34.172808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-90418c51-e48e-4ea8-9004-5b18de8ec67a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1266 microversion: 2.1 time: 0.864758 Aug 25 12:55:34.177453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1422/2923] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:33 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1266 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:34.200300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:34.201893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:34.237181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:34.245898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:34.253151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.254997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:34.256326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:34.259945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.435868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:34.437778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:34.439414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:34.441392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lazy-loading 'fault' on Instance uuid 730eaa8b-b270-44ea-bd56-4de7581671d1 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:55:35.013363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a26316f4ba04e8598ae218980ef72f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc6f7eecabd4ffc9752b60b91aa5a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:35.055174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-271c9335-6e92-437c-ad98-e03223c626fe tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 200 len: 1315 microversion: 2.1 time: 0.873588 Aug 25 12:55:35.063946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1423/2924] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:34 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:35.102704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:35.104894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:35.134925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.136513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.138108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.142633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:35.144230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:35.144497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:35.997314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.013108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.066820 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f88b21e-d9a2-43fa-b0a5-6b1260d21020 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1471 microversion: 2.1 time: 2.333747 Aug 25 12:55:36.072453 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1502/2925] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:33 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1471 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:36.082499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.097533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.102373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:36.104258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:36.105429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8907ce98-dcf4-4e82-a144-e7c1a82de8f4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 1.033017 Aug 25 12:55:36.109584 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1424/2926] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:35 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:36.133765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:36.147366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:36.157759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.161589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.166719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.180459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.183847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.186087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.194980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.206724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.219756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.233384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.235245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.237361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.650267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:36.687915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a5f90957-1c67-4d2e-bbe7-fee86c651b5c tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 200 len: 1622 microversion: 2.1 time: 0.571516 Aug 25 12:55:36.689550 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1425/2927] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:36 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 1622 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:36.698461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730eaa8b-b270-44ea-bd56-4de7581671d1", "name": "network-vif-deleted", "tag": "17d273b7-8827-4268-afa9-f74899d04c99"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:36.744614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.760911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.762242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.804534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] Creating event network-vif-deleted:17d273b7-8827-4268-afa9-f74899d04c99 for instance 730eaa8b-b270-44ea-bd56-4de7581671d1 on n-h1-850468-18 Aug 25 12:55:36.821794 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-cf01cf02-f3ad-4eb4-b0bf-9e999c62bfe4 req-22d8fa07-5bfd-4254-bd4d-f7a5fddb0c8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129789 Aug 25 12:55:36.828643 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1426/2928] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:36.845362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:36.857211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:36.880408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.888902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.890218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.892649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:36.895089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:36.895999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:36.989512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:37.024048 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d596fae3-cc26-407e-a5c3-211e91db2c4d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1512 microversion: 2.1 time: 0.949352 Aug 25 12:55:37.041046 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1503/2929] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:36 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1512 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:37.070900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:37.076590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 730eaa8b-b270-44ea-bd56-4de7581671d1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:37.100640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.109306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.111215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.113309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.114576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.120681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.179294 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 HTTP/1.1 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '730eaa8b-b270-44ea-bd56-4de7581671d1'} Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:37.185520 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. Aug 25 12:55:37.194904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:37.208448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 730eaa8b-b270-44ea-bd56-4de7581671d1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:37.210719 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-472e9db0-f2d0-46cf-a18d-9a4c8b2fe52b tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1" status: 404 len: 111 microversion: 2.1 time: 0.167329 Aug 25 12:55:37.217350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1504/2930] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:37 2022] GET /compute/v2.1/servers/730eaa8b-b270-44ea-bd56-4de7581671d1 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:37.227151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:37.236897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:37.252971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:37.267806 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c77f938f-444b-44c6-b341-c547a661f161 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1266 microversion: 2.1 time: 0.436517 Aug 25 12:55:37.280570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.284315 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1427/2931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:36 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1266 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:37.285864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.287044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.288748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.293830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.295036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.334716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:37.344041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:37.405306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.412707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.414326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.425381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:37.426628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:37.427748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:37.551499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:37.926018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:37.970378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:39.564344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:39.592269 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cb343a4-1dc0-4b4a-bf15-0ebb4093f8a3 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1512 microversion: 2.1 time: 2.372536 Aug 25 12:55:39.607173 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1505/2932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:37 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1512 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:39.648029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:39.650485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:39.655642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:39.694427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:39.701554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:39.702399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:39.707983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:39.713664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:39.717114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:39.717997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:39.749283 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db56fea6-0c6a-4484-9991-0c05cb8119e9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1471 microversion: 2.1 time: 2.456044 Aug 25 12:55:39.753535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1428/2933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:37 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1471 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:39.779679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-366f7966-c987-4693-b88f-0bd7b3fe7b07 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c25fec10>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:39.942907 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-366f7966-c987-4693-b88f-0bd7b3fe7b07 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Image not found. Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-366f7966-c987-4693-b88f-0bd7b3fe7b07 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e HTTP/1.1 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e'} Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e to delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e could not be found. Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:39.946962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:55:39.957020 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:39.961250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-366f7966-c987-4693-b88f-0bd7b3fe7b07 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:39.964530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-366f7966-c987-4693-b88f-0bd7b3fe7b07 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e" status: 404 len: 62 microversion: 2.1 time: 0.208169 Aug 25 12:55:39.969237 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1429/2934] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:39 2022] DELETE /compute/v2.1/images/206aaa4b-d5fa-48b4-a1af-4c1f18c2d03e => generated 62 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:55:39.985427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:39.987098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:40.001904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.003735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.005023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.007069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.008372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.010083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.044855 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e HTTP/1.1 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9ebe2ecb-f094-4493-93bb-30d4a4f3b17e'} Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:40.048171 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 404 to user: Instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:40.057355 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6c3c3a9-f886-4a5d-83d8-ef9728a22270 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e" status: 404 len: 111 microversion: 2.1 time: 0.079931 Aug 25 12:55:40.058947 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1430/2935] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:39 2022] GET /compute/v2.1/servers/9ebe2ecb-f094-4493-93bb-30d4a4f3b17e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:40.081228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:40.082685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:40.096963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.097866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.098816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.100169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.101282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.102396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.170123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:40.205616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:40.217835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:40.219592 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-611cf746-3085-4b6c-9b46-96d03f231607 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.596714 Aug 25 12:55:40.239479 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1506/2936] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:39 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:40.306719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebe2ecb-f094-4493-93bb-30d4a4f3b17e", "name": "network-vif-deleted", "tag": "9beb251e-ec76-485a-bfe1-d5739b504694"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:40.332173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:40.333638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:40.335092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:40.380467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] Creating event network-vif-deleted:9beb251e-ec76-485a-bfe1-d5739b504694 for instance 9ebe2ecb-f094-4493-93bb-30d4a4f3b17e on n-h2-850468-18 Aug 25 12:55:40.391752 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8b90048f-27c8-49c5-8a9f-c2b500b28fcf req-1e0d0173-bd6c-4293-9ba5-3e291aebefac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110156 Aug 25 12:55:40.392873 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1507/2937] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:40.407846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:40.420667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:40.422837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:41.041621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.044031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.045254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.047894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.047894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.049457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.159791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:41.184968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-207b388e-2bd0-4579-8c8c-1e46b4960e3f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 1.124000 Aug 25 12:55:41.198164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1431/2938] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:40 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:41.218191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.226568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:41.260279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.261170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.262239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.266703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.269315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.271221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.323419 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e HTTP/1.1 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'dfdb4df5-a95f-4c67-a87f-3260b04a3d8e'} Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:41.329420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2bb82d8a-61fa-4e5d-9f8a-e4b84202c560 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 404 len: 111 microversion: 2.1 time: 0.133503 Aug 25 12:55:41.343220 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1432/2939] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:41 2022] DELETE /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:41.354133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.354133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:41.371843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.373398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.377427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.381948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.383552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.384897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.386192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:41.420550 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e HTTP/1.1 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '41ebbe19-2715-4cab-815c-f179e403c17e'} Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:41.424794 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:41.433802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:41.436516 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b027e8a9-588e-4b88-8020-a8c451b4fa76 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 404 len: 111 microversion: 2.1 time: 0.097782 Aug 25 12:55:41.439619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1433/2940] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:41 2022] DELETE /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:41.459930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9ca0ca1-23ca-468b-83ee-75f9d243555d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '.version_select at 0x7fc6c26b5700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.534748 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9ca0ca1-23ca-468b-83ee-75f9d243555d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733048702" status: 202 len: 0 microversion: 2.1 time: 0.089824 Aug 25 12:55:41.536830 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1434/2941] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733048702 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:41.561096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.563118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:41.584038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.590804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.591869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.593469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.595228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.596229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.617221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f85b10a1-78a3-4794-be43-7a08fbfb3c61 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 1.220938 Aug 25 12:55:41.619694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1508/2942] 10.222.0.60 () {58 vars in 1154 bytes} [Thu Aug 25 12:55:40 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:41.632221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:41.634337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:41.667058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.668719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.675377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.678047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:41.679440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:41.680669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:41.991603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:42.024139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:42.031135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:42.035308 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe23177e-aa73-4192-b733-36784a55f508 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.412743 Aug 25 12:55:42.036940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1509/2943] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:41 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:42.049162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:42.051612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: dfdb4df5-a95f-4c67-a87f-3260b04a3d8e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:42.069344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.071132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.072504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.074487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.075916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.077194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.112275 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e HTTP/1.1 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'dfdb4df5-a95f-4c67-a87f-3260b04a3d8e'} Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.116619 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. Aug 25 12:55:42.128304 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.132883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance dfdb4df5-a95f-4c67-a87f-3260b04a3d8e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:42.134554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dae7db83-9576-4cd5-9b59-065dd62234f5 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e" status: 404 len: 111 microversion: 2.1 time: 0.094644 Aug 25 12:55:42.152491 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1510/2944] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:42 2022] GET /compute/v2.1/servers/dfdb4df5-a95f-4c67-a87f-3260b04a3d8e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:42.167096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:42.176554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 41ebbe19-2715-4cab-815c-f179e403c17e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:42.206330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.207765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.211182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.212903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.217277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.219382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.276304 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e HTTP/1.1 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '41ebbe19-2715-4cab-815c-f179e403c17e'} Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.288382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.298811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 41ebbe19-2715-4cab-815c-f179e403c17e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:42.303497 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a217574-2b6f-4cbb-8d8f-3f57a89ac1a9 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e" status: 404 len: 111 microversion: 2.1 time: 0.146844 Aug 25 12:55:42.306297 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1511/2945] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:42 2022] GET /compute/v2.1/servers/41ebbe19-2715-4cab-815c-f179e403c17e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:42.323403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:42.332497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:42.363909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.371482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.374488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.378452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.378452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.387214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.645959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:42.685763 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d2ea5a8-82ec-4b16-9996-fcd3e2a57c21 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1471 microversion: 2.1 time: 1.146909 Aug 25 12:55:42.686643 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1435/2946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:41 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1471 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:42.697140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:42.702406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:42.739543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.740809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.741864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.744628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.745858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.746945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.790693 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 HTTP/1.1 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '572ee41e-718b-49dd-9343-c24431e0e1d8'} Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:42.795508 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d064b6d5-3375-4be1-93fa-edb6d51646db tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "DELETE /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 404 len: 111 microversion: 2.1 time: 0.108377 Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1436/2947] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:42 2022] DELETE /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:42.815773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:42.826414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.827622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.829489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:42.830483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:42.831794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:42.832788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.076145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:43.104539 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee74d12d-cf3c-42da-ad16-10afeb3a9607 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1511 microversion: 2.1 time: 0.791900 Aug 25 12:55:43.112935 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1512/2948] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:42 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:43.166570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8015bec-9bdb-48d2-b188-2cc4a9c454d3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c1e16e50>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.233816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8015bec-9bdb-48d2-b188-2cc4a9c454d3 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101641616" status: 202 len: 0 microversion: 2.1 time: 0.087559 Aug 25 12:55:43.236753 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1513/2949] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 12:55:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101641616 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:55:43.248363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.251358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] [instance: 572ee41e-718b-49dd-9343-c24431e0e1d8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:43.282753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.284450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.285617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.288634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.289696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.290553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.369257 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] HTTP exception thrown: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Request method failure captured: Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 HTTP/1.1 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3A_O25qxWIhcsOFx91_tUD4oInifK2DmOqtm0Z9Y3nItLZOwzs_yBxQvK4m175SF8bhtCPvxK9ZnDJirKkLl0MNieTPKD93yc2b3OF6dxp3Dy-UFKR1OZqgeQ9MIZ2USRIITUW26V2Zlwf1hsqvdTliGrCV8CR8ZbSh_3fD8SiLTUc Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bd445c58c0b544a480e2aa0c5afd1cf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: bd445c58c0b544a480e2aa0c5afd1cf0 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestMultiNic-258617488 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6fe40285fc75459f9d8549db4f166b51 Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestMultiNic-258617488-project Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '572ee41e-718b-49dd-9343-c24431e0e1d8'} Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:43.387412 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. Aug 25 12:55:43.401752 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:43.404778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] Returning 404 to user: Instance 572ee41e-718b-49dd-9343-c24431e0e1d8 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:43.413829 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-480db026-f57e-4ed4-a173-7e20d39e6062 tempest-ServersTestMultiNic-258617488 tempest-ServersTestMultiNic-258617488-project] 10.222.0.60 "GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8" status: 404 len: 111 microversion: 2.1 time: 0.174430 Aug 25 12:55:43.415120 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1514/2950] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:43 2022] GET /compute/v2.1/servers/572ee41e-718b-49dd-9343-c24431e0e1d8 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:43.427563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.429111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:43.450937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.452161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.453511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.466497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.468448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.471233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.665218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:43.697475 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2eabe2cc-edcb-43a1-b6b6-6792d39d3411 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 0.895589 Aug 25 12:55:43.700209 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1437/2951] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:42 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:43.709230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.724471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:43.756360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.757825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.761055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.764956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:43.774041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:43.784890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:43.894503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:43.925132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:43.928099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:43.953849 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-59247197-0493-49dd-8c07-7cea15e59a06 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.534861 Aug 25 12:55:43.956069 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1515/2952] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:43 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:43.992575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:43.993834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:44.005174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:44.006073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:44.007428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:44.020709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:44.021674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:44.022523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:44.776479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:44.805391 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a11480b-0884-4885-a00a-dfa13edabbe1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1512 microversion: 2.1 time: 1.102044 Aug 25 12:55:44.817079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1438/2953] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:43 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1512 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:44.843168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b748c6-40aa-40dd-ba77-7ec6fc53c285", "tag": "107b42ec-44bf-4fc5-a6c5-ed619c6181bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:44.878221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:44.880607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:44.882363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:44.937040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] Creating event network-changed:107b42ec-44bf-4fc5-a6c5-ed619c6181bd for instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 on n-h1-850468-18 Aug 25 12:55:44.967153 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-99748118-81d9-4de6-9ccd-3dbc1054df97 req-25c2934d-ba95-43b0-b958-b9d16f9c36c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147466 Aug 25 12:55:44.971561 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1439/2954] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:44.995345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:44.996997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:44.998455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:45.023288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:45.024918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:45.025785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:45.027142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:45.028196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:45.029246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:45.038071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-051c4f0f-ad91-419a-a44e-74f3703b14ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 1.079990 Aug 25 12:55:45.040521 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1516/2955] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:43 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:45.067734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:45.070260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:45.105135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:45.106395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:45.117723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:45.119676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:45.120833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:45.121706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:46.518433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:46.554742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08c53266-33b7-46c6-9d32-b0a6e6277edd tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 1.578894 Aug 25 12:55:46.556688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1440/2956] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:44 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:46.579054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:46.585431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:46.619270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:46.620251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:46.621093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:46.622450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:46.623329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:46.624086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:46.797536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:46.829255 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a71dba7f-6205-4160-9ff9-daacd188f4ab tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1512 microversion: 2.1 time: 1.785727 Aug 25 12:55:46.833819 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1517/2957] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:45 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1512 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:46.857496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:46.864193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:46.883519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:46.884882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:46.886033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:46.887690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:46.888912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:46.889947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:46.992384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:47.041203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:47.057334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:47.059711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5605f0c0-bb46-4ef4-b5ed-d8be64d409b2 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.500564 Aug 25 12:55:47.060838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1441/2958] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:46 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:47.081844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:47.107927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:47.110575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:47.127598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:47.128541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:47.129375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:47.130802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:47.131648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:47.132457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:47.263220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:47.455742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:47.488452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:47.489367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:47.490151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.091950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.150430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3977f84f-6857-4b65-b352-e8b0585d3a59 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 1.305235 Aug 25 12:55:48.197295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1518/2959] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:46 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:48.227520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.230067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:48.244404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.246830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.249215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.251561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.252848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.254300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.306614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ac427e2-9726-4c58-94d1-be9f8f4b7a55 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.232500 Aug 25 12:55:48.308153 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1442/2960] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:55:47 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:48.329685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02d5e5f3-3f1c-4616-8f95-52ca00f07f62 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '.version_select at 0x7fc6c264a790>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.414353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-02d5e5f3-3f1c-4616-8f95-52ca00f07f62 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Image not found. Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02d5e5f3-3f1c-4616-8f95-52ca00f07f62 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/images/6948583d-a197-4bd3-ae4d-ddfe0d5700af HTTP/1.1 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: exception: Image not found. Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6948583d-a197-4bd3-ae4d-ddfe0d5700af'} Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6948583d-a197-4bd3-ae4d-ddfe0d5700af to delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6948583d-a197-4bd3-ae4d-ddfe0d5700af could not be found. Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:48.418641 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 25 12:55:48.427455 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:55:48.436612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02d5e5f3-3f1c-4616-8f95-52ca00f07f62 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Image not found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:48.450407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02d5e5f3-3f1c-4616-8f95-52ca00f07f62 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/images/6948583d-a197-4bd3-ae4d-ddfe0d5700af" status: 404 len: 62 microversion: 2.1 time: 0.139915 Aug 25 12:55:48.451880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1443/2961] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:48 2022] DELETE /compute/v2.1/images/6948583d-a197-4bd3-ae4d-ddfe0d5700af => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 12:55:48.467162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.478706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:48.491378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.492895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.494051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.495731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.497054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.498203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.809508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.835028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.849332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.858766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.862606 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6aa3ff1e-d428-4e53-ad51-ba24bfa728ef tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.407698 Aug 25 12:55:48.868663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1444/2962] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:48 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:48.876527 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa00cc0e-d3fc-461c-8287-039f0aa5de86 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 0.666826 Aug 25 12:55:48.878036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1519/2963] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:48 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:48.898317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.917361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:48.918688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:48.926686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:48.928158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:48.954299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.956357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.967151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:48.972939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:48.974674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:48.975347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.035306 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d HTTP/1.1 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d'} Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:49.043868 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.050512 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.056840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:49.065603 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b6f3468-6e09-4590-9f69-669ab06981da tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 404 len: 111 microversion: 2.1 time: 0.178326 Aug 25 12:55:49.070028 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1520/2964] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:48 2022] DELETE /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:55:49.086604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.090631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] [instance: 0ae995c7-76d8-421e-97de-2f781b807e2d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.125314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.131839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.133014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.134878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.136231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.139741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.161257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.161919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.162386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.163417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.164397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.164591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.203601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] HTTP exception thrown: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Request method failure captured: Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d HTTP/1.1 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3BPQZLTQfcjZqW_QyCKBeXWWK0MxfKe4RyeC9F69SIAHg0Yua5iYZAfrVF_fYVPW72sD7LBeVp3gfrL9fQMH6ydhyQzETTMU8tAb7Y5XV8bujlzV22BwWxKu0-UUCMFQsFZ6SdPz_vvN7hs7QSMa50_Faj0pk69e9cQaz96WIlbBwo Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0fc6f7eecabd4ffc9752b60b91aa5a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 0fc6f7eecabd4ffc9752b60b91aa5a33 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 8a26316f4ba04e8598ae218980ef72f0 Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1972121180-project Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0ae995c7-76d8-421e-97de-2f781b807e2d'} Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.216888 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. Aug 25 12:55:49.230373 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:55:49.275512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] Returning 404 to user: Instance 0ae995c7-76d8-421e-97de-2f781b807e2d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:55:49.280678 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23ac7676-c0f8-4309-9a03-4c1692089f13 tempest-ImagesOneServerNegativeTestJSON-1972121180 tempest-ImagesOneServerNegativeTestJSON-1972121180-project] 10.222.0.60 "GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d" status: 404 len: 111 microversion: 2.1 time: 0.199402 Aug 25 12:55:49.286693 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1521/2965] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/0ae995c7-76d8-421e-97de-2f781b807e2d => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 12:55:49.299088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.302157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.318777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.320441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.322260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.324083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.328968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.328968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.615731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:49.886163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3c16d27-1268-4ccc-a2b9-f1ae248f3c53 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 1.015337 Aug 25 12:55:49.892171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:49.901852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1445/2966] 10.222.0.60 () {58 vars in 1150 bytes} [Thu Aug 25 12:55:48 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:49.924427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.926510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2c3dd75-9922-4fb2-8e2d-3aa5e36f5d0f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 0.637225 Aug 25 12:55:49.927564 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1522/2967] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:49.929295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.940851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:49.944069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.945506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:49.946934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.948813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.950763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:49.952442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:49.954794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:49.996681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.006011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.007494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.009155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.010396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.011497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.157474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:50.160267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.195670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.208526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.214405 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad6c056f-5f7b-4f91-a4f0-372e2f5ae43c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.300867 Aug 25 12:55:50.221534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1446/2968] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:50.253054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:50.264186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.271668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:50.293743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.295036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.300632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.302790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.304250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.315098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.659262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:50.804095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.832844 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a25c94d-cac8-4d40-9057-85eaea4db17e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.606884 Aug 25 12:55:50.839883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13654aa9-4e70-4919-b4d5-a3d996e8148a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 0.910287 Aug 25 12:55:50.848619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1447/2969] 10.222.0.60 () {58 vars in 1212 bytes} [Thu Aug 25 12:55:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:50.852363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1523/2970] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:49 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:50.860822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:50.873454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:50.876099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:50.881355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:50.898698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.899874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.905581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.908316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:50.909690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:50.910719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:50.975719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:50.984248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:51.001918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.008907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.016205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:51.018209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.019609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.020934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:51.179130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:51.202578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:51.646996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e019086-8f4f-4aca-8d13-3377301ac81b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.795688 Aug 25 12:55:51.660227 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1448/2971] 10.222.0.60 () {58 vars in 1196 bytes} [Thu Aug 25 12:55:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:51.679091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:51.683819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:51.711356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.714006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.717295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:51.724480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:51.725280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:51.728794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:52.237880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:52.245573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:52.321724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:52.325084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:52.332928 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f5545f39-6a35-425f-82d2-a1d03a89f429 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.675887 Aug 25 12:55:52.334398 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1449/2972] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:51 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:52.348962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:52.379661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:52.383763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': '-398308874', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:52.406078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:52.407152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:52.408251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:52.409802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:52.410680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:52.413235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:52.864106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:53.154930 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e336463f-1712-42e2-afac-b423205bef26 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-398308874" status: 200 len: 345 microversion: 2.1 time: 0.815349 Aug 25 12:55:53.164720 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1450/2973] 10.222.0.60 () {58 vars in 1156 bytes} [Thu Aug 25 12:55:52 2022] GET /compute/v2.1/servers?name=-398308874 => generated 345 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:53.188769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:53.190062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:53.213045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.213916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.214391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:53.220155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.223707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.224616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:53.660319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:53.697742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8357a21c-943b-43bc-a3ed-1d90ca2c5487 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 2.727623 Aug 25 12:55:53.701695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1524/2974] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:50 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:53.727863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:53.761952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:53.768571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:53.793135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.797850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.804072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:53.806886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:53.810078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:53.815160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.367508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:54.499421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:54.545227 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c39c9a78-1e0a-4193-aeb7-811e8a8e7340 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 1.367853 Aug 25 12:55:54.546595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1451/2975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:53 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:54.586689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:54.599449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:54.636625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.648938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.655839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.658555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.659981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.666660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.722052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8b8521f-26a8-4eaf-8ca0-e66185981c3b tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 1.014134 Aug 25 12:55:54.728179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1525/2976] 10.222.0.60 () {58 vars in 1154 bytes} [Thu Aug 25 12:55:53 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:54.769276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:54.774595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:54.827568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.845949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.847328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:54.855461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:54.856813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:54.857934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:55.427615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:55.484674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:55.492916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:55.505959 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59adf241-a8d5-4752-8323-397edff5b1f5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.942239 Aug 25 12:55:55.520385 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1452/2977] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:54 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:55.563401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:55.582298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:55.584018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-39830887', 'deleted': False, 'project_id': '1b2c96d9879849169ffd1da4664f4704'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 12:55:55.597612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:55.600828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:55.602265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:55.604137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:55.605422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:55.606525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.035126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 12:55:56.462182 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a52e7486-4018-4e8a-99e5-5f7790af6c02 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-39830887" status: 200 len: 345 microversion: 2.1 time: 0.939199 Aug 25 12:55:56.464165 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1453/2978] 10.222.0.60 () {58 vars in 1226 bytes} [Thu Aug 25 12:55:55 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-39830887 => generated 345 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:56.477472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:56.493768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:56.527618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.529771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.531428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.534142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.539499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.551981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.659044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:56.704500 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38b34619-abcc-4b6e-b394-bb9084abbf13 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 1.955108 Aug 25 12:55:56.706107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1526/2979] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:54 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:56.737008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b748c6-40aa-40dd-ba77-7ec6fc53c285", "name": "network-vif-plugged", "status": "completed", "tag": "107b42ec-44bf-4fc5-a6c5-ed619c6181bd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:55:56.771909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.779676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.780847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.823461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] Creating event network-vif-plugged:107b42ec-44bf-4fc5-a6c5-ed619c6181bd for instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 on n-h1-850468-18 Aug 25 12:55:56.839924 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4d5738aa-4ce3-4d9d-9b4e-fef1ec65f123 req-83391f24-bc61-4725-b811-f9ac17b05c81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129239 Aug 25 12:55:56.845006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1527/2980] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:55:56.870323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:56.871494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:56.893391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.894621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.895298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:56.897120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:56.898140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:56.899017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:57.067530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:55:57.440502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:55:57.571101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f63400b-ad7a-4d11-b70c-c37f3e55bd27 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 204 len: 0 microversion: 2.1 time: 0.723401 Aug 25 12:55:57.579455 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1528/2981] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:55:56 2022] DELETE /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:55:58.881734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:58.896496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:58.907635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:58.920724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:58.927916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:58.933080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:58.934657 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd5520c4-8721-4222-9500-68c42bfe77ec tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1308 microversion: 2.1 time: 2.467973 Aug 25 12:55:58.934896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:58.935679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:58.940932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:58.944093 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1454/2982] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:56 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1308 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:55:58.966764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:58.967546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:58.996027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.005632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.006842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:59.011802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.014638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.018221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:59.260748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:59.337359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:59.345700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:55:59.365325 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09d1066c-ca2c-4d46-b62c-232b8e5d8ecf tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 1.774871 Aug 25 12:55:59.369762 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1529/2983] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:55:57 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:55:59.382428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:55:59.383730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:55:59.441635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.442501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.443301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:55:59.444985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:55:59.445836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:55:59.449726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:01.159119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:01.222277 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-388394e4-5403-4cb1-a6e5-ddcd1dd6b736 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1518 microversion: 2.1 time: 2.275495 Aug 25 12:56:01.228650 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1455/2984] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:58 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1518 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:01.249080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:01.251453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:01.280548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:01.282980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:01.284163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:01.285977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:01.287409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:01.288486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:01.798883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:01.863773 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6dc271a5-f1c9-4603-9863-0c16f76ac969 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 2.487002 Aug 25 12:56:01.869190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1530/2985] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:55:59 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:01.909157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:01.913973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:01.981298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:01.981298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:01.984525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:01.992781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.005208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.007524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.419167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:02.438348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:02.449686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:02.460819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:02.463439 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db9c9334-fe15-4751-ab14-0b53a5e267b4 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.584393 Aug 25 12:56:02.468673 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1531/2986] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:01 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:02.482848 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bdcc72b3-69a4-40c0-9e0a-383269caea8d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1489 microversion: 2.1 time: 1.249501 Aug 25 12:56:02.490151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:02.493662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:02.496706 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1456/2987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:01 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1489 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:02.525966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:02.526967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:02.535656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.554242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.555443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.556579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.558157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.563088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.565232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.566281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.577312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:02.580567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:02.585627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:02.587031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:03.594625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:03.623296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e6e1a6f-d387-44f1-9e92-5c7f420339a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1489 microversion: 2.1 time: 1.103242 Aug 25 12:56:03.641273 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1457/2988] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:02 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1489 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:03.674425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:03.675588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:03.718124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:03.720178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:03.720975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:03.722380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:03.723456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:03.737799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:03.958115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:04.849295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:04.898666 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-593216a8-ad86-438a-8b7c-299bbf21379e tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 200 len: 1518 microversion: 2.1 time: 2.425276 Aug 25 12:56:04.917312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1532/2989] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:02 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 1518 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:04.941486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:04.942946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:04.956889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.959278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.961398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:04.963081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:04.964281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:04.965401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:05.069981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:05.556718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:05.574469 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02b23107-cf0d-4283-b429-d0a6425f0705 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 204 len: 0 microversion: 2.1 time: 0.652771 Aug 25 12:56:05.581976 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1533/2990] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:04 2022] DELETE /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:05.602647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ddbdf34-03dd-47ec-969f-4b0297e3083e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1476 microversion: 2.1 time: 1.952377 Aug 25 12:56:05.606510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:05.616239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:05.617555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1458/2991] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:03 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1476 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:05.651009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:05.657541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:05.661837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:05.666999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:05.667667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:05.672347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:05.676282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:05.677701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:05.709781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:05.715944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:05.720403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:05.725017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:05.730405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:05.735349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:05.738476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:06.852334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:06.920738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:06.932504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:06.939672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3cb445f-251d-43b7-a740-cfa98dbf4486 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 1.351571 Aug 25 12:56:06.943570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1534/2992] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:05 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:06.998067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07a043-d36c-4e43-9fb0-4e67c7d64913", "name": "network-vif-deleted", "tag": "576388b3-cfdc-4309-818f-1e216045e4ab"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:07.046324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:07.055264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:07.060107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:07.143828 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] Creating event network-vif-deleted:576388b3-cfdc-4309-818f-1e216045e4ab for instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 on n-h1-850468-18 Aug 25 12:56:07.195871 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2d0e0420-c505-4e28-95c2-3eca69ab1714 req-94dfb1af-ff79-4d9f-81af-75817f28a461 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234406 Aug 25 12:56:07.201628 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1535/2993] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:07.224819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:07.226819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:07.250375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:07.254607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:07.257900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:07.262160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:07.267322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:07.273856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:07.922967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:07.958101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae80db32-bb35-4e95-bf17-881f25def5a6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1489 microversion: 2.1 time: 2.335914 Aug 25 12:56:07.975915 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1459/2994] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:05 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1489 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:08.013270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:08.026421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: ce07a043-d36c-4e43-9fb0-4e67c7d64913] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:08.059139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.060543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.061450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.062939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.064423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.065586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.146519 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] HTTP exception thrown: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Request method failure captured: Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 HTTP/1.1 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3DZ71r143b7EK5Mcr5_OPa31_POZ_PU9nXMlMKFrJ8bCDVwDJiiILrRtj2NpT9_pZh83oMCNRa1Tpz18Z9JMtfDD0LBTWvsAY88obl4g_ynVgI6D0A_xyfInDXayCPODfSYMaENfm6aIRICuh_9vEkPGD2C7lVLj-s2tgezxlAQ4vM Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 375f73ecadcd45aab0148803e57c19b6 Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ce07a043-d36c-4e43-9fb0-4e67c7d64913'} Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:08.161459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Returning 404 to user: Instance ce07a043-d36c-4e43-9fb0-4e67c7d64913 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c797f576-0eb5-4ad7-9ed0-b047db262ae1 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913" status: 404 len: 111 microversion: 2.1 time: 0.186257 Aug 25 12:56:08.176082 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1460/2995] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:07 2022] GET /compute/v2.1/servers/ce07a043-d36c-4e43-9fb0-4e67c7d64913 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:08.192476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:08.193809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:08.220101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.220777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.221618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.222984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.223893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.236040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.723527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:08.770560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6ae61e3-7142-4b28-af68-16cba2b7d6b8 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1508 microversion: 2.1 time: 1.560644 Aug 25 12:56:08.775187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1536/2996] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:07 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1508 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:08.794798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:08.801281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:08.830026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.832667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.834290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:08.836038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:08.837548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:08.838261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:09.721198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:09.757055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:09.848706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:09.854848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:09.872952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8be309a3-a931-42a3-8333-bf7d56af0b89 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 1.094806 Aug 25 12:56:09.896452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1537/2997] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:08 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:09.918525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:09.923058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:09.967056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:10.004288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.005328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.008084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.011210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.016197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.020324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.270803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:10.403501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:10.440193 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c16c057f-7102-4ba8-9a2f-2a445b3de097 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1475 microversion: 2.1 time: 2.267333 Aug 25 12:56:10.459180 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1461/2998] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:08 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1475 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:10.507924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:10.513034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:10.540390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.545204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.545955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.550244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.553570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.557237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.739702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43d7fbd8-eb72-47f2-8618-a2ff8d75ec5a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 204 len: 0 microversion: 2.1 time: 0.851308 Aug 25 12:56:10.742167 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1538/2999] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:09 2022] DELETE /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:10.758201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:10.784889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:10.786318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:10.848967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.851295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.854495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:10.860062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:10.861224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:10.862064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.019960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.028303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.029847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.032774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lazy-loading 'fault' on Instance uuid 104aafde-b4b1-48c3-8268-e82a786c1945 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:56:11.075434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-660139c1-7f82-4597-aac1-dde9ca37e639 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 204 len: 0 microversion: 2.1 time: 0.585618 Aug 25 12:56:11.086812 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1462/3000] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:10 2022] DELETE /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:11.118825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c6375b-030f-4c2f-8a26-79c4f77ba192", "name": "network-vif-unplugged", "status": "completed", "tag": "c98e23dd-e986-420e-9817-6f7be2812234"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:11.145248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.146093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.147518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.183985 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Creating event network-vif-unplugged:c98e23dd-e986-420e-9817-6f7be2812234 for instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 on n-h1-850468-18 Aug 25 12:56:11.199577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:56:11.231147 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2fc9fd8e-f112-4050-82b1-e628fd927622 req-e3ff275f-9ba7-4d1c-a1af-3808f3d48c39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145265 Aug 25 12:56:11.233351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1463/3001] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:11.256185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104aafde-b4b1-48c3-8268-e82a786c1945", "name": "network-vif-deleted", "tag": "aeb71a72-9b5b-4f57-86bd-6acd4434b688"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:11.309790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.313042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.314727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.323883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:11.379999 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa7ef74f-09c3-41f2-8540-b1068875de2d tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 200 len: 1311 microversion: 2.1 time: 0.626420 Aug 25 12:56:11.398971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1539/3002] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:10 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 1311 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:11.424915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] Creating event network-vif-deleted:aeb71a72-9b5b-4f57-86bd-6acd4434b688 for instance 104aafde-b4b1-48c3-8268-e82a786c1945 on n-h2-850468-18 Aug 25 12:56:11.440468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-fbddfd09-4473-4cc7-9440-99e59b65ffaf req-bef24c60-5d21-43ec-afaa-915533edda15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203692 Aug 25 12:56:11.444021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1464/3003] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:11.454044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:11.456728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:11.463005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:11.469955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:11.485398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.489910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.489910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.489910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.489910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.489910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.545622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.552190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.556894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.559733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:11.561611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:11.575311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:11.961796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:11.973459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:12.036367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:12.039589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:12.052490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7099c2d0-1ced-43d5-9b47-85ab8245793c tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.595138 Aug 25 12:56:12.054094 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1465/3004] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:11 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:12.065197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:12.073529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:12.125462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.127192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.161232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.172409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.173890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.178288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.549884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:12.584192 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b214dd1-f251-4e4b-9dc5-d19487c79055 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1495 microversion: 2.1 time: 1.168134 Aug 25 12:56:12.601449 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1540/3005] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:11 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1495 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:12.633888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:12.636865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:12.681027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.688099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.689265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.690705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:12.691661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:12.695114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:12.855109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:12.933073 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db1f7070-3e5b-4f4b-839b-b0a5e59591f5 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1518 microversion: 2.1 time: 0.864012 Aug 25 12:56:12.934980 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1466/3006] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:12 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1518 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:12.967712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:12.970887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: 104aafde-b4b1-48c3-8268-e82a786c1945] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:13.001009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.006513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.014629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.020274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.021826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.025116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.097786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 HTTP/1.1 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '104aafde-b4b1-48c3-8268-e82a786c1945'} Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:13.105771 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:13.114356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 404 to user: Instance 104aafde-b4b1-48c3-8268-e82a786c1945 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:13.115426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e46c3afb-895c-430f-bd26-f53a3e695b27 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945" status: 404 len: 111 microversion: 2.1 time: 0.177935 Aug 25 12:56:13.125212 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1467/3007] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:12 2022] GET /compute/v2.1/servers/104aafde-b4b1-48c3-8268-e82a786c1945 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:13.148893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:13.150902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:13.180623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.184158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.187690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.191621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.192873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.198193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.478507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:13.517992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:13.540735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:13.556088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71e86fd4-8986-4b4d-ad2b-0c196eeb2822 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 0.423952 Aug 25 12:56:13.557818 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1468/3008] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:13 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:13.571372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:13.583674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:13.611803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.617453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.619157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.625527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:13.628062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:13.632310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:13.770257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:14.041576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:14.097192 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca88fe6c-586e-4e91-b1cc-4c99811f1174 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1473 microversion: 2.1 time: 1.475800 Aug 25 12:56:14.100366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1541/3009] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:12 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1473 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:14.141512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:14.142815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:14.160896 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0f07ac4-4b40-43f4-bd14-2c51d1e80940 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "DELETE /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 204 len: 0 microversion: 2.1 time: 0.599464 Aug 25 12:56:14.170710 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1469/3010] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:13 2022] DELETE /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:14.183215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:14.183727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:14.184210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:14.197130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:14.197717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:14.201561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:14.203246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:14.204449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:14.237604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:14.238588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:14.243813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:14.251392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:14.255119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:14.260399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:15.272943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:15.318133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-559fd70d-432c-4f2f-9808-df50db3b57f6 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1518 microversion: 2.1 time: 1.126980 Aug 25 12:56:15.321336 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1470/3011] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:14 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1518 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:15.341222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:15.345188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:15.371966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:15.373614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:15.377931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:15.380743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:15.384743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:15.386841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:15.440852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:15.490037 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01adfe5e-24f3-4292-802e-121cbaee62b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1495 microversion: 2.1 time: 1.383158 Aug 25 12:56:15.492095 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1542/3012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:14 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1495 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:15.517791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:15.530331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:15.573152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:15.574163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:15.578519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:15.584682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:15.587021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:15.589513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:16.848275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:16.894831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:16.908201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:16.911460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a9358b2-11f4-4cd2-bddd-f23914b3a4c3 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1604 microversion: 2.32 time: 1.417286 Aug 25 12:56:16.937815 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1543/3013] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:15 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1604 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:16.959285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:16.968108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:16.993713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:16.994635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:16.995475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:16.997286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:16.998181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:16.999001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:17.518843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:17.545330 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-921a84b0-3900-4af8-8519-b45f8ce29762 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 2.221227 Aug 25 12:56:17.556823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1471/3014] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:15 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:17.566334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:17.567378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:17.614843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:17.617198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:17.618296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:17.622430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:17.623349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:17.630514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.229537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:18.251350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0005536-9527-4d1d-93fd-414b29831202 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1473 microversion: 2.1 time: 1.309907 Aug 25 12:56:18.252670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1544/3015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:16 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1473 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:18.266546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:18.268379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:18.281457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.282847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.285566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.288947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.290166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.291247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.728167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:18.776407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af23f92f-c876-4b3e-8c93-b16b4370dbf4 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1518 microversion: 2.1 time: 1.217492 Aug 25 12:56:18.777470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1472/3016] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:17 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1518 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:18.788830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:18.790454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:18.815343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.816293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.817104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:18.818394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:18.819256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:18.820049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:19.084641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:19.085517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:19.089213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:19.091424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lazy-loading 'fault' on Instance uuid 933a95df-0075-40d3-a47a-513ac45d4aa6 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:56:19.178851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:19.227256 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f000efb5-17ed-46e2-9e7e-1ed41834bd8a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1495 microversion: 2.1 time: 0.968249 Aug 25 12:56:19.231545 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1545/3017] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:18 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1495 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:19.267717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:19.268982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:19.294719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:19.296180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:19.298043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:19.299760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:19.301021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:19.302211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:19.503785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:19.550957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:19.559610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c773e3e9245464488269535790003b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e3ca8e316045648a29e1afb1b5669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:19.568971 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df05978d-3944-477c-a45b-dc110438c4d5 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 200 len: 1371 microversion: 2.32 time: 0.789051 Aug 25 12:56:19.571274 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1473/3018] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:18 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 1371 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:56:19.601323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:19.603382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:19.645560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:19.647250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:19.648911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:19.650840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:19.655543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:19.661031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:20.722631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:20.747359 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2553aa52-9a1d-4c15-95d0-712750849602 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1522 microversion: 2.1 time: 1.509248 Aug 25 12:56:20.754431 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1546/3019] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:19 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1522 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:20.775615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b748c6-40aa-40dd-ba77-7ec6fc53c285", "name": "network-vif-unplugged", "status": "completed", "tag": "107b42ec-44bf-4fc5-a6c5-ed619c6181bd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:20.830684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:20.831707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:20.832704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:20.865465 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] Creating event network-vif-unplugged:107b42ec-44bf-4fc5-a6c5-ed619c6181bd for instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 on n-h1-850468-18 Aug 25 12:56:20.879611 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1eb29e04-4639-4fa2-9f0a-145b1d4ba10a req-c8c3fc62-87ed-4d28-a1d9-b8b60b04bba0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115271 Aug 25 12:56:20.882959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1547/3020] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:20.902078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:20.907410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:20.929788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:20.935381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:20.938040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:20.944198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:20.945758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:20.947664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.409199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:21.447119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0affe3c2-f587-494f-bd19-d65b794f3df0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1470 microversion: 2.1 time: 1.873226 Aug 25 12:56:21.458194 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1474/3021] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:19 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1470 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:21.482116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:21.485777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:21.509949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:21.536675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.538389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.539323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.541904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.542867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.543996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.907386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:21.934287 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cbeb1edc-d885-41df-98f7-05b572b5329a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 200 len: 1453 microversion: 2.1 time: 0.471165 Aug 25 12:56:21.939786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1475/3022] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:21 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 1453 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:21.962414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:21.964209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:21.989522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.991046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:21.992430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:21.994229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:21.996550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.005765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.068459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] HTTP exception thrown: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Request method failure captured: Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 HTTP/1.1 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB27dLiF71HgAbsF2zioKW1ln4WjXKJcYlJ93-_FdG1L27uxBilVWldow36trYsFxkIdTYnoKPnRMQS2jUuwuItk7w7nm2ZRCaj6OnFohfgiXFJT7drpz8a5NCAj2zu3G8ty6pP5dRQzD1jCUsYCkvoOtdqu9hAy4Q4TUpEA3ey7Ugx0 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9c773e3e9245464488269535790003b2 Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '933a95df-0075-40d3-a47a-513ac45d4aa6'} Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:22.072005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Returning 404 to user: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa706e51-58ad-4ac8-b4a9-1322de0115b6 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 404 len: 111 microversion: 2.32 time: 0.132536 Aug 25 12:56:22.091996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1476/3023] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:21 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:56:22.101319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:22.105469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b748c6-40aa-40dd-ba77-7ec6fc53c285", "name": "network-vif-deleted", "tag": "107b42ec-44bf-4fc5-a6c5-ed619c6181bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:22.150070 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68956f0d-bc40-4fa9-9c45-47956e527599 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1518 microversion: 2.1 time: 1.257489 Aug 25 12:56:22.151192 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1548/3024] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:20 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1518 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:22.155074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.158829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.159770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.183525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:22.188027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:22.214688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.215634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.225895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.231408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.232282 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] Creating event network-vif-deleted:107b42ec-44bf-4fc5-a6c5-ed619c6181bd for instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 on n-h1-850468-18 Aug 25 12:56:22.244384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.245478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.257568 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-65181d92-f4b6-46d3-b133-f4daa4d125fd req-38ebb10c-0e75-4c0a-90b1-694b44e45e19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165169 Aug 25 12:56:22.259043 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1477/3025] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:22.281461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:22.286486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:22.317768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.326421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.327587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.330027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.331199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.336629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.564880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00f4af77-b5d1-4acf-b466-65283bd5f7a0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192/action" status: 204 len: 0 microversion: 2.1 time: 0.400204 Aug 25 12:56:22.566472 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1549/3026] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:56:22 2022] POST /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192/action => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:22.594369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5ff8ef7-2e81-4fb3-894e-0b0a147fe383 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '.version_select at 0x7fc6c27cbdc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:22.661559 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5ff8ef7-2e81-4fb3-894e-0b0a147fe383 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306692658" status: 204 len: 0 microversion: 2.32 time: 0.091035 Aug 25 12:56:22.664537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1550/3027] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 12:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306692658 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:56:22.677105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8f122f-9542-433c-898e-9c3bbe30f239", "name": "network-vif-deleted", "tag": "23042e68-a62f-41db-bd12-f525141a612e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:22.707783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.710850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.711745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.747304 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] Creating event network-vif-deleted:23042e68-a62f-41db-bd12-f525141a612e for instance be8f122f-9542-433c-898e-9c3bbe30f239 on n-h1-850468-18 Aug 25 12:56:22.773153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7e4a97a9-8af6-4acd-932e-7f3032ace63a req-bff52f9c-98ba-4c8c-84eb-5d4652e3242e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102652 Aug 25 12:56:22.775542 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1551/3028] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:22.796956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:22.802479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:22.824606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.826526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.829170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:22.835128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:22.836598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:22.837853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.442298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3566ed81b8cd452f8e1427269170f661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70e6ee291dd4ae9bf42d43caa89f82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:23.469974 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f71fcf94-8d2f-469e-bc6d-b8c9a1e4c6e0 tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 200 len: 1480 microversion: 2.1 time: 1.208206 Aug 25 12:56:23.487250 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1478/3029] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:22 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 1480 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:23.488447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:23.490184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:23.531219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:23.532635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:23.535023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.541939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:23.544687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:23.546475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.592133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 HTTP/1.1 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '13b748c6-40aa-40dd-ba77-7ec6fc53c285'} Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:23.623054 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7aef2643-c8d4-4c91-a395-4787a34e44d6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 404 len: 111 microversion: 2.1 time: 0.153823 Aug 25 12:56:23.638880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1479/3030] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:23 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:23.653475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c6375b-030f-4c2f-8a26-79c4f77ba192", "name": "network-vif-plugged", "status": "completed", "tag": "c98e23dd-e986-420e-9817-6f7be2812234"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:23.684720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:23.685646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:23.686490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.759219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Creating event network-vif-plugged:c98e23dd-e986-420e-9817-6f7be2812234 for instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 on n-h1-850468-18 Aug 25 12:56:23.790400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:56:23.823432 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7d10bfef-bb72-40f3-8a0f-b66da9f1de65 req-21cc02a4-be2c-4179-b8fc-757e2e841caf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177744 Aug 25 12:56:23.825399 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1480/3031] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:23.839102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:23.840960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:23.877371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:23.878188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:23.883343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:23.890405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:23.891663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:23.894035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.238690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:24.240014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:24.267581 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84e0dde3-4863-463b-a10d-95031dc1a978 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1476 microversion: 2.1 time: 0.438613 Aug 25 12:56:24.269801 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1481/3032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:23 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:24.282854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e05e0cc-7d8f-4ebf-9c76-5b7267699b7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1470 microversion: 2.1 time: 1.502837 Aug 25 12:56:24.288950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1552/3033] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:22 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1470 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:24.298984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:24.300432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:24.324878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.327625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.335316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.337088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.337917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.338567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.394128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:24.416324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a87fc7e-7fe8-4ae6-ab90-340524fca4de", "name": "network-vif-deleted", "tag": "c1e8031f-5911-4fb8-8f32-5b446da1cada"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:24.464832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.466464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.467747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.508933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:24.525870 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] Creating event network-vif-deleted:c1e8031f-5911-4fb8-8f32-5b446da1cada for instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de on n-h1-850468-18 Aug 25 12:56:24.544901 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2ac9699c-7d7c-4b63-984c-d0850e56fc3b req-f6c7c641-0eb1-4286-b428-aad6d0b9d704 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129925 Aug 25 12:56:24.546141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1553/3034] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:56:24.565420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:24.566804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] [instance: be8f122f-9542-433c-898e-9c3bbe30f239] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:24.607964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.610415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.611574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.613290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.614545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.615695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.625270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:24.663004 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] HTTP exception thrown: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Request method failure captured: Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 HTTP/1.1 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB2_DtGrrvoGv_Kw8ToddVPFB5vArNE8953m8sX8OlhAfOqUCEPUkbI2UBY-uvlBfAGERk_9csP3lexrY4invqCrp6nL9PBAdu1uEfngobIuQrzXpU9y37taFMzUvztpCEBS_r7E8PKwCiwoqkkjP2X6asOrsdNDIIu7VPlWVuAV9_KA Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e70e6ee291dd4ae9bf42d43caa89f82b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e70e6ee291dd4ae9bf42d43caa89f82b Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606009277 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3566ed81b8cd452f8e1427269170f661 Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606009277-project Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'be8f122f-9542-433c-898e-9c3bbe30f239'} Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:24.667057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] Returning 404 to user: Instance be8f122f-9542-433c-898e-9c3bbe30f239 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:24.675963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af392e14-fe36-46b1-b18f-86cb83979b5e tempest-ServerRescueNegativeTestJSON-606009277 tempest-ServerRescueNegativeTestJSON-606009277-project] 10.222.0.60 "GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239" status: 404 len: 111 microversion: 2.1 time: 0.121902 Aug 25 12:56:24.678697 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1554/3035] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:24 2022] GET /compute/v2.1/servers/be8f122f-9542-433c-898e-9c3bbe30f239 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:24.702989 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51e1aae9-0a6d-4612-bb3e-22f05aa58bf8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 204 len: 0 microversion: 2.1 time: 0.429996 Aug 25 12:56:24.709207 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1482/3036] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:24 2022] DELETE /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:24.730701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:24.731947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:24.764326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.769127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.771378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:24.773828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:24.775834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:24.778081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.329784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:25.331449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:25.368719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:25.376615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:25.377632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.379035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:25.379924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:25.380783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.498059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:25.502176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:25.504720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.506369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lazy-loading 'fault' on Instance uuid 5a87fc7e-7fe8-4ae6-ab90-340524fca4de {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:56:25.526618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:25.560201 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6738b755-1498-4b96-b7d0-ebfbe5393ec3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1495 microversion: 2.1 time: 0.833247 Aug 25 12:56:25.561293 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1555/3037] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:24 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1495 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:25.574446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:25.581859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:25.604034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:25.604957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:25.610342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.622052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:25.622957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:25.623622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:25.713865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:25.756051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1c157665-f76d-4362-9909-fa0098898977 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 200 len: 1310 microversion: 2.1 time: 0.451255 Aug 25 12:56:25.757482 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1483/3038] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:25 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 1310 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:26.277462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:26.320042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1783b284-a8fa-43c5-b37a-9d5b28aee039 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1470 microversion: 2.1 time: 0.750764 Aug 25 12:56:26.321955 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1556/3039] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:25 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1470 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:26.608075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:26.610668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:26.642569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.657369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.658141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.659682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.661069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.662214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.801953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:26.804237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: 5a87fc7e-7fe8-4ae6-ab90-340524fca4de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:26.827849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.829008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.829844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.831191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.845574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.846849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.901311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] HTTP exception thrown: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Request method failure captured: Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de HTTP/1.1 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3DZ71r143b7EK5Mcr5_OPa31_POZ_PU9nXMlMKFrJ8bCDVwDJiiILrRtj2NpT9_pZh83oMCNRa1Tpz18Z9JMtfDD0LBTWvsAY88obl4g_ynVgI6D0A_xyfInDXayCPODfSYMaENfm6aIRICuh_9vEkPGD2C7lVLj-s2tgezxlAQ4vM Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 375f73ecadcd45aab0148803e57c19b6 Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5a87fc7e-7fe8-4ae6-ab90-340524fca4de'} Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:26.904683 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. Aug 25 12:56:26.922865 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:26.924906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Returning 404 to user: Instance 5a87fc7e-7fe8-4ae6-ab90-340524fca4de could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:26.927467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-152ea5dc-9a75-4870-b7b0-d8d9bd6d78c2 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de" status: 404 len: 111 microversion: 2.1 time: 0.133995 Aug 25 12:56:26.929998 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1557/3040] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:26 2022] GET /compute/v2.1/servers/5a87fc7e-7fe8-4ae6-ab90-340524fca4de => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:26.945912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:26.957409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:26.984017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.985685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.987014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:26.988980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:26.990378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:26.991622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:27.108301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:56:27.407499 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9dd8499c-d0a1-4fb2-8087-daba8fbd020d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 204 len: 0 microversion: 2.1 time: 0.469166 Aug 25 12:56:27.410322 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1558/3041] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:56:26 2022] DELETE /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:56:27.442574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:27.447039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:27.489512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:27.492603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:27.497261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:27.504800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:27.510123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:27.511455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:28.183307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:28.227168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ff98651-9623-4342-85b8-79c2ff899cc9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1495 microversion: 2.1 time: 1.625953 Aug 25 12:56:28.252564 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1484/3042] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:26 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1495 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:28.296977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:28.298127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:28.336359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:28.338003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:28.340919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:28.347529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:28.348536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:28.349369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:28.623125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:28.649990 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9511cdb-2b4e-4370-a149-8bb1e860643e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1470 microversion: 2.1 time: 1.236619 Aug 25 12:56:28.665176 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1559/3043] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:27 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1470 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:29.275735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:29.277776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:29.311437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:29.313173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:29.313982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:29.315294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:29.316174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:29.335290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:30.027834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:30.066267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0274908e-d718-43d4-8791-f4c8a3a740a9 tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1517 microversion: 2.1 time: 1.802127 Aug 25 12:56:30.072955 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1485/3044] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:28 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1517 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:30.094580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:30.096486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:30.129458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:30.134956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:30.142248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:30.143887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:30.145066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:30.146162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:31.919142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:32.005298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45d3fcb4-19a4-4b2f-bb03-0026f4154202 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1495 microversion: 2.1 time: 2.712831 Aug 25 12:56:32.040475 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1560/3045] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:29 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1495 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:32.076918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:32.080347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:32.104298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.109925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.115701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.117408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:32.122613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:32.122613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:32.292939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:32.371901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca39589d-4486-4924-88c7-0ebd628488fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1470 microversion: 2.1 time: 2.291992 Aug 25 12:56:32.381515 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1486/3046] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:30 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1470 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:33.083414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:33.084367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:33.105897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:33.107320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:33.108565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:33.110295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:33.111710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:33.112794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:33.740662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:33.777957 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7574945b-b9fb-4278-a82b-65d168151d2d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 200 len: 1453 microversion: 2.1 time: 0.721632 Aug 25 12:56:33.778962 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1487/3047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:33 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 1453 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:33.807120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de10e4ed-cbc9-42dd-ab1f-008225eb7811", "name": "network-vif-deleted", "tag": "f3743538-56b9-4952-ad48-f44fc5878662"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:33.866887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:33.882511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:33.888730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:33.933304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] Creating event network-vif-deleted:f3743538-56b9-4952-ad48-f44fc5878662 for instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 on n-h1-850468-18 Aug 25 12:56:33.946812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4bd75984-7df8-4be2-9550-a317fa1503a1 req-a120f0b8-df6e-4f8d-955d-6955bd0b3dd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164862 Aug 25 12:56:33.948545 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1488/3048] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:33.961393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:33.964497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:33.985717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:33.986643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:33.987459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:33.990032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:33.991436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:33.992489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.058604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:34.109938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38f3a692-c185-4049-b58d-509f46f1d07f tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1517 microversion: 2.1 time: 2.062286 Aug 25 12:56:34.161922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1561/3049] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:32 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1517 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:34.838268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:34.845902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:34.892500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.893447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.894315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.895738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:34.896718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:34.897574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:34.959943 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 HTTP/1.1 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'de10e4ed-cbc9-42dd-ab1f-008225eb7811'} Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:34.967714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 12:56:34.977065 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:34.984727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:34.991005 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54df8fe9-a229-47a1-a075-89855d17e047 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 404 len: 111 microversion: 2.1 time: 0.164818 Aug 25 12:56:34.998377 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1562/3050] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:34 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:35.185647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:35.190477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:35.224973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:35.226119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:35.227103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:35.229226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:35.230469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:35.231718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:35.642066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:35.690143 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be20fb07-76d9-47c2-a70e-89fc5bf6dd57 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1462 microversion: 2.1 time: 1.731838 Aug 25 12:56:35.692374 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1489/3051] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:33 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1462 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:35.714592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-658082653", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:35.770969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f73ecadcd45aab0148803e57c19b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c96d9879849169ffd1da4664f4704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:35.817981 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf8badcd-b040-4388-b8ee-40e5fdecce0d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 200 len: 1475 microversion: 2.1 time: 0.639608 Aug 25 12:56:35.826224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1563/3052] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:35 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 1475 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:35.845001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:35.846211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:35.872554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:35.874658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:35.876199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:35.877854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:35.880316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:35.885660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:35.948654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:56:37.210607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:37.270711 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b439f0cf-e267-4b80-9c23-fabc4cb90d60 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1462 microversion: 2.1 time: 1.439389 Aug 25 12:56:37.278139 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1564/3053] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:35 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1462 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:37.289939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69de9f4-523f-466e-bb09-2e3368870ef2", "name": "network-vif-deleted", "tag": "f9ce3799-062a-4add-9d4d-7e21287b9735"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:37.319268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.320735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.321929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.357725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] Creating event network-vif-deleted:f9ce3799-062a-4add-9d4d-7e21287b9735 for instance a69de9f4-523f-466e-bb09-2e3368870ef2 on n-h1-850468-18 Aug 25 12:56:37.374338 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-72091917-943b-4934-a4c0-e53cf922f3af req-0705e415-5d80-45d3-9a2f-ce4c33342ae1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090530 Aug 25 12:56:37.377026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1565/3054] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:37.390354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:37.393190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] [instance: a69de9f4-523f-466e-bb09-2e3368870ef2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:37.411686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.414666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.418161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.420358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:37.425285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:37.426451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:37.474110 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] HTTP exception thrown: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Request method failure captured: Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 HTTP/1.1 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3DZ71r143b7EK5Mcr5_OPa31_POZ_PU9nXMlMKFrJ8bCDVwDJiiILrRtj2NpT9_pZh83oMCNRa1Tpz18Z9JMtfDD0LBTWvsAY88obl4g_ynVgI6D0A_xyfInDXayCPODfSYMaENfm6aIRICuh_9vEkPGD2C7lVLj-s2tgezxlAQ4vM Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1b2c96d9879849169ffd1da4664f4704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 1b2c96d9879849169ffd1da4664f4704 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1315363060 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 375f73ecadcd45aab0148803e57c19b6 Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListServerFiltersTestJSON-1315363060-project Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'a69de9f4-523f-466e-bb09-2e3368870ef2'} Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:37.483000 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] Returning 404 to user: Instance a69de9f4-523f-466e-bb09-2e3368870ef2 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-feddb2bc-a6cd-44e5-8e75-fef0609a791d tempest-ListServerFiltersTestJSON-1315363060 tempest-ListServerFiltersTestJSON-1315363060-project] 10.222.0.60 "GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2" status: 404 len: 111 microversion: 2.1 time: 0.113528 Aug 25 12:56:37.496725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1566/3055] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:37 2022] GET /compute/v2.1/servers/a69de9f4-523f-466e-bb09-2e3368870ef2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:56:37.509832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c3ea5a4-19e5-4f5f-8474-3b00637a8935 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'create', calling method: .version_select at 0x7fc6c292e1f0>, body: {"keypair": {"name": "tempest-keypair-498471445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYWyydySgP30v+kjTOKIJyDBGtJLgeXrnZ2LBr9HOcrDyWZge509xbPSBHdYy1T49ma6jnTx1ZA00GPaN+RIrXiw6n/u6zcgiSQSCpZLRgBIrRxQPmKCObLxgY3p9xcig=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:37.608311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4c3ea5a4-19e5-4f5f-8474-3b00637a8935 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:37.637587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4c3ea5a4-19e5-4f5f-8474-3b00637a8935 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:37.722886 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c3ea5a4-19e5-4f5f-8474-3b00637a8935 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.224229 Aug 25 12:56:37.725800 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1567/3056] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 12:56:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:39.759382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:56:39.760486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:56:39.761108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:56:39.761881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:56:39.762656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:56:39.824795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:39.826780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:39.828595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:39.830453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:39.833545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:39.834879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:39.910016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:39.935208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:39.990251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:56:39.995855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:56:40.225523 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d486635-1fc2-4de7-a650-3a6d39cd86e8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.529882 Aug 25 12:56:40.229315 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1490/3057] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:56:40.262356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e6ba769-af5e-4375-94df-1e773045fe00 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:40.265860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e6ba769-af5e-4375-94df-1e773045fe00 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:40.276108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:40.601085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2e6ba769-af5e-4375-94df-1e773045fe00 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:40.638771 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e6ba769-af5e-4375-94df-1e773045fe00 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1208 microversion: 2.1 time: 0.393597 Aug 25 12:56:40.645845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1568/3058] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:40 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1208 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:41.729778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-628f22e2-9167-47bb-bc92-2faa5379780e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:41.738585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-628f22e2-9167-47bb-bc92-2faa5379780e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:42.248052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-628f22e2-9167-47bb-bc92-2faa5379780e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:42.289816 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-628f22e2-9167-47bb-bc92-2faa5379780e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1208 microversion: 2.1 time: 0.571862 Aug 25 12:56:42.294649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1491/3059] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:41 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1208 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:43.337176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:43.347469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:43.396252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.398002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.402786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:43.406406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:43.409565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:43.410944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:44.365418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:44.408491 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5637394f-192b-42a4-bf2c-fdb8c2c2687b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1260 microversion: 2.1 time: 1.080195 Aug 25 12:56:44.410640 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1569/3060] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:43 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1260 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:45.459728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:45.465192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:45.514282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:45.523023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:45.525350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:45.529476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:45.531788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:45.540894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:46.373213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:46.406773 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc665815-be31-4159-93eb-d4fb4f3c7ba4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1266 microversion: 2.1 time: 0.949827 Aug 25 12:56:46.421297 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1492/3061] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:45 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1266 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:47.450942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:47.459162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:47.486505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.494885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.495835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:47.497424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:47.501072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:47.505709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:48.746212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:48.776108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-848f7b92-bdc6-4cec-a6c2-e1161afd7cb9 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1266 microversion: 2.1 time: 1.331968 Aug 25 12:56:48.779007 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1570/3062] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:47 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1266 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:49.829510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:49.829510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:49.854030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.854950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.855855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.857253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:49.867752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:49.882395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:49.885557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:50.667191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:50.742296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a0d8b7d-2e89-4b77-a953-f9348f1bf3e7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1266 microversion: 2.1 time: 0.911418 Aug 25 12:56:50.744001 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1493/3063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:49 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1266 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:51.816968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:51.821609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:51.867500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:51.889284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:51.892584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:51.895033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:51.897524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:51.899024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:51.916685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.301840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32bc094b-c97d-4dc0-8ec9-6c476197407d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '.version_select at 0x7fc6c6cc5820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:52.326536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32bc094b-c97d-4dc0-8ec9-6c476197407d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:52.327830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32bc094b-c97d-4dc0-8ec9-6c476197407d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:52.328684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32bc094b-c97d-4dc0-8ec9-6c476197407d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:52.345123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:52.380593 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32bc094b-c97d-4dc0-8ec9-6c476197407d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.092665 Aug 25 12:56:52.384765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1494/3064] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 12:56:52 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:52.432647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8243dc12-3462-4f00-9824-440f4870c849 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:52.441657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:52.490837 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8243dc12-3462-4f00-9824-440f4870c849 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.067999 Aug 25 12:56:52.495320 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1495/3065] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 12:56:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:52.537215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62b0fa6f-ad8e-4eea-b38e-6370e3dd59f1 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-999367464", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:52.605321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:52.646145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-62b0fa6f-ad8e-4eea-b38e-6370e3dd59f1 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.135394 Aug 25 12:56:52.656235 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1496/3066] 10.222.0.60 () {60 vars in 1146 bytes} [Thu Aug 25 12:56:52 2022] POST /compute/v2.1/flavors => generated 498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:56:52.669560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a696663e-b09e-4970-a0c3-c245c0320c89 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1266 microversion: 2.1 time: 0.887033 Aug 25 12:56:52.688286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1571/3067] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:51 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1266 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:52.704512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c70082a0-7124-4584-9e8b-df6a2ee8547d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:52.730514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c70082a0-7124-4584-9e8b-df6a2ee8547d tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.054470 Aug 25 12:56:52.732276 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1497/3068] 10.222.0.60 () {58 vars in 1182 bytes} [Thu Aug 25 12:56:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 12:56:53.141299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1430008568", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "4c79cf84-7318-4f91-901a-395119de6eae"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:56:53.342482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:56:53.718303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:53.721138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:53.758573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:53.759605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:53.760402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:53.761697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:53.770393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:53.772064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:55.911439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:55.918995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:55.942382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d079ff25-05ba-4055-8236-292cab9740a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 2.233255 Aug 25 12:56:55.960345 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1498/3069] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:53 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:56:55.960345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:55.960345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:55.999065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.000680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.002334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.004922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.006066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.007001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.047687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] HTTP exception thrown: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Request method failure captured: Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 HTTP/1.1 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB27dLiF71HgAbsF2zioKW1ln4WjXKJcYlJ93-_FdG1L27uxBilVWldow36trYsFxkIdTYnoKPnRMQS2jUuwuItk7w7nm2ZRCaj6OnFohfgiXFJT7drpz8a5NCAj2zu3G8ty6pP5dRQzD1jCUsYCkvoOtdqu9hAy4Q4TUpEA3ey7Ugx0 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9c773e3e9245464488269535790003b2 Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '933a95df-0075-40d3-a47a-513ac45d4aa6'} Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:56.051606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Returning 404 to user: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:56.061023 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e5aecbb-cf3e-462f-913c-a7e38fc5a876 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "DELETE /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 404 len: 111 microversion: 2.32 time: 0.112242 Aug 25 12:56:56.072079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1499/3070] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:56:55 2022] DELETE /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:56:56.086448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:56.088250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] [instance: 933a95df-0075-40d3-a47a-513ac45d4aa6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:56.103679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.104838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.105995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.108428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.108428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.110682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.153790 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] HTTP exception thrown: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Request method failure captured: Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 HTTP/1.1 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB27dLiF71HgAbsF2zioKW1ln4WjXKJcYlJ93-_FdG1L27uxBilVWldow36trYsFxkIdTYnoKPnRMQS2jUuwuItk7w7nm2ZRCaj6OnFohfgiXFJT7drpz8a5NCAj2zu3G8ty6pP5dRQzD1jCUsYCkvoOtdqu9hAy4Q4TUpEA3ey7Ugx0 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.32 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/99e3ca8e316045648a29e1afb1b5669f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 99e3ca8e316045648a29e1afb1b5669f Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1133835223 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9c773e3e9245464488269535790003b2 Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest-1133835223-project Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '933a95df-0075-40d3-a47a-513ac45d4aa6'} Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.159089 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:56:56.172769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] Returning 404 to user: Instance 933a95df-0075-40d3-a47a-513ac45d4aa6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:56:56.180800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:56:56.181656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:56:56.182241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:56:56.184022 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-488cfc4f-69cb-451f-aa35-86185cd89710 tempest-TaggedBootDevicesTest-1133835223 tempest-TaggedBootDevicesTest-1133835223-project] 10.222.0.60 "GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6" status: 404 len: 111 microversion: 2.32 time: 0.106096 Aug 25 12:56:56.186197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:56:56.189321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:56:56.201130 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1500/3071] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:56:56 2022] GET /compute/v2.1/servers/933a95df-0075-40d3-a47a-513ac45d4aa6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:56:56.243485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.244478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.245354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.246782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:56.247381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:56.248080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:56.293202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:56:56.323459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:56:56.345898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:56:56.400590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:56:56.409058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:56:56.559342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc37208e-b36b-49cc-9487-b8d075ce8bd1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.426833 Aug 25 12:56:56.562558 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1572/3072] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:56:56.583448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-260b1675-6c2f-4c82-be2f-59e49a027fc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:56.584847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-260b1675-6c2f-4c82-be2f-59e49a027fc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:57.025061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:57.026959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:57.073731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.075926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.075926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.078935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:57.079921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:57.080782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:57.797107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-260b1675-6c2f-4c82-be2f-59e49a027fc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:56:57.844434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-260b1675-6c2f-4c82-be2f-59e49a027fc1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1279 microversion: 2.1 time: 1.264549 Aug 25 12:56:57.848915 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1501/3073] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:56 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1279 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:56:58.899755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:56:58.900894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:56:58.943971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.949420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.951420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:56:58.956838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:56:58.959815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:56:58.961115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:00.114047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:00.175180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:00.229047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14390b09-2636-4ea8-a32d-a8b591e3f552 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1275 microversion: 2.1 time: 1.323389 Aug 25 12:57:00.234589 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1502/3074] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:58 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1275 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:00.240903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1d7c0e5-1bbf-43ae-bde4-e9b8cb0ca656 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 3.240397 Aug 25 12:57:00.247219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1573/3075] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:56:56 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 3251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:01.275334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:01.276546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:01.323857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:01.330554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:01.332304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:01.339484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:01.340931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:01.349780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:02.441809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:02.449335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:02.482236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:02.487485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:02.497524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:02.503682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:02.505428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:02.513163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:02.868660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:02.908691 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1f06a0d-bb83-47e7-9ef7-ac3c9212101c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1337 microversion: 2.1 time: 1.640698 Aug 25 12:57:02.948275 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1503/3076] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:01 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1337 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:02.979466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a801ba20-2b5e-4e8b-a140-fcc95e5af41f", "tag": "3f084e06-ac68-4341-bf13-05f116d37875"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:03.032796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:03.036594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:03.038152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:03.089282 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] Creating event network-changed:3f084e06-ac68-4341-bf13-05f116d37875 for instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f on n-h1-850468-18 Aug 25 12:57:03.116628 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2fc38b71-bcb6-44f8-9388-57f41324b329 req-a16d4445-546d-4bd0-859e-602121052ed5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157564 Aug 25 12:57:03.118740 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1504/3077] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:03.958630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:03.967032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:04.008344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.011151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.017219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.024477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:04.025645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:04.027814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:04.775157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:04.777078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:04.835379 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35480ee6-86ad-437c-939c-7c9e912fd5c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1337 microversion: 2.1 time: 0.890903 Aug 25 12:57:04.836541 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1505/3078] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:03 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1337 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:04.859981 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e2e283d-b5b0-454a-8c6d-56bbc0e973d0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 3.565856 Aug 25 12:57:04.861823 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1574/3079] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:01 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 3576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:05.886930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:05.892884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:05.916284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:05.918874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:05.947687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.954802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.955986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.956437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.957707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.958343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.959738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.961178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.963103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:05.969365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:05.971385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:05.972401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:06.293799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:06.373026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:06.675881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:06.707911 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a1a8567-1fc8-4274-801f-6dbb8518bae0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1337 microversion: 2.1 time: 0.821168 Aug 25 12:57:06.708746 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1506/3080] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:05 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1337 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:07.614298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1114344431", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:07.833587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] validate_networks() for [('0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:57:07.851797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:08.301940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:08.341757 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cf1d419-a023-4b7e-a26d-6140f5148a6c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 2.441809 Aug 25 12:57:08.350442 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1575/3081] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:05 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:08.400232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:08.405730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:08.444979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.448871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.453768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:08.459084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:08.461854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:08.468867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.033771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:10.084172 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d4681c4-836c-43cd-99bb-774c9adb428b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1337 microversion: 2.1 time: 1.731097 Aug 25 12:57:10.105319 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1576/3082] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:08 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1337 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:10.128848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:10.130477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:10.151580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.153480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.154582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:10.156748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:10.157887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:10.159038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:13.474979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:13.511817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9501cad-3010-440e-a4c7-420bdb4f3d05 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 3.403905 Aug 25 12:57:13.520274 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1577/3083] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:10 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 3414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:13.540071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:13.553725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:13.574798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:13.580059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:13.581923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:13.594155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:13.595894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:13.597111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:13.598480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:14.656793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:57:14.659129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:57:14.666010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:57:14.667224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:57:14.672966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:57:14.770855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:14.773464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:14.774807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:14.776694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:14.778224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:14.779336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:14.850423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:57:14.869331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for user b39d94a9d13d4b739e36f862de62d064 and project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:57:14.905989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:57:14.912472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:57:15.174094 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21c4d9a7-c8a6-4458-8e42-ede0f14c062c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.114242 Aug 25 12:57:15.193401 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1507/3084] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 8135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:57:15.233856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:15.235543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:15.262826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:15.266178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:15.269334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:15.277006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:15.281728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:15.283194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:17.225946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:17.266813 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b51e30a-fb94-4dba-bc71-2e46d06a3eee tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 3.744083 Aug 25 12:57:17.272900 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1578/3085] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:13 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 3751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:17.300790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:17.302471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:17.330797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:17.334852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:17.339664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:17.344142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:17.347434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:17.348363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:18.077346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:18.111083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:18.111948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c64be5c1-274d-4b42-a8f2-81d58a938bf4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1222 microversion: 2.1 time: 0.836619 Aug 25 12:57:18.130611 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1579/3086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:17 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1222 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:18.158855 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92e495b0-3e66-41ba-90b7-72730d4c5764 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 2.959479 Aug 25 12:57:18.162765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1508/3087] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:15 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 2969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:18.320737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:18.325937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:18.354091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:18.355551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:18.356820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:18.359226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:18.364230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:18.367850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.188151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:19.193792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:19.285839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.288305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.297807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.300294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.305112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.305903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.658934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:19.700777 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28ce300e-cb9e-4826-b338-f94e541d9b02 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1288 microversion: 2.1 time: 0.549401 Aug 25 12:57:19.702488 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1509/3088] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:19 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1288 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:19.781970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:19.791414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:19.807807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.810512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.813909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:19.815800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:19.816990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:19.820450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:20.899550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:20.951218 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-948d1058-df8f-42b6-8f35-8e7b027686fd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 2.632725 Aug 25 12:57:20.953071 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1580/3089] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:18 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:20.982787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:20.990093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:21.022098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:21.033582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:21.038694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:21.049693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:21.051337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:21.052659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:21.475673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:21.503208 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c41c56c-19db-4d00-9963-ae7eee891da2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1276 microversion: 2.1 time: 0.548175 Aug 25 12:57:21.504447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:21.508019 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1581/3090] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:20 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:21.535686 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9ba4188-0fd1-4542-bf89-bdea66ce7a1f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 1.826277 Aug 25 12:57:21.541939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1510/3091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:19 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:22.019120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:22.026179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:22.051096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:22.057478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:22.059290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:22.065058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:22.066488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:22.067918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:22.557118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:22.558441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:22.588414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:22.598803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:22.599320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:22.599784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:22.600607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:22.601133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:22.601842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:23.870429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:23.906775 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33f046a9-0601-4cbb-b798-1358c2a540de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1276 microversion: 2.1 time: 1.362051 Aug 25 12:57:23.921607 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1511/3092] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:22 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1276 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:23.947821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:23.949962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:23.956076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:23.971354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.972990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.975317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:23.977667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:23.978997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:23.981020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:24.003781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4a56011-f9a2-4ed4-9a62-634a605925ea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 2.008780 Aug 25 12:57:24.007693 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1582/3093] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:21 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:24.555762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:24.632496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:24.637451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:24.639620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:24.747290 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] Creating event network-changed:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:57:24.783154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-13e268c8-a809-40f7-a02c-410d467e1a79 req-e5748170-a4e7-4210-ba37-02140512efce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563417 Aug 25 12:57:24.789382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1583/3094] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 12:57:24.808991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:24.890439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:24.959217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:24.968538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:25.013901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.016532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.021180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.024098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.040839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.048399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.593219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:25.629734 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5cfa595f-4c44-4cdb-a291-d7c658d73b68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1276 microversion: 2.1 time: 0.684750 Aug 25 12:57:25.635985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:25.649400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1584/3095] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:24 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1276 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:25.697085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:25.699183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:25.705563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da229a66-8cf5-4c7b-856b-20a7c7371180 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 1.763829 Aug 25 12:57:25.715117 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1512/3096] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:23 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:25.746952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.751695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.752892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:25.755071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:25.760063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:25.761362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.653815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:26.658498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=74 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:26.696508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:26.705619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:26.723108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6db7ca83-780a-431d-90be-a087e43d8540 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 1.068079 Aug 25 12:57:26.724600 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1585/3097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:25 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:26.765137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:26.770496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:26.793419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.798667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.799039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.800018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.800602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.801873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.803548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.805448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:26.805635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.806383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.809011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:26.810328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:26.826083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=64 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:27.802733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:27.829227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:27.855102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22f96ef0-67fb-416c-a907-bb9c82ed835f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.164948 Aug 25 12:57:27.873318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6fcad4d6-5be8-49b7-8706-8d21228a469e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 1.115736 Aug 25 12:57:27.884659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1586/3098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:26 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:27.894589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:27.896107 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1513/3099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:26 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:27.910460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:27.935778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:27.942456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:27.943281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:27.944681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:27.955808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:27.957576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:28.879183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:28.903199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:28.904412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:28.913033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f258368-3742-49f4-9078-7a408088ce7f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 1.025118 Aug 25 12:57:28.932349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1587/3100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:27 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:28.944779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:28.946106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:28.947359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:28.951727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:28.953118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:28.962214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.412152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a801ba20-2b5e-4e8b-a140-fcc95e5af41f", "name": "network-vif-plugged", "status": "completed", "tag": "3f084e06-ac68-4341-bf13-05f116d37875"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:29.449324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.450274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.454026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.537241 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] Creating event network-vif-plugged:3f084e06-ac68-4341-bf13-05f116d37875 for instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f on n-h1-850468-18 Aug 25 12:57:29.551713 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cac716f5-8ec1-4263-afda-ca0926da13f0 req-6604f8b7-879e-493b-8c40-898f6620273f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.611686 Aug 25 12:57:29.552910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1588/3101] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:29.589727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:29.607343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:29.654623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.657321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.659937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.664431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:29.669277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:29.672152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:29.673722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:29.706291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f705df89-c14e-4439-b318-97d3e41ada3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 0.809216 Aug 25 12:57:29.724675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1514/3102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:28 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:29.997408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:30.004031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:30.027668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.033199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.034185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:30.035561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:30.036456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:30.037236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:31.585392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:31.612883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c6eef54-7cdf-4c62-9ad0-82b5034a97a4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 2.048410 Aug 25 12:57:31.614380 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1589/3103] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:29 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:31.629004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:31.646905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:31.670021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:31.681440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:31.682890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:31.684868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:31.686350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:31.687686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.074201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:32.119467 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f42c81fd-85a5-4b2f-b1e4-e55c89ff078a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 2.129144 Aug 25 12:57:32.134023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1515/3104] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:29 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:32.488476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:32.515954 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af557d03-3348-4541-8cff-9d619ae043a8 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 0.898530 Aug 25 12:57:32.548185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1590/3105] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:31 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:32.662121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:32.666645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:32.707787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.726188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.732097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:32.734058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:32.735523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:32.757684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.180079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:33.182411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:33.215571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.218480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.219761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:33.221508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:33.226645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:33.227896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:34.679835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:34.825265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c18ead6b-b98b-4525-b7bb-81657f995f99 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1308 microversion: 2.1 time: 2.160975 Aug 25 12:57:34.830023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1516/3106] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:32 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1308 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:34.884316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:34.903263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:34.946584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.947512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.948399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:34.949783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:34.950670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:34.951512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.541643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:36.599961 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0612b6df-28f2-45ae-b741-3c20e795be1b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 3.442410 Aug 25 12:57:36.604312 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1591/3107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:33 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 3447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:36.621442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:36.627657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:36.690312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.696393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.699966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:36.704324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:36.707210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:36.709951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.751137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:37.785933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:37.799460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa2780db-0bd7-4d8a-b58b-4f08081984f1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 2.961489 Aug 25 12:57:37.812488 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1517/3108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:34 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:37.830861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:37.833838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:37.852937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9dc0adc-8e3e-4519-87fa-dca58a637ff8 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1488 microversion: 2.1 time: 1.245150 Aug 25 12:57:37.867087 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1592/3109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:36 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1488 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:37.876732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.879213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.885884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.888786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.894183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.899193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.921941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:37.936884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:37.970936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.976203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.978947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:37.985397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:37.990437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:37.995009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:38.373180 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6942a79-8e9d-4851-8372-57bd50d4a265 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "PUT /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1083 microversion: 2.1 time: 0.452937 Aug 25 12:57:38.376020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1593/3110] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 12:57:37 2022] PUT /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1083 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:38.413269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:38.417041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:38.451286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:38.456218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:38.462518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:38.465090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:38.471686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:38.475025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.290033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:39.341555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76125035-07d0-4d81-be0e-f3b6e7adc3ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 1.526240 Aug 25 12:57:39.342764 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1518/3111] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:37 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:39.357218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:39.358541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:39.387227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.393303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.394441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.395725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.396588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.402764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:39.812330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:39.861353 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45dce182-4d61-4812-adf4-fe4dd5c4bdcb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1509 microversion: 2.1 time: 1.456511 Aug 25 12:57:39.905724 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1594/3112] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:38 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1509 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:39.931752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-plugged", "status": "completed", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:39.966328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:39.977958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:39.979299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.037990 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] Creating event network-vif-plugged:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:57:40.058448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0320e49a-3e22-4f23-b96e-67e8bdf49aa3 req-7729c032-0286-4e8b-b7d0-d3fc0de07c17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149666 Aug 25 12:57:40.059257 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1595/3113] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:40.077397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:40.085931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:40.126170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.127576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.128497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.129855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.130733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.131555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.604306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:40.641725 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc0dbef2-d21a-4797-a716-3b25d9d06d68 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.296762 Aug 25 12:57:40.649492 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1519/3114] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:39 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:40.671794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:40.694501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:40.712229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.714308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.715531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:40.718232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:40.720868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:40.722436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:41.973124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:42.012098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-075a782c-d353-4cb3-b605-c4fac30d2685 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 1.356093 Aug 25 12:57:42.014784 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1520/3115] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:40 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:42.047554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c746c0-9899-4852-91bf-e4dd6e85828e", "tag": "675aa903-504a-40fd-a7dd-09bfb52281b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:42.095416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.096589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.100579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.149280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] Creating event network-changed:675aa903-504a-40fd-a7dd-09bfb52281b3 for instance 85c746c0-9899-4852-91bf-e4dd6e85828e on n-h1-850468-18 Aug 25 12:57:42.177877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-454fa76c-e3d3-4262-8581-c448c4dee390 req-4e9d14cb-519e-4e01-b2d5-29d4dc636f2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142912 Aug 25 12:57:42.179998 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1521/3116] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:42.206939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:42.221085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:42.261075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.261711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.262998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.265166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.271020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.272738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.502732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:42.538631 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-294955cd-8904-4830-bd65-b8a24ea8aed4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1509 microversion: 2.1 time: 2.476856 Aug 25 12:57:42.551008 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1596/3117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:40 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1509 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:42.603626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:42.607114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:42.631679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.633209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.639518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.641466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:42.643515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:42.657640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:42.773886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:57:43.080683 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bdb711e6-b71c-4f22-90ca-0c137d43361a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 204 len: 0 microversion: 2.1 time: 0.495886 Aug 25 12:57:43.086139 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1597/3118] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:57:42 2022] DELETE /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:57:43.110771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:43.115892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:43.145801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:43.146801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:43.147647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:43.149099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:43.167278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:43.168176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:43.169278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:43.177767 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f21b69c-2946-47a0-b4d1-96c057a66506 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 0.994625 Aug 25 12:57:43.179463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1522/3119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:42 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:43.195358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:43.206292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:43.237724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:43.239324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:43.245638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:43.247912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:43.250363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:43.251600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:44.027161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:44.051087 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28745dd8-939a-4a3a-a894-0d3f03e85d11 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1379 microversion: 2.1 time: 0.963409 Aug 25 12:57:44.080210 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1598/3120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:43 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1379 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:44.108446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:44.164695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e5e5f02-6e0b-40cc-8cd7-261b98459fc2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1515 microversion: 2.1 time: 0.978708 Aug 25 12:57:44.167692 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1523/3121] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:43 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1515 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:44.233592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:44.241537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:44.252212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:44.306796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:44.307794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:44.314686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:44.317377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:44.321499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:44.324008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:44.965529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:44.987395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-55ffff72-665e-4561-a739-110ce4192a3f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 0.762900 Aug 25 12:57:44.989482 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1599/3122] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:44 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:45.099398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:45.100372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:45.145332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.146589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.147459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:45.160292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.161199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.162385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:45.214499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:45.215749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:45.261489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.262411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.263432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:45.285039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:45.285976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:45.286811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.718970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:47.791457 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00afc8f8-7a03-46bf-991f-697105027849 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1515 microversion: 2.1 time: 2.583194 Aug 25 12:57:47.799914 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1600/3123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:45 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1515 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:47.818965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:47.825063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:47.852913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:47.920907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.926217 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a7202fe-08ad-4462-ab67-f3ed41a568c7 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1527 microversion: 2.1 time: 2.837692 Aug 25 12:57:47.942896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.943444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1524/3124] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:45 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1527 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:47.954493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.956339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:47.960604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:47.963247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:47.998833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:48.004518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:48.043671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.045997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.050553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.056334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:48.058752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:48.061866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:48.094065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:49.274159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:49.339694 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8fd35f8d-f319-4dad-84a4-ffc2637b50d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.536838 Aug 25 12:57:49.359642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1601/3125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:47 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:49.388339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:49.400211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:49.431294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:49.442817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:49.443807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:49.445741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:49.447040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:49.448253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:49.677662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:49.721872 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a780695f-deb1-4e3c-9e76-11bf584a2197 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1527 microversion: 2.1 time: 1.731955 Aug 25 12:57:49.723476 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1525/3126] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:47 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1527 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:49.822370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7ef5ddf-71bd-4a5b-bc1f-142db2e18434 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:49.904240 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7ef5ddf-71bd-4a5b-bc1f-142db2e18434 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/4c79cf84-7318-4f91-901a-395119de6eae" status: 202 len: 0 microversion: 2.1 time: 0.144690 Aug 25 12:57:49.910499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1526/3127] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:57:49 2022] DELETE /compute/v2.1/flavors/4c79cf84-7318-4f91-901a-395119de6eae => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:57:49.938797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3e8709b-58a9-433c-96e0-7b57daa4ca13 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:50.028377 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3e8709b-58a9-433c-96e0-7b57daa4ca13 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101748 Aug 25 12:57:50.031247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1527/3128] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:57:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:50.082143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:50.087482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:50.107328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.110399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.113300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.115735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.117874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.119941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.331991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:50.367724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67c8eee9-fb3c-4656-b532-db6607ec0a43 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1515 microversion: 2.1 time: 1.005391 Aug 25 12:57:50.386561 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1602/3129] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:49 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1515 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:50.407949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:50.409919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:50.436903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.443058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.444784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.446663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:50.451619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:50.454023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:50.552541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:50.575832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Old instance type tempest-test_resize_flavor_-999367464, new instance type m1.heat {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 12:57:50.602126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:57:50.611759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:57:50.615214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:57:50.620379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:57:50.621488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:57:51.045568 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00ae288c-d708-4dfa-8fc3-597c3386ef94 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508/action" status: 202 len: 0 microversion: 2.1 time: 0.982040 Aug 25 12:57:51.047686 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1528/3130] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:57:50 2022] POST /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 12:57:51.074341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:51.075873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:51.097769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.100687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.102612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:51.103322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:51.105149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:51.106154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.176768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:52.204442 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0ec960c-24ba-4c71-8ac6-432b2a911f49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.809485 Aug 25 12:57:52.206133 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1603/3131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:50 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:52.216743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a801ba20-2b5e-4e8b-a140-fcc95e5af41f", "name": "network-vif-deleted", "tag": "3f084e06-ac68-4341-bf13-05f116d37875"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:52.240520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.242280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.244067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.271846 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] Creating event network-vif-deleted:3f084e06-ac68-4341-bf13-05f116d37875 for instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f on n-h1-850468-18 Aug 25 12:57:52.285451 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ca25d488-f5ed-452d-bada-7ff961325ce3 req-80e95b64-023b-4317-9346-d8cb8cf016a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076143 Aug 25 12:57:52.287943 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1604/3132] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:52.302421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:52.305294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:52.324377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.325875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.328243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.330153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.331461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.333033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.491839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:52.492670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:52.493859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:52.495056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'fault' on Instance uuid a801ba20-2b5e-4e8b-a140-fcc95e5af41f {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:57:52.690158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:52.716008 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-926be876-cbf7-44ea-9837-5374f1b16945 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1536 microversion: 2.1 time: 1.659202 Aug 25 12:57:52.718558 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1529/3133] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:51 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1536 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:52.887520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:52.935505 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95b20fd2-078a-43bd-b26f-772d2610d31c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 200 len: 1319 microversion: 2.1 time: 0.644452 Aug 25 12:57:52.939831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1605/3134] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:52 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 1319 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:53.248381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.261462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.266331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:53.307998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.314565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.314939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.316148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.317003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.322958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.763372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:53.776210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:53.850656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.853377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.854412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:53.855809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:53.856922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:53.858560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:54.918100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:54.972453 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-15058385-1bc1-4862-be37-e62571f3874a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.725313 Aug 25 12:57:54.990169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1530/3135] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:55.034582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:55.035781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:55.080240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.081242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.083876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.085366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:55.086271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:55.087075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:55.103336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:55.121995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:57:55.178513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-207cb22b-8b77-4679-ac45-c862378d5278 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1536 microversion: 2.1 time: 1.420394 Aug 25 12:57:55.182444 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1606/3136] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:53 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1536 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:57:55.192158 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f HTTP/1.1 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a801ba20-2b5e-4e8b-a140-fcc95e5af41f'} Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:57:55.200723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:57:55.210187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:57:55.218571 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-043ff3cb-f97a-42fb-94e5-054c55a70198 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 404 len: 111 microversion: 2.1 time: 0.211437 Aug 25 12:57:55.225425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1531/3137] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:54 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:57:55.756964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2015912150", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6219781b-87e0-4796-bc61-fab6fc9376d3"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:56.047812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:56.065179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:56.105174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] validate_networks() for [('6219781b-87e0-4796-bc61-fab6fc9376d3', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:57:56.113922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:56.129281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:56.133603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:56.137196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:56.142155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:56.146431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:57.423943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:57.457320 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ee5c509-ffd2-4904-99f6-8edf05df7a50 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 1.441642 Aug 25 12:57:57.458903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1532/3138] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:56 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:57.468354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:57.469556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:57.483853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:57.488062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:57.488940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:57.490321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:57.491216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:57.493060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.188753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:57:59.224903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-adc2424b-e68f-4b1e-aed9-bea5d57926ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1536 microversion: 2.1 time: 1.763287 Aug 25 12:57:59.256924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1533/3139] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:57 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1536 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:57:59.286013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c746c0-9899-4852-91bf-e4dd6e85828e", "name": "network-vif-plugged", "status": "completed", "tag": "675aa903-504a-40fd-a7dd-09bfb52281b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:57:59.470202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.474166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.474873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.504845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] Creating event network-vif-plugged:675aa903-504a-40fd-a7dd-09bfb52281b3 for instance 85c746c0-9899-4852-91bf-e4dd6e85828e on n-h1-850468-18 Aug 25 12:57:59.525923 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-487ee49f-41b6-40e0-82ea-5817299b2aef req-92611f30-5533-45b3-b37c-b431d119ae0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278849 Aug 25 12:57:59.527255 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1534/3140] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:57:59.541693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:57:59.544324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:57:59.562749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.564402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.565296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:57:59.567006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:57:59.567943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:57:59.568804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.046302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:00.053866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:00.056220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:00.061997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:00.072993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:00.105671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.108423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.109837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.120010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.121482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.123536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.202238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:00.220010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Getting quotas for user 879716a40c8f4d1b9ee3716a9f7b4048 and project 615a6fd5f398400693b7d6c5f584135a. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:00.259581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:00.305336 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-745ba0fb-f9b9-4a0d-b9d7-9725284a6ddc tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 0.775394 Aug 25 12:58:00.305646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:00.319816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:00.344942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1535/3141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:57:59 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:00.359941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.361852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.397421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.401249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.405535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.408528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:00.409693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:00.410813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:00.538549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c38ebe0-7da7-4e1c-9f4b-9ff7c0478935 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.787693 Aug 25 12:58:00.545000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1607/3142] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:00.569916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3115a63b-7adc-45ec-ad4c-c16151b7a39d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:00.574934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3115a63b-7adc-45ec-ad4c-c16151b7a39d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:00.903809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3115a63b-7adc-45ec-ad4c-c16151b7a39d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:00.958743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3115a63b-7adc-45ec-ad4c-c16151b7a39d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1209 microversion: 2.1 time: 0.401529 Aug 25 12:58:00.962148 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1608/3143] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1209 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:01.358185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:01.367792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:01.405131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.406552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.408790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.410982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:01.413879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:01.415908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:01.723166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:01.756622 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3be6496-5acb-4cf5-86fc-5ce270927dd3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1536 microversion: 2.1 time: 1.408859 Aug 25 12:58:01.789174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1536/3144] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:00 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1536 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:02.018875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c53d8b8f-779d-4248-852c-62886319112f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:02.028841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c53d8b8f-779d-4248-852c-62886319112f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:02.981561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c53d8b8f-779d-4248-852c-62886319112f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:03.053445 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c53d8b8f-779d-4248-852c-62886319112f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1209 microversion: 2.1 time: 1.046050 Aug 25 12:58:03.057714 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1537/3145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:02 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1209 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:03.617625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-697135138", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:03.892205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] validate_networks() for [('54e5edae-5404-46de-ad4a-66afd3679592', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:58:03.911394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:03.945214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e22d5f2-3e6a-45b5-a581-8c92ca448f65 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1318 microversion: 2.1 time: 2.597311 Aug 25 12:58:03.946277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1609/3146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:01 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1318 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:03.957634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:03.970038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:04.004773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.021703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.024576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:04.028234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:04.041569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:04.042890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:05.970899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:06.028228 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d36a66c7-ea01-47ca-ae65-52b3048bcba8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1541 microversion: 2.1 time: 2.060169 Aug 25 12:58:06.030354 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1610/3147] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:03 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1541 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:06.051038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:06.055711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:06.096945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:06.097814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:06.098608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:06.106116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:06.109333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:06.110114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:06.486981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:06.521926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-942812f5-ee07-453c-95bd-47e16829d0ae tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1267 microversion: 2.1 time: 0.489007 Aug 25 12:58:06.527164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1611/3148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:06 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1267 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:06.548767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:06.554158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:06.582008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:06.582939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:06.592947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:06.605219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:06.608548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:06.611261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.288524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:07.291505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:07.292994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:07.302361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:07.304843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:07.353854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.360491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.361817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.368846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.372275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.375234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.424337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Getting quotas for project db87ddade283469a8137dc3905493e94. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:07.440794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Getting quotas for user ed1af7df8d3a416e967cb6fe15210f62 and project db87ddade283469a8137dc3905493e94. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:07.478484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:07.486408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:07.615670 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4737e040-94ce-4bc3-9f38-a63656339e83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.552681 Aug 25 12:58:07.618132 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1538/3149] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:07.630676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:07.632527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:07.649723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.651771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.652969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:07.655707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:07.657163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:07.658678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:09.012549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:09.096984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-584b3ddd-bd22-4023-94da-3d1b5c1ed56f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1508 microversion: 2.1 time: 2.551800 Aug 25 12:58:09.097860 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1612/3150] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:06 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1508 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:09.138392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:09.140252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:09.203654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:09.212269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:09.213141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:09.226408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:09.227159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:09.241246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.069216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:10.095512 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79adf3ec-52b4-4c84-979a-3ebb8b26116c tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1267 microversion: 2.1 time: 0.993932 Aug 25 12:58:10.098145 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1613/3151] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:09 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1267 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:10.110633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:10.112407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:10.127982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.130172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.131556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.133908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.135190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.136888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.196044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:10.772818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:10.793416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db5ed682-89f3-49c6-9273-6c9b99805241 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1212 microversion: 2.1 time: 0.692356 Aug 25 12:58:10.804488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1614/3152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:10 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1212 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:10.821485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:10.839065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:10.850252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:10.859685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eddaa229-8056-46fa-bb18-2bec93d05034 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1541 microversion: 2.1 time: 3.238765 Aug 25 12:58:10.876895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.902240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.903517 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1539/3153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:07 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1541 bytes in 3284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:10.914426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.924100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:10.927910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:10.929277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:10.949327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:11.257398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-581200074", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "cb7c552f-5632-4263-94a0-93e0dd061ee4"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:11.591350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] validate_networks() for [('cb7c552f-5632-4263-94a0-93e0dd061ee4', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:58:12.422080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:12.450526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d31d8341-eb2a-4bf1-91e1-064570e8194b tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1508 microversion: 2.1 time: 1.638792 Aug 25 12:58:12.454580 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1615/3154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:10 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1508 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:12.506920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:12.508876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:12.522895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:12.524317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:12.527329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:12.529581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:12.531151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:12.532370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.048462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:13.081377 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-019793c8-87ec-43c2-93fc-1bbb139e1677 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1267 microversion: 2.1 time: 0.623970 Aug 25 12:58:13.100155 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1616/3155] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:12 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1267 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:13.112555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:13.112555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:13.145357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:13.149519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:13.153951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.160723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:13.162294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:13.167122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.441002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:13.471714 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc83121f-2a74-42c6-acc8-22a035349bee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1274 microversion: 2.1 time: 0.383829 Aug 25 12:58:13.485432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1617/3156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:13 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1274 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:13.494355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:13.505568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:13.523467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:13.530279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:13.531694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:13.533610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:13.534967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:13.542274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:14.594188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:14.620658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56ac6efe-7740-4b54-a241-e371cbcd2483 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1541 microversion: 2.1 time: 1.132662 Aug 25 12:58:14.621755 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1618/3157] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:13 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1541 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:14.653426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:14.659887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:14.676199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:14.680777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:14.686991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:14.688216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:14.690462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:14.691778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:14.693137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.002817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:15.017208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:15.018549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:15.019501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:15.020486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:15.107516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:15.222286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:15.243738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.247616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.257514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.259210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.260654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.261766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.338026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:15.338999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:15.341163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:15.341163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:15.342882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:15.386758 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ad22429-f036-4705-9834-9745cdca598a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "POST /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e/action" status: 202 len: 1110 microversion: 2.1 time: 0.755923 Aug 25 12:58:15.393958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.421338 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1619/3158] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:14 2022] POST /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e/action => generated 1110 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 12:58:15.441655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.048s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.442557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.444578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.451017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.452680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.457657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:15.459263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:15.486278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.487655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.497636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.500644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.501548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.502347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.537980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Getting quotas for project ca116650455a456da3186d4fb844fe6a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:15.564516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Getting quotas for user 44b032b82b6a4adabc813984d44d83de and project ca116650455a456da3186d4fb844fe6a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:15.609207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:15.614182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:15.828733 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e40d04d9-147e-49c6-b4cd-a7f244062a80 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.922198 Aug 25 12:58:15.831603 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1540/3159] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:15.890923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:15.905381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:15.948789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.950133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.957414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:15.959314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:15.969341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:15.971355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:17.914932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:17.936979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:17.977440 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-014919a5-0c4b-44c6-ba37-99d9eaf246da tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 2.524914 Aug 25 12:58:17.988915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b89dac2e-b84a-4b88-8931-d5a655bac3ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 2.145909 Aug 25 12:58:18.028391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1541/3160] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:15 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:18.039957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1620/3161] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:15 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:18.113321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:18.114587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:18.156286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:18.172633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:18.233248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:18.244332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:18.245846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:18.247781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:18.255633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:18.258275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:18.268720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:18.270298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:18.271547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:18.273365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:18.274634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:18.287667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:19.452542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:19.485540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d68fb75-7774-4ac1-b21d-1026e70cb5b5 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1540 microversion: 2.1 time: 1.423944 Aug 25 12:58:19.486719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1621/3162] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:18 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1540 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:19.509906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:19.517447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:19.540584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:19.557473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.564763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.573338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:19.580062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.582736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.589013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:19.604328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b737401f-cf31-48e9-94c1-95fb518b587f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 1.544250 Aug 25 12:58:19.613510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1542/3163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:18 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:19.639095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:19.640924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:19.677624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.680320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.685220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:19.691358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:19.697839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:19.698493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:20.024527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:20.059315 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-30b19db1-6a92-43ea-bbed-202b9ae07c17 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1287 microversion: 2.1 time: 0.561394 Aug 25 12:58:20.061030 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1622/3164] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:19 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1287 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:20.112597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:20.114642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:20.132718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:20.137560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:20.140904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:20.148302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:20.149607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:20.150795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:21.205825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:21.241359 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d712ccd-f4dc-4b02-8e9a-01eb3a13027c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.625642 Aug 25 12:58:21.249815 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1543/3165] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:19 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:21.273125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:21.274239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:21.322764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:21.323700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:21.324540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:21.326665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:21.328170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:21.331379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.376594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:22.429833 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37c0ab9a-f7bf-4f88-a7cb-d930ed13398a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1540 microversion: 2.1 time: 1.177950 Aug 25 12:58:22.432862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1544/3166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:21 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1540 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:22.456528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:22.458247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:22.484783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.488102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.491647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.496369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.499593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.506094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.578716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:22.636945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5db73d94-74ca-4d97-b661-08b47e5598b0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 2.543490 Aug 25 12:58:22.645118 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1623/3167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:20 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:22.655401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:22.667670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:22.733790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.744746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.747870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:22.752523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:22.754850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:22.757900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.145143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:23.173237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79b82b38-b003-4811-a903-8b880c849449 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1285 microversion: 2.1 time: 0.524479 Aug 25 12:58:23.174318 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1624/3168] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:22 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1285 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:23.202481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-unplugged", "status": "completed", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:23.260719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.265148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.270959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.353079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Creating event network-vif-unplugged:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:58:23.395113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:58:23.437450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-848928c2-20fb-42cd-90c3-0fbe36c280e1 req-3cc1ae73-2a58-4ecb-a144-bb73cf31d682 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.249741 Aug 25 12:58:23.444295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1625/3169] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:23.460225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:23.465909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:23.518618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.526876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.528541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.530983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.532416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.533661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.547177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:23.595434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-685ebaa1-1353-403c-be5e-dff5ade4a13e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 1.159927 Aug 25 12:58:23.596981 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1545/3170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:22 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:23.647470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:23.702404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:23.740246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.741126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.751819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.846343 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] Creating event network-changed:6b7cb724-42ee-45e9-9503-617f9e0edc50 for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 on n-h1-850468-18 Aug 25 12:58:23.864841 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-78f64cae-43e9-4805-a3d6-603802629613 req-c1bc041c-cdd7-4533-8567-6dabd00b573d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259855 Aug 25 12:58:23.873347 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1546/3171] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:23.892742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:23.894691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:23.927709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.928704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.929539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:23.940303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:23.941984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:23.943162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.228044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:24.254873 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5d0d201-3faa-4e86-afd2-bca28e6576ea tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 0.806114 Aug 25 12:58:24.266585 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1626/3172] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:23 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:24.290574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:24.292030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:24.327850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.329140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.329937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.331287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:24.332161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:24.332924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:24.903047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:24.945546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a6e6fa6-c8e1-4e6c-8756-2c4b4f0886c6 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1472 microversion: 2.1 time: 1.069734 Aug 25 12:58:24.947090 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1547/3173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:23 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1472 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:24.985572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:24.987217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:25.000816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.002276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.003009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.004355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.005197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.005955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.163662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:25.193720 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e843b100-32ec-4a7c-b359-7d0ee5148d36 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 0.918375 Aug 25 12:58:25.198693 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1627/3174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:24 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:25.231301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab365912-1c79-4919-aec0-cea6a0c602f5", "tag": "990c2134-fc66-4cc8-b850-407112ea8944"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:25.279878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.282799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.287954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.334816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] Creating event network-changed:990c2134-fc66-4cc8-b850-407112ea8944 for instance ab365912-1c79-4919-aec0-cea6a0c602f5 on n-h1-850468-18 Aug 25 12:58:25.357718 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-05e21f39-962e-4cb0-8b1c-3c0206ae22c8 req-8ed88020-4661-4735-9546-aed771874e08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151465 Aug 25 12:58:25.364815 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1628/3175] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:25.381865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:25.386538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:25.407835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.409454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.410703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.413978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.415663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.416903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.456702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:25.486896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:25.491279 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e5015ea0-db54-4e5a-969f-2569d2cb5508 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1285 microversion: 2.1 time: 0.532281 Aug 25 12:58:25.492395 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1548/3176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:24 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1285 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:25.531166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:25.532908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:25.547255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.548720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.549869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.552826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:25.554870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:25.555956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:25.608758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:26.021226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:26.043530 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8a1e21b-c4ad-4010-a114-a61e4b3b5624 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 0.675384 Aug 25 12:58:26.052170 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1629/3177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:25 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:26.073654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:26.074977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:26.099625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.106466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.108555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.109988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.110853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.115477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.501861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:26.540374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=86 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:26.555534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ddbd0d0-f13d-4819-8118-286deaf940f6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.050722 Aug 25 12:58:26.556684 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1549/3178] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:25 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:26.596042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:26.597346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:26.619976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.620557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.620963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:26.621698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:26.623920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:26.624555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.531638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:27.557079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab191023-b39e-438c-abf3-439d0ff836ce tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1472 microversion: 2.1 time: 1.501544 Aug 25 12:58:27.559299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1630/3179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:26 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1472 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:27.573454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:27.580138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:27.603508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.609068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.610823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.612966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.614722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.616661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.858465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:27.884073 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2344219c-6e06-4b04-afa0-02bd1e92f693 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.309340 Aug 25 12:58:27.906842 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1550/3180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:26 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:27.916743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:27.917788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:27.930820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.932236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.933151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:27.934509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:27.937281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:27.938281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:29.540070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:29.609541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9f589bc-a196-4739-89d9-0418d7b40441 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 2.046793 Aug 25 12:58:29.610856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1631/3181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:27 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:29.626596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:29.635317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:29.636510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:29.661350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.662983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.664331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:29.666287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.667798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.670836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:29.677575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5998ab14-0f1c-4b53-a541-d3dc212e85d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 1.757742 Aug 25 12:58:29.692159 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1551/3182] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:27 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:29.707120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:29.716751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:29.745415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.748265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.750660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:29.753578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:29.755910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:29.757829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.811330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:30.813610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:30.850767 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8647cdc8-bf1d-4a35-955e-47d3afe7de8e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.237476 Aug 25 12:58:30.853927 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1632/3183] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:29 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:30.863570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:30.865241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:30.867396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b753f802-ef5c-4df4-9a58-eb72fca2a3d9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1469 microversion: 2.1 time: 1.184833 Aug 25 12:58:30.889186 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1552/3184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:29 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1469 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:30.905743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:30.908208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:30.911066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.911749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.912581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.914141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.915323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.916453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.927717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.929060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.929889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:30.931436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:30.932320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:30.933275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.350202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:31.379390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d690c35c-2fad-4b24-b399-50e4cefcb345 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 0.523084 Aug 25 12:58:31.389004 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1633/3185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:30 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:31.398514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:31.406946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:31.420476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.422246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.423710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.425447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.426685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.427864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.431246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:31.455059 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df40ec9c-53e1-412f-8175-0b149ba2d96b tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 0.562651 Aug 25 12:58:31.470363 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1553/3186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:30 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:31.496485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:31.497501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:31.512135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.513063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.514155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.522946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.524334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.525976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.666033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.666931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.667752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.674672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:31.675610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:31.677688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:31.770537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:31.798241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:32.006739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:32.036175 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f8148bd-d1d0-4e9a-91c1-17608f005e5d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 0.643557 Aug 25 12:58:32.042051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1634/3187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:31 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:32.059495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0e383f-9e04-489f-8785-df11139f6a55", "tag": "cb876ec2-b596-42d7-832f-71d9734df153"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:32.089397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:32.090784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:32.093714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.143477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] Creating event network-changed:cb876ec2-b596-42d7-832f-71d9734df153 for instance ed0e383f-9e04-489f-8785-df11139f6a55 on n-h1-850468-18 Aug 25 12:58:32.153588 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92047d85-82d0-40c8-b226-7c9e03decb71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508/action" status: 202 len: 0 microversion: 2.1 time: 0.681169 Aug 25 12:58:32.158389 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a47f6ebb-de8e-421e-bc04-b4df2c5e4040 req-53c8e884-5bdc-46c1-8938-6890d49cee3d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113356 Aug 25 12:58:32.161613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1635/3188] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:32.164190 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1554/3189] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:58:31 2022] POST /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:58:32.180376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:32.181586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:32.195645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:32.197221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:32.197501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.198590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:32.198807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:32.199416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:32.200067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:32.200291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.227519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:32.228467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:32.229333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.230702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:32.237563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:32.240502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:32.306524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:32.909502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:32.969268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:32.971568 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0e4732b-7d44-4241-9a0e-4e970159aa1c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 0.784617 Aug 25 12:58:32.974445 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1555/3190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:32 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:58:32.986905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:32.989195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:33.003657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:33.005773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:33.007025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:33.009194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:33.010613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:33.011865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:33.040446 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cdb8adf-cc95-40a3-b1bd-997172aa59f0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 0.865837 Aug 25 12:58:33.060363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1636/3191] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:32 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:33.060363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:33.060363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:33.091101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:33.093085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:33.094483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:33.099363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:33.102952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:33.104315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.077098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:34.090712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:34.094821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42a9813a-c1d3-4261-ae73-14d14d8e0296 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 1.051365 Aug 25 12:58:34.109704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1637/3192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:33 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:34.120987 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d84f6baa-0169-4988-98c3-22f98e6725a1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.142993 Aug 25 12:58:34.132849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-plugged", "status": "completed", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:34.133511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1556/3193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:32 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:34.151876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.153426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.155364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.163654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:34.165547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:34.181626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Creating event network-vif-plugged:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:58:34.190923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.191820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.192661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.193965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.194786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.195556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.196737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:58:34.211078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-48dfa241-3f35-450d-ba57-9a9f4e6376b6 req-dbb34346-c1cf-47b4-bad5-3e6135c81dfc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099491 Aug 25 12:58:34.212877 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1638/3194] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:34.224864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:34.226928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:34.249815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.250860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.251777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:34.253599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:34.255102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:34.255843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:35.659482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:35.681437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c4c3ab2-4377-4b44-9c6b-6825a7f3f9b8 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 1.466115 Aug 25 12:58:35.683362 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1639/3195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:34 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:35.694180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:35.696072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:35.714458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:35.715549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:35.718489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:35.720176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:35.721287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:35.722245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:35.815291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:35.834588 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-549f36fc-be79-4880-bcc1-3bfee655a291 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1515 microversion: 2.1 time: 1.698851 Aug 25 12:58:35.835903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1557/3196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:34 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1515 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:35.852851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:35.854955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:35.878692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:35.879615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:35.880614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:35.882398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:35.883191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:35.884011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.108245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:37.119831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:37.129476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88a07d73-84d3-4a41-87fe-8755613bcf62 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 1.290735 Aug 25 12:58:37.131690 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1558/3197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:35 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:37.143539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:37.144861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:37.160292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8129a7f9-c38f-4fc8-9167-d3b5f326df9c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.474579 Aug 25 12:58:37.188532 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1640/3198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:35 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:37.204534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.205442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.212197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.213132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:37.214877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.217139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:37.218534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.222786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.244502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.257376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.258608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.260297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:37.261529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:37.262602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:37.947873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:37.980541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-399a8766-c29a-41dc-a0ca-044c2071d986 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 0.789396 Aug 25 12:58:37.983404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1641/3199] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:37 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:37.996622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:37.999060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:38.037782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:38.039494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:38.040823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:38.045642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:38.047423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:38.048760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:38.333929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:38.354415 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c231d013-c1bc-4986-91ad-fc36895cc3cb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.218180 Aug 25 12:58:38.360623 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1559/3200] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:37 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:38.375511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:38.377719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:38.392535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:38.394333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:38.395783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:38.401278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:38.403409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:38.405666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.305250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:39.325489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:39.336185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc049dd5-fcbd-4a3d-8fbb-74f63d6de51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 1.349801 Aug 25 12:58:39.344211 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1642/3201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:37 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:39.352279 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b089b31-1306-4976-8519-f11b69997d08 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 0.989052 Aug 25 12:58:39.364291 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1560/3202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:38 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:39.372164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:39.377781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:39.390299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:39.393204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:39.412976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.416607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.417908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.423032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.424013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.424875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.425105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.425758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.426371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:39.426586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:39.427550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:39.428528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.027457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:41.039126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:41.048422 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3735d9ba-803d-411e-80c3-a3bb1bbdd0f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.701646 Aug 25 12:58:41.054537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1643/3203] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:39 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:41.085196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:41.089093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd4dce57-ece6-4da1-b771-71fb5269d217 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 1.733591 Aug 25 12:58:41.093546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:41.108663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1561/3204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:39 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:41.125651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "name": "network-vif-plugged", "status": "completed", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:41.126432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:41.127317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:41.136502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.157272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:41.159118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:41.160565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.186323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:41.187211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:41.187991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.296884 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] Creating event network-vif-plugged:6b7cb724-42ee-45e9-9503-617f9e0edc50 for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 on n-h1-850468-18 Aug 25 12:58:41.347632 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ac01aec7-c35a-4862-97df-952662de22ba req-cbac7f25-86e0-42f8-8ddd-b1e90a00b6fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236624 Aug 25 12:58:41.363571 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1562/3205] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:41.396166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:41.397671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:41.425709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:41.426669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:41.427476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.428840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:41.429716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:41.430491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:41.736180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:42.708559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:42.734033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-05ad2b90-b2f3-426f-9daa-816aa3c4e0c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.677295 Aug 25 12:58:42.745988 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1644/3206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:41 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:42.771018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:42.772356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:42.801399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:42.808815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:42.809695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:42.810607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:42.811366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:42.812224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:43.008985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:43.040509 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19382876-5276-4fa5-b65f-e8094aee0d13 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 1.674590 Aug 25 12:58:43.056852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1563/3207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:41 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:43.070682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:43.071626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:43.094661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:43.096759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:43.096759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:43.097788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:43.099674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:43.099674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:43.126793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:44.714980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:44.751343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:44.758612 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2fe26cfc-df5e-4b81-b426-57e7e6ea5c8e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 1.996737 Aug 25 12:58:44.759869 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1645/3208] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:42 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:44.789272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:44.789272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:44.809629 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66b1abc8-038d-49dc-9c5e-65987e487086 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1316 microversion: 2.1 time: 1.749190 Aug 25 12:58:44.812791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1564/3209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:43 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1316 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:44.815840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=58 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:44.829729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:44.830612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:44.831277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:44.832529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:44.833481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:44.834215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:44.858401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c746c0-9899-4852-91bf-e4dd6e85828e", "name": "network-vif-unplugged", "status": "completed", "tag": "675aa903-504a-40fd-a7dd-09bfb52281b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:44.890435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:44.891961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:44.893265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:44.958514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] Creating event network-vif-unplugged:675aa903-504a-40fd-a7dd-09bfb52281b3 for instance 85c746c0-9899-4852-91bf-e4dd6e85828e on n-h1-850468-18 Aug 25 12:58:44.979994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a5cac12c-cd09-4b47-be72-d825793ce01b req-a670d77b-a046-416b-9f45-b650c8ce3e1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154769 Aug 25 12:58:44.981562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1565/3210] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:44.999033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:45.000515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:45.024799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.025696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.026837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:45.036835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:45.038180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:45.039395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.239326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:46.279222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0cd6529d-c069-41f4-b046-8958d10fa53b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 1.515777 Aug 25 12:58:46.281500 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1646/3211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:44 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:46.294033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:46.295760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:46.299092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:46.316819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.319738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.321765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.324754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-050bf4dc-cd1d-4258-9c95-abfa4a9877ef tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.340832 Aug 25 12:58:46.325373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:46.326972 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1566/3212] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:44 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:46.327996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:46.330210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:46.352897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Action: 'create', calling method: .version_select at 0x7fc6c6ab91f0>, body: {"keypair": {"name": "tempest-keypair-1109921807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGCMhSAb0qp2ZmZcPztG9Y7eGQ21+cklsT/CrVj7u8VEsR2iuoK1AbQU99pwRy49LLfKo1XsKoUe77SVOtXVRbzmV1nwZ0rn92GJEPWg8PFtMW8ycYi/b/u8QRqvvwnYg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:46.422216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Getting quotas for project 5a38a040c18f4ee89d29da12df9e343d. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:46.451805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Getting quotas for user be7e7d4b536247019427bbc244880e8b and project 5a38a040c18f4ee89d29da12df9e343d. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:46.502719 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 12:58:46.952529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:46.976179 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-573a292d-10c5-4eaa-8d2c-a987e4257011 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 0.691383 Aug 25 12:58:46.977695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1647/3213] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:46 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:46.989575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:46.991344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:47.006971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.009957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.011507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.013114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.014037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.014864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.522182 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 33012. Aug 25 12:58:47.569518 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e7f75bdf-553f-4eba-8c95-b7456de8b0c0 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 1.239091 Aug 25 12:58:47.589356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1567/3214] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 12:58:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1262 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 12:58:47.612466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:47.614328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:47.628919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.630662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.631736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.633712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.635086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.637319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.759654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:47.781836 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0d845397-e57a-4837-917f-b8c89b0ae298 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 0.801468 Aug 25 12:58:47.800155 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1648/3215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:46 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:47.800155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:47.800155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:47.808935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.810350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.811555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:47.813297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:47.814431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:47.815516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.402955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:48.426116 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-542cd046-1425-46c6-b02e-ffe17b326f34 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.830503 Aug 25 12:58:48.427732 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1568/3216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:48.439422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:48.444674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:48.485273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.488933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.491419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.493046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.494459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.496915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.651553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:48.699223 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-51d5af01-8d48-45f1-af0c-8911c644e576 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1468 microversion: 2.1 time: 0.912637 Aug 25 12:58:48.745548 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1649/3217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:47 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1468 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:48.770547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:48.775010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:48.799055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.801688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.803154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:48.806592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:48.808064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:48.812089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:49.784767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:49.861110 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-46892b02-31e2-4c27-9b34-e85b41c49c06 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.428811 Aug 25 12:58:49.888653 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1569/3218] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:48 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:49.909771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1532745136", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:50.074446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:50.103555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-872a0087-da28-48e3-b240-3bbcd498cee1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 1.350960 Aug 25 12:58:50.120507 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1650/3219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:48 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:50.120711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] validate_networks() for [('54e5edae-5404-46de-ad4a-66afd3679592', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:58:50.139512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:50.141871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:50.158304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:50.160212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:50.161730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:50.163746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:50.166451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:50.168797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:51.679428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:51.697628 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1cbfad2-7f6e-48eb-a868-1aad4b713a02 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 1.587895 Aug 25 12:58:51.699415 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1651/3220] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:50 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:51.709140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:51.710882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:51.725035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:51.727051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:51.729178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:51.731114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:51.732687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:51.734257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.241764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:54.272057 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5992acd8-b87c-4bcb-8f22-77df7cf06c7b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1534 microversion: 2.1 time: 2.569503 Aug 25 12:58:54.298923 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1652/3221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:51 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1534 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:54.335154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c746c0-9899-4852-91bf-e4dd6e85828e", "name": "network-vif-plugged", "status": "completed", "tag": "675aa903-504a-40fd-a7dd-09bfb52281b3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:54.368872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:54.370367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:54.371715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.400598 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] Creating event network-vif-plugged:675aa903-504a-40fd-a7dd-09bfb52281b3 for instance 85c746c0-9899-4852-91bf-e4dd6e85828e on n-h1-850468-18 Aug 25 12:58:54.417795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d649f52b-e73a-46f1-90f5-231da2154d54 req-ed31858b-211a-463d-83d3-81eeaf004a71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122524 Aug 25 12:58:54.421091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1653/3222] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:54.434643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:54.436350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:54.458954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:54.460151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:54.462354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.464796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:54.467455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:54.468411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:54.486964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:55.215784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:58:55.217754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:58:55.217754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:58:55.218582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:58:55.218965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:58:55.255999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:58:55.311221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.328201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.329400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.331190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.331786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.332656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.414706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Getting quotas for project db87ddade283469a8137dc3905493e94. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:58:55.432040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Getting quotas for user ed1af7df8d3a416e967cb6fe15210f62 and project db87ddade283469a8137dc3905493e94. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:58:55.478313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:58:55.487087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:58:55.675130 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cef5ffbc-b248-48c9-942c-dd81d7e29b63 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.799303 Aug 25 12:58:55.677320 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1570/3223] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:58:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:58:55.706120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:55.707808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:55.740980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.742684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.752635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.754481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:55.757595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:55.760741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:55.943271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:55.994824 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-564bead6-399b-42c7-9e6f-cfc9ca79b8e0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 1.569767 Aug 25 12:58:56.001715 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1654/3224] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:54 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:56.025337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:56.041817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:56.081059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:56.090549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:56.092042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:56.103041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:56.104358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:56.109528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.129439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:57.229055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74727bc1-d859-4a64-9b41-a15a23ff8a36 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 1.545971 Aug 25 12:58:57.247101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1571/3225] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:55 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:57.293197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:57.294994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:57.305782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:57.328478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.329514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.331166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.332895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.333882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.335407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.348092 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-820026b4-89a8-4a13-a626-1259e0c9b270 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 1.343920 Aug 25 12:58:57.370779 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1655/3226] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:56 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:57.414421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:57.420717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:57.438977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.448782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.450214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.453152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.459501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.460683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.708464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:57.727108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36ecbcd6-4379-44d6-bbd3-01d0f2ab359c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1221 microversion: 2.1 time: 0.352306 Aug 25 12:58:57.741857 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1656/3227] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:57 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:57.768573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab365912-1c79-4919-aec0-cea6a0c602f5", "name": "network-vif-plugged", "status": "completed", "tag": "990c2134-fc66-4cc8-b850-407112ea8944"}, {"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-unplugged", "status": "completed", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:58:57.795485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.797419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.799162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.824168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Creating event network-vif-plugged:990c2134-fc66-4cc8-b850-407112ea8944 for instance ab365912-1c79-4919-aec0-cea6a0c602f5 on n-h1-850468-18 Aug 25 12:58:57.825277 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Creating event network-vif-unplugged:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:58:57.837695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 12:58:57.852567 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-18a02814-6422-48e9-acbb-279b8a0689ca req-2bba1bcd-f358-4061-a720-6da78f9fa3ed service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.095442 Aug 25 12:58:57.853870 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1657/3228] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:58:57.863925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:57.865022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:57.878085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.879493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.880652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:57.882380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:57.883898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:57.884756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.324426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:58.347510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-373b07d4-c207-40c1-8d86-d6e7c735f733 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1534 microversion: 2.1 time: 1.096407 Aug 25 12:58:58.348784 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1572/3229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:57 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1534 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:58.360411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:58.362157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:58.391664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.392775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.394476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.396204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.397067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.397905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.546245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:58.570530 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e69d8dd3-666b-4ccf-9356-4accf89fcaa0 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 0.714242 Aug 25 12:58:58.572877 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1658/3230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:57 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:58.603779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:58.608619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:58.637436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.640225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.650147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:58.655530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:58.657451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:58.658863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.489766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:59.517580 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c6a70d5-4c26-4393-a549-55b72e3d7377 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 0.939332 Aug 25 12:58:59.520795 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1659/3231] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:58 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:59.532974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:59.534742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:59.549555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.551943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.553354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.556313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:59.557613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.558874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.560737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.597281 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c857f1c0-25e2-4dd1-a9cf-adf5ac6af7d3 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1521 microversion: 2.1 time: 1.245300 Aug 25 12:58:59.613369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1573/3232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:58 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1521 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:59.677301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:58:59.690032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:58:59.720624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.724031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.736269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.738362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:58:59.740625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:58:59.742460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:58:59.910260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:58:59.960031 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40c684b4-4dac-4173-964e-2a9422961835 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1221 microversion: 2.1 time: 0.436019 Aug 25 12:58:59.961024 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1660/3233] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:59 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1221 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:58:59.995822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:00.000984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:00.050619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:00.052102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:00.056626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:00.061458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:00.063949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:00.065249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:00.469898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:00.508450 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0542eda6-af1c-4366-9645-b31ac64fa581 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1534 microversion: 2.1 time: 0.889822 Aug 25 12:59:00.510330 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1574/3234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:59 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1534 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:00.551907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0e383f-9e04-489f-8785-df11139f6a55", "name": "network-vif-plugged", "status": "completed", "tag": "cb876ec2-b596-42d7-832f-71d9734df153"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:00.613854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:00.627869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:00.634942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:00.695034 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] Creating event network-vif-plugged:cb876ec2-b596-42d7-832f-71d9734df153 for instance ed0e383f-9e04-489f-8785-df11139f6a55 on n-h1-850468-18 Aug 25 12:59:00.711151 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-68cd55d1-cb30-4299-816c-e17f26c6d4e1 req-f777b0e3-7203-4ce9-bd78-a4ff24c8d65d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191383 Aug 25 12:59:00.717101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1575/3235] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:00.829894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:00.861061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-391feee5-e5db-4df3-9697-8680b51a29bc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1309 microversion: 2.1 time: 0.888987 Aug 25 12:59:00.875219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1661/3236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:58:59 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1309 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:00.904515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1797957033", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7dc2f117-8f84-4c6d-9ca0-5e8d76d734e9"}, {"port": "252b1902-0e99-4869-88f0-e2932be678d4", "tag": "port-1"}, {"port": "b2cb2cb6-0a37-461c-b67c-d35a7d61d27d", "tag": "port-2"}, {"uuid": "37c73c6d-fbef-4cde-8d5d-09d845737c70", "tag": "net-1"}, {"uuid": "37c73c6d-fbef-4cde-8d5d-09d845737c70"}, {"uuid": "c65f44df-2e0b-4781-93f3-414c0d3f2b8c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c65f44df-2e0b-4781-93f3-414c0d3f2b8c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "79cadff4-da68-4179-b723-ac4fdb1f7668", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8f1d1c59-ded3-42f6-8101-e6289089f450", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "908d82ec-d81c-42f2-a3b7-cd6a25de1017", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--565299661"}], "key_name": "tempest-keypair-1109921807", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:01.472258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1832530369", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "55ed0b16-6a6b-4c52-890b-8ffacd3d69e2"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:01.491872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] validate_networks() for [('7dc2f117-8f84-4c6d-9ca0-5e8d76d734e9', None, None, None, None, None), (None, None, '252b1902-0e99-4869-88f0-e2932be678d4', None, None, None), (None, None, 'b2cb2cb6-0a37-461c-b67c-d35a7d61d27d', None, None, None), ('37c73c6d-fbef-4cde-8d5d-09d845737c70', None, None, None, None, None), ('37c73c6d-fbef-4cde-8d5d-09d845737c70', None, None, None, None, None), ('c65f44df-2e0b-4781-93f3-414c0d3f2b8c', '10.2.2.100', None, None, None, None), ('c65f44df-2e0b-4781-93f3-414c0d3f2b8c', '10.2.2.200', None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:01.738588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] validate_networks() for [('55ed0b16-6a6b-4c52-890b-8ffacd3d69e2', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:03.979696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:59:03.982088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:59:03.983782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:59:03.985101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:59:03.986326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:59:04.008850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.010623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.011469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.013779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.014769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.015858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.060550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Getting quotas for project af077f69bb3d4a20aff3af35151d5e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:59:04.078984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Getting quotas for user 5e9c535c1460412aad46e766745d5f72 and project af077f69bb3d4a20aff3af35151d5e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:59:04.111540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:59:04.117708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:59:04.221826 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a03e8038-4cc8-4cdf-a2cf-368e2698bedf tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.499886 Aug 25 12:59:04.233604 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1576/3237] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 12:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:59:04.241999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:04.243756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:04.258142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.262404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.263642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.266337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.267678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.268861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.803233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:04.841951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-07037923-0899-423f-b1fd-97ad42ea2828 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1327 microversion: 2.1 time: 0.605247 Aug 25 12:59:04.846165 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1577/3238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:04 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1327 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:04.857187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:04.859361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:04.875027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.887330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.889632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:04.893913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:04.896027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:04.900770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:05.480787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:05.514926 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b44d65bd-6027-46aa-a260-087e0844f6eb tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1506 microversion: 2.1 time: 0.665968 Aug 25 12:59:05.517641 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1578/3239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:04 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:05.535961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:05.542196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:05.562773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:05.564150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:05.565202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:05.566708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:05.569604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:05.573061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:05.804857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:05.833606 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d213df36-b78b-41f8-b31e-1585bea0f522 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1269 microversion: 2.1 time: 0.312131 Aug 25 12:59:05.839352 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1579/3240] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:05 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1269 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:05.855998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:05.867568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:05.882592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:05.884978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:05.886581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:05.891545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:05.893104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:05.894250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:06.964899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:06.995832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e69c511-ad56-4c8c-ac57-633a0b9e163d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1527 microversion: 2.1 time: 1.147055 Aug 25 12:59:07.007844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1580/3241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:05 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1527 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:07.020806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:07.030966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:07.057869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.061775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.067016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:07.074358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.076297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.077509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:07.873829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:07.914590 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aec12f9a-06fc-4bba-828f-9afcc2e344f7 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1489 microversion: 2.1 time: 0.903792 Aug 25 12:59:07.915726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1581/3242] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:07 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1489 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:07.950042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:07.958789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:07.973017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.975277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.976480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:07.978494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:07.979725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:07.980947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:08.249716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:08.270213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:08.273877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:08.276637 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-65a70184-f4c0-4354-b93a-0327d8731231 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1319 microversion: 2.21 time: 0.343652 Aug 25 12:59:08.280140 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1582/3243] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:07 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:08.290196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:08.291872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:08.308469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:08.311635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:08.311635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:08.313145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:08.314121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:08.314963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.128553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:09.147912 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8429a204-5754-4630-82d8-afe607d38267 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 200 len: 1506 microversion: 2.1 time: 0.865650 Aug 25 12:59:09.157923 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1583/3244] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:08 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 1506 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:09.172421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:09.175992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:09.204617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:09.205807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:09.206600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.208006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:09.208901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:09.209977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:09.247802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:10.134511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:10.149399 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6281cfe-62b6-4c95-b36a-e0d74ad8fb39 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1527 microversion: 2.1 time: 0.988423 Aug 25 12:59:10.150496 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1584/3245] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:09 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1527 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:10.160427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-plugged", "status": "completed", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:10.179933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:10.181705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:10.182556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:10.208241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] Creating event network-vif-plugged:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 12:59:10.220637 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-029c94c3-10b5-47d4-894e-a8a8c601d6a0 req-46e37f96-da20-427d-adeb-39f24cc3998d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067554 Aug 25 12:59:10.221791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1585/3246] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:10.233777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:10.235789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:10.248672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:10.249473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:10.250703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:10.252268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:10.253145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:10.254394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:10.855857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=45 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:11.599162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:11.616397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b1612466-9a7b-4948-b3a4-5e180a33af2c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 1.392161 Aug 25 12:59:11.617992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1586/3247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:10 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:11.636634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:11.639092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:11.652620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:11.653693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:11.654419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:11.655801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:11.657125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:11.657942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.429414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:12.448037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-94def896-9cdf-405e-ba97-ec7fa6917519 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1527 microversion: 2.1 time: 0.827242 Aug 25 12:59:12.449200 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1587/3248] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:11 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1527 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:12.816337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Calling method '.version_select at 0x7fc6c6ab9d30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:12.820606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.822305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.823822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.860249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.862844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.864804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.897057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.898356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.899235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.914245 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a285e56a-d217-4526-a8a5-056e632437cf tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978 tempest-PortsAdminExtendedAttrsIpV6TestJSON-340092978-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.462669 Aug 25 12:59:12.916023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1588/3249] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 12:59:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:12.926604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2124147395"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:12.931426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:12.956331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.957224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.958601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:12.960105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:12.960835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:12.961931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.114314 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ada256d-5e21-4373-be16-b075af1dbe35 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "PUT /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1074 microversion: 2.1 time: 0.196104 Aug 25 12:59:13.115961 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1589/3250] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 12:59:12 2022] PUT /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1074 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:13.125453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:13.126725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:13.150066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.150783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.151558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.152959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.154498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.155327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.213225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:13.408438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a32d2a7-36d6-4646-b212-10341e553f85 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 204 len: 0 microversion: 2.1 time: 0.289235 Aug 25 12:59:13.417022 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1590/3251] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:13 2022] DELETE /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:13.429726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:13.431847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:13.449159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.451279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.453799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:13.455617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:13.457152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:13.459466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.037541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:14.099660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:14.471927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:14.489926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:14.493762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:14.496103 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-46a1f0ce-4b80-4919-b8e5-dad7160654f1 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 1.082306 Aug 25 12:59:14.497993 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1591/3252] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:13 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:14.503098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:59:14.505153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:59:14.506522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:59:14.506772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:14.508103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:14.512875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:59:14.514361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:59:14.519863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.520791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.521886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.524204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.525572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.526805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.555656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.557953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.559058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.564073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:14.565986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:14.568254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:14.641787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Getting quotas for project 5a38a040c18f4ee89d29da12df9e343d. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:59:14.658590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Getting quotas for user be7e7d4b536247019427bbc244880e8b and project 5a38a040c18f4ee89d29da12df9e343d. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:59:15.049170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:59:15.057719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='79cadff4-da68-4179-b723-ac4fdb1f7668',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8f1d1c59-ded3-42f6-8101-e6289089f450',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='908d82ec-d81c-42f2-a3b7-cd6a25de1017',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:59:15.170484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:15.188436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40147a8c-5efc-49fb-81c8-8f8c2db86e31 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1527 microversion: 2.1 time: 0.688407 Aug 25 12:59:15.191529 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1592/3253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:14 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1527 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:15.687445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5ca20c8-3e2c-4fb8-b56c-0479a6c3b243 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:15.697511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b5ca20c8-3e2c-4fb8-b56c-0479a6c3b243 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] HTTP exception thrown: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5ca20c8-3e2c-4fb8-b56c-0479a6c3b243 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Request method failure captured: Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/flavors/4c79cf84-7318-4f91-901a-395119de6eae HTTP/1.1 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3CdmO49FbFLDvmtkKJqZT3bAncNX9bluTmZAIKyl6d4A7X3-O-I3j5BUAsRTUYN0Kp6zTk6YmZKmHQ0hgixqV-LFw4Ls9VTE_QqqfFvxdQBmomZoVoIVdk1l3DMCslDYoVb6JF-maKkAfj7xKNglWK_xTYHhPmxCRSHxGC43I4LpKw Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 43d9c92ddaae4ef79be3aa8602b0e933 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MigrationsAdminTest-1290252318 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43d9c92ddaae4ef79be3aa8602b0e933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43d9c92ddaae4ef79be3aa8602b0e933"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d9c92ddaae4ef79be3aa8602b0e933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43d9c92ddaae4ef79be3aa8602b0e933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MigrationsAdminTest-1290252318 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 43d9c92ddaae4ef79be3aa8602b0e933 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MigrationsAdminTest-1290252318 Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MigrationsAdminTest-1290252318-project-admin Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 77f6b482b5784340b298a855a843f9ec Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MigrationsAdminTest-1290252318-project-admin Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: exception: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4c79cf84-7318-4f91-901a-395119de6eae'} Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:15.707686 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5ca20c8-3e2c-4fb8-b56c-0479a6c3b243 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Returning 404 to user: Flavor 4c79cf84-7318-4f91-901a-395119de6eae could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5ca20c8-3e2c-4fb8-b56c-0479a6c3b243 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/4c79cf84-7318-4f91-901a-395119de6eae" status: 404 len: 109 microversion: 2.1 time: 0.520312 Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1593/3254] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:15 2022] DELETE /compute/v2.1/flavors/4c79cf84-7318-4f91-901a-395119de6eae => generated 109 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:15.735828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:15.749060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:15.753780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.755220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.758997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.777285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:15.780335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:15.784405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:15.952549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=46 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:16.020783 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-598cf2f1-228e-4a20-ba77-6263d7b4395a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 15.142624 Aug 25 12:59:16.021968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1662/3255] 10.222.0.60 () {62 vars in 1189 bytes} [Thu Aug 25 12:59:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 15146 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 12:59:16.044643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:16.045763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:16.065202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:16.066109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:16.067610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:16.070183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:16.071084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:16.071939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:16.634847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:16.657428 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6de3d0c-7147-4d3e-85a1-952ca86f8ee6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.938876 Aug 25 12:59:16.658895 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1594/3256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:15 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:16.670674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1757018003", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:16.817564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] validate_networks() for [('0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:16.863378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:16.889163 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60b82dfd-26dd-4504-9948-c6b9c070c2fb tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1500 microversion: 2.1 time: 0.864430 Aug 25 12:59:16.900219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1663/3257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:16 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1500 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:17.253996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:17.256196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:17.278086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.280465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.281750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.283564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.285172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.286663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.321029 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] HTTP exception thrown: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Request method failure captured: Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 HTTP/1.1 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Hhj0sruP2HKSMrlUrIvP0KhD9VhMHGgUuR9n3wmnogZmMPnfrsFDr8ClF0Tbc_bEdmR3xEP3VGRIAlkOM6VzVO7O8X5fhte2SCgkuLnQOjd8DFelPcmQKAtMaCSjpdexHRG1wSoXv4Bs-5NLdJeIzETpDJQyRa6xq2aQZHY69fiEY Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: ae51f4169b7c43d28be4598f57818b31 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: ae51f4169b7c43d28be4598f57818b31 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2069478417-project Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6bbf4f2a759c4ffea5b9935445c1c4c3 Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417-project Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ed0e383f-9e04-489f-8785-df11139f6a55'} Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:17.330057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:17.339057 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:17.344805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Returning 404 to user: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:17.346214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-187001ff-2965-4f61-91a5-2b1c3b4811da tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 404 len: 111 microversion: 2.1 time: 0.441352 Aug 25 12:59:17.357985 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1664/3258] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:16 2022] DELETE /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 111 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:17.367831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a277d44-5bfe-4641-a508-01856d871560", "tag": "c345f056-2073-4666-bd8d-ff11aeb7ea64"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:17.394049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.395641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.397414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.424015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] Creating event network-changed:c345f056-2073-4666-bd8d-ff11aeb7ea64 for instance 6a277d44-5bfe-4641-a508-01856d871560 on n-h1-850468-18 Aug 25 12:59:17.437273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-23358b3f-dcc1-4502-84d9-c9b1fe6e8c24 req-775a3b88-21ad-475a-af34-bf4a351a4d07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076101 Aug 25 12:59:17.442127 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1665/3259] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:17.459745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:17.462893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:17.504913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.506748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.507907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:17.509713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:17.512495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:17.514011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:18.758426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:18.786376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:18.789939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:18.792756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-33fb4d08-09f1-4ef7-a9d9-3083ac7a7a4d tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 1.347604 Aug 25 12:59:18.794355 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1666/3260] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:17 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:18.806196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1554584270", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:18.937910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 12:59:19.270213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:59:19.272033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:59:19.273296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:59:19.274334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:59:19.275381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:59:19.300180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.301263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.302232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.303903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.305003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.306360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.348657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:59:19.361844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for user b39d94a9d13d4b739e36f862de62d064 and project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:59:19.390263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:59:19.395543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:59:19.481132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 12:59:19.482312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 12:59:19.483537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 12:59:19.485612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 12:59:19.486478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 12:59:19.504901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6f7f927-fbfe-4881-aa21-55adaa378706 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841652 Aug 25 12:59:19.506824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1595/3261] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:59:19.517818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.519213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.524634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:19.524969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.525726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:19.526372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.527578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.529462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.540174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:19.549443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.551079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.553771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.555526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.558131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.561007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.583186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 12:59:19.596355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Getting quotas for user e2d13befb47c4236a104a8d5feb949d8 and project 3713bafd03504284b0123f1ad434abe5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 12:59:19.633380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 12:59:19.639553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 12:59:19.729981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:19.751444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:19.755036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:19.760254 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-525fbdf9-f702-43d1-a7f7-321154d16293 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1528 microversion: 2.42 time: 0.248676 Aug 25 12:59:19.762430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1596/3262] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:19 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1528 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:19.783815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:19.785474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:19.791858 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab4dfe62-31f1-4ec9-882b-c78183d34fdb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994635 Aug 25 12:59:19.801598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.802939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.804392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.806106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.806533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1667/3263] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 12:59:19.807640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.808853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.828920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:19.830739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:19.870510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.872977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.879588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:19.880913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:19.884572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:19.886029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.330653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:20.354724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-426de26b-8a73-4e60-8c71-62fda369a78e tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1527 microversion: 2.1 time: 0.540793 Aug 25 12:59:20.355880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1668/3264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:19 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1527 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:20.401643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:20.403403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:20.417010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.418514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.420349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.422325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.423510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.424613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.507194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:20.557231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c708efa2-713e-4ecc-9639-7f18742aa166 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1500 microversion: 2.1 time: 0.783860 Aug 25 12:59:20.588698 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1597/3265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:19 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1500 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:20.636580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe38ca6-2c1c-4484-84db-3d9c05044b8b", "tag": "d5fd1beb-ffb5-4424-88da-988de4a6ca1d"}, {"server_uuid": "85c746c0-9899-4852-91bf-e4dd6e85828e", "name": "network-vif-deleted", "tag": "675aa903-504a-40fd-a7dd-09bfb52281b3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:20.677376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.680336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.681836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.733202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Creating event network-changed:d5fd1beb-ffb5-4424-88da-988de4a6ca1d for instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b on n-h1-850468-18 Aug 25 12:59:20.734479 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] Creating event network-vif-deleted:675aa903-504a-40fd-a7dd-09bfb52281b3 for instance 85c746c0-9899-4852-91bf-e4dd6e85828e on n-h1-850468-18 Aug 25 12:59:20.762448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-96705b21-0ec2-4a63-9b3d-4792c3d466f6 req-55c6b8e7-3425-4445-9a27-34f8b2838765 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.152234 Aug 25 12:59:20.764824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1598/3266] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:20.786454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:20.789378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:20.814876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.817755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.818854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:20.820754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:20.822925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:20.824888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.208155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.220273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.233920 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1716b0c5-fa3f-48bb-97cd-09f5583e49d2 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1222 microversion: 2.1 time: 0.464877 Aug 25 12:59:21.238645 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1599/3267] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:20 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1222 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:21.249569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9a5e6b8-acf9-42bf-8eef-84c87f5caa32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.860147 Aug 25 12:59:21.251128 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1669/3268] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:20 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:21.251708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eeb2702b-1e79-42be-9aaf-48ee8cba4140 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:21.253034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eeb2702b-1e79-42be-9aaf-48ee8cba4140 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:21.271636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:21.275974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:21.296225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.312365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.313397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.315323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.319946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.321027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.496547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eeb2702b-1e79-42be-9aaf-48ee8cba4140 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.536470 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eeb2702b-1e79-42be-9aaf-48ee8cba4140 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1213 microversion: 2.1 time: 0.293582 Aug 25 12:59:21.541612 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1600/3269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:21 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:21.566918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Action: 'update', calling method: >, body: {"server": {"name": "ed0e383f-9e04-489f-8785-df11139f6a55_new"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:21.578507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:21.601695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.603036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.604306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.606069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.608173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.609154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.645546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] HTTP exception thrown: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Request method failure captured: Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 HTTP/1.1 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 64 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Hhj0sruP2HKSMrlUrIvP0KhD9VhMHGgUuR9n3wmnogZmMPnfrsFDr8ClF0Tbc_bEdmR3xEP3VGRIAlkOM6VzVO7O8X5fhte2SCgkuLnQOjd8DFelPcmQKAtMaCSjpdexHRG1wSoXv4Bs-5NLdJeIzETpDJQyRa6xq2aQZHY69fiEY Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ae51f4169b7c43d28be4598f57818b31 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ae51f4169b7c43d28be4598f57818b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ae51f4169b7c43d28be4598f57818b31 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2069478417-project Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6bbf4f2a759c4ffea5b9935445c1c4c3 Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2069478417-project Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "ed0e383f-9e04-489f-8785-df11139f6a55_new"}} Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ed0e383f-9e04-489f-8785-df11139f6a55', 'body': {'server': {'name': 'ed0e383f-9e04-489f-8785-df11139f6a55_new'}}} Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:59:21.650049 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:21.661859 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:21.668077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] Returning 404 to user: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:21.672799 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-70f04092-6d7c-47ff-a20b-bd7f594d98b1 tempest-ServersNegativeTestMultiTenantJSON-2069478417 tempest-ServersNegativeTestMultiTenantJSON-2069478417-project] 10.222.0.60 "PUT /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 404 len: 111 microversion: 2.1 time: 0.125886 Aug 25 12:59:21.674745 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1601/3270] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 12:59:21 2022] PUT /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:21.685039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:21.696682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.697669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.698448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.757778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Going to try to stop instance {{(pid=122700) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 12:59:21.798835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.816071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.819825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:21.822286 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7f00d4c-97e3-46d6-a433-747e0dc8430c tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 0.563180 Aug 25 12:59:21.823382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1670/3271] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:21 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:21.833623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:21.834819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:21.838454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:21.855959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.857729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.859090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.862155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.864022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.865354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.909131 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e08e2be0-33f0-477a-9645-ab0cbbdc4702 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "POST /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5/action" status: 202 len: 0 microversion: 2.1 time: 0.231662 Aug 25 12:59:21.912023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1602/3272] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 12:59:21 2022] POST /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 12:59:21.923491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:21.924761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:21.938017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.939030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.939967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:21.941463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:21.942455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:21.943210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.003773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:22.042533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.067485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.072400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.075486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d61ecdfc-6781-487f-b393-c9c77a79c3ca tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1576 microversion: 2.42 time: 0.249836 Aug 25 12:59:22.076895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1671/3273] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:21 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:22.099706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.101464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:22.130346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.131456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.132276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.134020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.134892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.136018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.196026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d13d727d-9a19-4440-9460-8df2bb460578 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 204 len: 0 microversion: 2.1 time: 0.280562 Aug 25 12:59:22.197279 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1603/3274] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:21 2022] DELETE /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:22.212281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.214121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:22.229963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.231168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.233306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.234889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.240078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.240078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.548366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.562861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43580cb1-a8d8-4b89-95c4-ba6e94a31e3e tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 0.483214 Aug 25 12:59:22.563828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1672/3275] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:22 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:22.576921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.578818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:22.593843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.595175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.598641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.600157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.603065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.604530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.611864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.626281 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-685f5bbe-6b90-43bc-8e79-5dae16cc8bec tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1533 microversion: 2.1 time: 0.421586 Aug 25 12:59:22.627406 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1604/3276] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:22 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1533 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:22.638084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.639713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:22.656443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.657631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.658851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.660413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.661500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.663568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.781763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:22.797967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf67ee4f-81a6-4b8b-bd8b-b65a7bacdeb4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1214 microversion: 2.1 time: 0.231606 Aug 25 12:59:22.799258 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1673/3277] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:22 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:22.808667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:22.810432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:22.822694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.823795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.824819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:22.826831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:22.827941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:22.828895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.007696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.031780 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6f7057e-3e4d-4f51-aa31-425f791c1787 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1217 microversion: 2.1 time: 0.230081 Aug 25 12:59:23.037061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1674/3278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:22 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:23.048024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:23.050401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:23.058124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.064912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.065985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.067169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.068644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.070121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.071231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.074914 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-824ee503-93a4-4d3a-bc74-4cb85e038cb4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.444983 Aug 25 12:59:23.076472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1605/3279] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:22 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:23.129324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:23.131004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:23.145181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.146688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.147485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.148618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.149811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.150945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.318803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.338223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.342421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.344424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f93fd63-85d4-4aa1-9f03-44ee5245c239 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1576 microversion: 2.42 time: 0.223397 Aug 25 12:59:23.345567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1606/3280] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:23 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:23.383887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.396040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.398842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:23.400393 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27db2854-cc5f-4cfd-94ec-6bd4d0206317 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 0.364912 Aug 25 12:59:23.401061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1675/3281] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:23 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:23.603295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:23.604857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:23.618793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.619759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.620451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.621788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.623533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.624583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.663844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:23.665306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:23.678469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.679783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.681549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:23.682326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:23.684160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:23.686399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.044913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.059272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.062500 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74c58cbc-aaac-449a-adc8-214b53ab4e4d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 0.466362 Aug 25 12:59:24.066513 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1607/3282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:23 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:24.076686 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-713cba73-3ea8-4e18-b020-5aac98728d7f tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1533 microversion: 2.1 time: 0.423641 Aug 25 12:59:24.080876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:24.083734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:24.092884 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1676/3283] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:23 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1533 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 12:59:24.099580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.100510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.101513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.103251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.104266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.105326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.112657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:24.114370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:24.127121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.128033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.128911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.130329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.131640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.132375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.226312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.243068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95442e90-24d0-481a-bb8a-f1e2fa6192ab tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1214 microversion: 2.1 time: 0.173981 Aug 25 12:59:24.256547 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1608/3284] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:24.256547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:24.256547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:24.273926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.275223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.276380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.277706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.279788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.280730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.293765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.312250 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f00530ac-af3f-4328-8615-7c0dbdad3714 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1217 microversion: 2.1 time: 0.216828 Aug 25 12:59:24.313901 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1677/3285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:24.430694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:24.449965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:24.499325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.503327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.505668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.506926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.507835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.508604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.836490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.879360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.892457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.895033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e7cda59-d8ed-4e09-a54f-11aaa5872ce6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1576 microversion: 2.42 time: 0.497871 Aug 25 12:59:24.908332 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1678/3286] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1576 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:24.909165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:24.913323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:24.925367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:24.929791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.931549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.932941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.935832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:24.938547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:24.939758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:24.946900 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4993a56f-8c4c-46ea-be3d-7eefe1c30a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.700813 Aug 25 12:59:24.956703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1609/3287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:24.988885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a277d44-5bfe-4641-a508-01856d871560", "name": "network-vif-plugged", "status": "completed", "tag": "c345f056-2073-4666-bd8d-ff11aeb7ea64"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:25.019647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.021689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.023162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.057578 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] Creating event network-vif-plugged:c345f056-2073-4666-bd8d-ff11aeb7ea64 for instance 6a277d44-5bfe-4641-a508-01856d871560 on n-h1-850468-18 Aug 25 12:59:25.071221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-91a30e2d-9eee-470d-8fd7-8bcde0612353 req-fbb7655e-c4b9-4760-af47-5c61e16d2df7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118996 Aug 25 12:59:25.073053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1610/3288] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:25.111005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.113233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.128187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.129968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.131308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.133227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.134881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.136281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.420167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.438248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.442303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.445107 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5eb2206-544a-4a96-ad65-12383ab70d44 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 0.545952 Aug 25 12:59:25.446601 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1679/3289] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:24 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:25.475591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.477490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.501474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.502743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.503815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.505599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.506746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.507938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.515013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.533746 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5861169a-084a-45af-8921-ab7ee18dbfc4 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 0.432491 Aug 25 12:59:25.534845 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1611/3290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:25.543108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.544657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.571506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.573609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.574796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.578027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.579667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.582135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.750503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.775837 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea213a04-f48b-4651-9fa9-adfd53fb2bd5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1270 microversion: 2.1 time: 0.238339 Aug 25 12:59:25.777620 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1612/3291] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:25.787658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.789332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.811559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.812608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.813552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.814994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.815973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.816955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.892749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.904521 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc48c157-b747-436a-a4c7-cda47f9ed3cb tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1533 microversion: 2.1 time: 0.440705 Aug 25 12:59:25.905834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1680/3292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1533 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:25.948307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:25.950195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:25.953946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:25.969658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.970278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.970798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.971635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:25.972218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:25.972729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:25.974518 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c213fcdf-388c-4020-b594-d827e1925796 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1209 microversion: 2.1 time: 0.194271 Aug 25 12:59:25.976014 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1613/3293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:25.990892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:26.003476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:26.005910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:26.016636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.017559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.018362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.020804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.020804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.021608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.151360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:26.171503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:26.174756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:26.177317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5f30e9b-7e5b-415d-8f9c-aa0b213f5343 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1576 microversion: 2.42 time: 0.233263 Aug 25 12:59:26.179154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1681/3294] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:26.510810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:26.512784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:26.532383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.534309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.535354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.536870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.538176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.539299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.618992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:26.653551 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bb6ba33c-ce68-4d8e-83d7-d94e24a17bde tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.665303 Aug 25 12:59:26.655129 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1614/3295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:25 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:26.664825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:26.666433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:26.687197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.688343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.689102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:26.690442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:26.697407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:26.698412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.307000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.341382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.345522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.348341 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2da419f-4c54-4e28-b294-345050317a9f tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 0.856604 Aug 25 12:59:27.360704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1682/3296] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:26 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 12:59:27.389048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:27.390813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:27.403456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.404988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.406196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.407918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.409151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.410279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.890676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.906363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08d737d0-1e4b-428e-96ad-660e7136cee4 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1270 microversion: 2.1 time: 0.543291 Aug 25 12:59:27.907498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1683/3297] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:27 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1270 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:27.916781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:27.917917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:27.931504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.931860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.932794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.934246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:27.936043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:27.936821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:27.967235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:27.991971 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf381e84-f416-441e-9a34-bc53c1a8b316 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 1.334613 Aug 25 12:59:27.993565 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1615/3298] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:26 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:28.003279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:28.005004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:28.018246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.019238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.020045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.021488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.022726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.023607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.205227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.223398 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e71ef3cb-52a7-4be4-b363-fab47ff4e72a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1265 microversion: 2.1 time: 0.227256 Aug 25 12:59:28.225595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1616/3299] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:27 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:28.237678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:28.239636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:28.255551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.256528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.257357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.258722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.260152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.261315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.341204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.370950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b6131353-7d16-47cf-b79d-ffaae1bbd3f0 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1533 microversion: 2.1 time: 0.461339 Aug 25 12:59:28.384545 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1684/3300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:27 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1533 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:28.400632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:28.402690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:28.418765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.420098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.421241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.423796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.425221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.426652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.527722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.595915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.600873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.611925 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e17c8ab-3b31-4799-86e1-4507c3cb3e64 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1594 microversion: 2.42 time: 0.381916 Aug 25 12:59:28.632218 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1617/3301] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:28 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1594 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:28.642832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:28.647000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:28.671824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.672977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.673737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.675040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:28.675887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:28.676715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:28.686530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:28.958259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:28.975908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4fd2c784-256d-4e04-a84e-00976b5e6620 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1317 microversion: 2.1 time: 0.586800 Aug 25 12:59:28.982382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1685/3302] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:28 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:28.996162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:28.999423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:29.014746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.015652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.016595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:29.018002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.018701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.019567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:29.051802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:29.079804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:29.082635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:29.093483 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2eec6ed2-3153-4c17-bb22-4237454fcdad tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 0.464150 Aug 25 12:59:29.095923 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1618/3303] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:28 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:29.117430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:29.120159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:29.150776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.157443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.158841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:29.160935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:29.162259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:29.163536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:29.325360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:29.552347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:29.619262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:30.340011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:30.376018 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-493cfd57-e149-494f-af57-0120ab10de57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1288 microversion: 2.1 time: 1.390676 Aug 25 12:59:30.398507 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1686/3304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:28 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1288 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:30.425831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:30.427418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:30.455945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:30.458435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:30.459776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:30.464946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:30.466941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:30.468654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:30.835674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:30.864906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd33c408-2a5a-49f1-a2bd-2db6a7d876cd tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1271 microversion: 2.1 time: 0.463193 Aug 25 12:59:30.865830 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1687/3305] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:30 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1271 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:30.875903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:30.893966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:30.915584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:30.917068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:30.918200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:30.920575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:30.921422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:30.922488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.022047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.023770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.025436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.026693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lazy-loading 'fault' on Instance uuid ed0e383f-9e04-489f-8785-df11139f6a55 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:59:31.142880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.174361 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bbe199c3-d006-4aa9-900d-2b772119e947 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 2.072637 Aug 25 12:59:31.176061 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1619/3306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:29 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:31.193959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:31.198130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:31.223751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.225332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.228624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.234514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.235986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.237163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.316085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b032b82b6a4adabc813984d44d83de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca116650455a456da3186d4fb844fe6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.356055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bda5c293-30fc-49a2-a959-21772e551505 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 200 len: 1317 microversion: 2.1 time: 0.487274 Aug 25 12:59:31.365289 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1688/3307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:30 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:31.378584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:31.380499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:31.436788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.440205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.443026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.453226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.457353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.471925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.516088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:31.848672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.890594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.894997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:31.897689 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f5f55fe-88a7-4218-b124-f49cdaef68f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1594 microversion: 2.42 time: 0.718119 Aug 25 12:59:31.912968 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1620/3308] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:31 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1594 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:31.936480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:31.943157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:31.974496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.981186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.983406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:31.986673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:31.990914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:31.997610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:32.681912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:32.734324 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d520b95-3656-4378-be14-921fa4fdad87 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1505 microversion: 2.1 time: 1.364872 Aug 25 12:59:32.754207 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1689/3309] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:31 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1505 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:32.792324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe38ca6-2c1c-4484-84db-3d9c05044b8b", "name": "network-vif-plugged", "status": "completed", "tag": "d5fd1beb-ffb5-4424-88da-988de4a6ca1d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:32.826395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:32.827249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:32.829761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:32.857827 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] Creating event network-vif-plugged:d5fd1beb-ffb5-4424-88da-988de4a6ca1d for instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b on n-h1-850468-18 Aug 25 12:59:32.868689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-615f80af-18c0-433a-8705-ca0cdc22f65f req-e03704ed-6e8d-4340-a3e7-4158e70b14fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111095 Aug 25 12:59:32.876664 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1690/3310] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:33.224763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:33.275782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:33.281174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:33.289438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea4663f6-0dd1-4df9-b52d-7d4d8d59bbf4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 1.369873 Aug 25 12:59:33.305778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1621/3311] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:31 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:33.336999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:33.338830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:33.354465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:33.355989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:33.357419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:33.359458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:33.360899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:33.362234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:33.609206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0e383f-9e04-489f-8785-df11139f6a55", "name": "network-vif-deleted", "tag": "cb876ec2-b596-42d7-832f-71d9734df153"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:33.646760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:33.647682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:33.651309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:33.685664 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] Creating event network-vif-deleted:cb876ec2-b596-42d7-832f-71d9734df153 for instance ed0e383f-9e04-489f-8785-df11139f6a55 on n-h1-850468-18 Aug 25 12:59:33.698804 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bef039f4-9d24-4771-af1c-d33a24c9ff31 req-de7a2542-6212-4062-9437-ea7f2c1a12e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.817279 Aug 25 12:59:33.701374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1691/3312] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:33.720573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:33.722380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:33.737648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:33.738601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:33.739431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:33.740884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:33.741703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:33.742438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.044812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:34.082121 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd6791f9-feb4-47f0-af36-7779c8ede3eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1271 microversion: 2.1 time: 0.377591 Aug 25 12:59:34.083680 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1692/3313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:33 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1271 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:34.106863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.108772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:34.139354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.141782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.143167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.144925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.146259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.148786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.617817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:34.691363 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-54145e09-3ea4-4f2a-b6e3-eab152b4cb49 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1318 microversion: 2.1 time: 1.383408 Aug 25 12:59:34.711965 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1622/3314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:33 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1318 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:34.731930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.733647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] [instance: ed0e383f-9e04-489f-8785-df11139f6a55] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:34.756767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.757916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.759586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.761435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.763500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.764994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.823268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] HTTP exception thrown: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Request method failure captured: Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 HTTP/1.1 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3G9EvO1OrfzjvsJos3OojPAhJgBqTEVG8nMn2Y4j8Kvsx9UpJf3fXtbOp1UsFipln2mR2scidqJo9Ap0AJ5gGUpM9JGaNbKcJi-DDNXnV0MVZg9PHS7ySt-IxsN75a9D3OEwgYWU23UVmZ3vzHvRFehsr_re3fH0p4ZlC4Z46Rlbjs Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ca116650455a456da3186d4fb844fe6a Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-322512306 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca116650455a456da3186d4fb844fe6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca116650455a456da3186d4fb844fe6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca116650455a456da3186d4fb844fe6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca116650455a456da3186d4fb844fe6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-322512306 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ca116650455a456da3186d4fb844fe6a Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-322512306 Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestMultiTenantJSON-322512306-project Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 44b032b82b6a4adabc813984d44d83de Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-322512306-project Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ed0e383f-9e04-489f-8785-df11139f6a55'} Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:34.834434 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] Returning 404 to user: Instance ed0e383f-9e04-489f-8785-df11139f6a55 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd9618ed-c1a7-471e-a3b7-896fb5924a09 tempest-ServersNegativeTestMultiTenantJSON-322512306 tempest-ServersNegativeTestMultiTenantJSON-322512306-project] 10.222.0.60 "GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55" status: 404 len: 111 microversion: 2.1 time: 0.126624 Aug 25 12:59:34.844278 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1623/3315] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:34 2022] GET /compute/v2.1/servers/ed0e383f-9e04-489f-8785-df11139f6a55 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:34.862616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:34.863409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:34.892197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.893320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.894138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:34.895457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:34.905216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:34.906372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.015745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:35.360697 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-07abdd7d-ca32-49a4-8929-fa96a90dd387 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 204 len: 0 microversion: 2.1 time: 0.515006 Aug 25 12:59:35.362076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1624/3316] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:34 2022] DELETE /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:35.375949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:35.378033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:35.390885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.392254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.393393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.395038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.396697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.397919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.399243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:35.429322 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-465bd196-7411-488a-b122-5b9d0683f916 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 1.342275 Aug 25 12:59:35.454678 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1693/3317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:34 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:35.474123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:35.475326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:35.490048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.491005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.493202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.495028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.496307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.498013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.785947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:35.818930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:35.828940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:35.836582 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-479733d1-85bf-463c-88b2-b740b95e0826 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1594 microversion: 2.42 time: 0.471589 Aug 25 12:59:35.847864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1625/3318] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:35 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1594 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:35.881908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:35.885101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:35.914596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.915630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.917488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:35.920168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:35.923486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:35.925029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.815294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:36.847851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:36.863740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:36.866839 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc530e56-0e51-4fce-be33-55bd430e4ed6 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1359 microversion: 2.21 time: 1.404668 Aug 25 12:59:36.868424 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1694/3319] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:35 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1359 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:36.885700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:36.888348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:36.909981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.913375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.916615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:36.932338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:36.933688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:36.941400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:37.752995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:37.787252 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f4ec862-cd8e-4af5-a6ae-8cc7dd507f7d tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 1.924882 Aug 25 12:59:37.788906 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1626/3320] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:35 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:37.799239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:37.800605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:37.827981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:37.837368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:37.839696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:37.842102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:37.843054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:37.843863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:38.929106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:38.958868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5fb4fb26-7a2d-4904-a30d-58cbdd534c91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1511 microversion: 2.1 time: 2.087358 Aug 25 12:59:38.963509 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1695/3321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:36 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1511 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:38.976286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0de314-a97e-44b0-80ce-8e6781033b34", "tag": "7dfb54c0-57ed-4c92-8a06-faefc4d7cffa"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:39.005565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.007957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.009596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.040980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] Creating event network-changed:7dfb54c0-57ed-4c92-8a06-faefc4d7cffa for instance 9f0de314-a97e-44b0-80ce-8e6781033b34 on n-h1-850468-18 Aug 25 12:59:39.052950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-447c64e6-be47-42f5-a824-f16141768063 req-cba8abc6-e649-41ea-a66d-af8baed69960 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086248 Aug 25 12:59:39.055188 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1696/3322] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:39.070052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:39.072534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:39.091261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.093890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.095310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.097165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.098195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.099132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:39.099968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.127525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b98801b8-cb07-4c42-bfe6-f83003211e8c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1318 microversion: 2.1 time: 1.336448 Aug 25 12:59:39.142209 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1627/3323] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:37 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1318 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:39.160515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:39.162288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:39.191302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.193728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.194954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.207232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.209011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.209837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.907878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:39.939623 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-835ce776-8e98-482d-998e-83540ab3c6c3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1510 microversion: 2.1 time: 0.881360 Aug 25 12:59:39.941838 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1697/3324] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:39 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:39.961660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:39.963641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:39.980586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:39.981589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:39.982465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:39.983446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.003114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.023637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.024735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.050450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.054129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.056524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-445f532b-0c81-4b12-99b3-c585125654cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1661 microversion: 2.42 time: 0.911830 Aug 25 12:59:40.058392 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1628/3325] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:39 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1661 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:40.069590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.072830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:40.094344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.095098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.097871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.103596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.107513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.109117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.714240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.729130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.761613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.765751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:40.771616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9714a9d8-081f-4548-adbe-2bb16f21a491 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1552 microversion: 2.21 time: 0.827322 Aug 25 12:59:40.773181 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d396673-99e1-4d2b-820b-0500e33f79eb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 0.711731 Aug 25 12:59:40.775761 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1629/3326] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:40 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:40.788691 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1698/3327] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:39 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1552 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:40.799645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.809824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:40.811527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:40.813388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:40.837083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.839628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.840297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.843213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.843642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.845421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.846956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.848001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.850178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.853428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:40.853428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:40.855689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:40.947038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:42.273873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:42.288668 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5ce639b-ab6c-4e04-b68f-ebc12f2a10a4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1511 microversion: 2.1 time: 1.510093 Aug 25 12:59:42.290607 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1630/3328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:40 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1511 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:42.302827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:42.303756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:42.314070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.315384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.316654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.318273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.319728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.321051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.396080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:42.708949 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f7d714a-a7af-44cf-b147-73ca39339f59 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 204 len: 0 microversion: 2.21 time: 0.415543 Aug 25 12:59:42.710152 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1631/3329] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:59:42 2022] DELETE /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 12:59:42.721762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:42.724097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:42.745945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.748094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.749393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.751546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.753633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.755018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.809902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:42.865916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:42.882238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0320360d-b70e-4054-bccc-bd850068dc44 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1318 microversion: 2.1 time: 2.091409 Aug 25 12:59:42.883733 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1699/3330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:40 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1318 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:42.921275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:42.923478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:42.936929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.938301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.939423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:42.941077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:42.942233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:42.943305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:44.327823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:44.359417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-726153bf-a789-4f34-a83e-cad1c6b3cc5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1487 microversion: 2.1 time: 1.646902 Aug 25 12:59:44.366936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1632/3331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:42 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1487 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:44.396630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:44.399684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:44.422315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:44.424420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:44.425321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:44.428204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:44.429894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:44.431224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:44.463946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:44.502535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:44.511847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:44.516203 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc34b78a-873f-49cd-be9c-06553d72df9c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1661 microversion: 2.42 time: 1.617594 Aug 25 12:59:44.524571 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1700/3332] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:42 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1661 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:44.552081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:44.564980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:44.591000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:44.593080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:44.593960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:44.595642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:44.602017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:44.603136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:46.897063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:46.930498 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0af5d58-cbe1-440d-84d9-73a3487b6604 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 2.559797 Aug 25 12:59:46.940396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1633/3333] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:44 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:46.947212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:46.955346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:46.960825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:46.990876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:46.992348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:46.994881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:46.996803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:46.998658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.007054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.008000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e9c535c1460412aad46e766745d5f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af077f69bb3d4a20aff3af35151d5e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:47.008657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.010345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-efda2930-f5ec-4eef-88a3-17cf7d9d21fb tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 200 len: 1558 microversion: 2.21 time: 2.483243 Aug 25 12:59:47.011327 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1701/3334] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:44 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 1558 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:47.052343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:47.053783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:47.080931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:47.091411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.092421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.093196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.094506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.095340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.096139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.126157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.127515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.128795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.129968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lazy-loading 'fault' on Instance uuid 6a277d44-5bfe-4641-a508-01856d871560 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 12:59:47.686820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:47.715122 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d218d538-5bdd-4f40-b453-0adb0b2b60b9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 200 len: 1307 microversion: 2.1 time: 0.772227 Aug 25 12:59:47.722920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1634/3335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:46 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 1307 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:47.738112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1221270978"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:47.757857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:47.784645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 12:59:47.792007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.794252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.796101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:47.798880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:47.800217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:47.801260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.160357 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8091dd3b-effc-4739-ba8a-7624d27d52b3 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "PUT /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1060 microversion: 2.1 time: 0.432057 Aug 25 12:59:48.161692 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1635/3336] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 12:59:47 2022] PUT /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1060 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:48.183112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:48.190756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:48.217214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:48.221789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:48.226758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.229807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:48.232565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:48.238237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:48.906545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:48.984512 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c1b6fcb-eff0-47f0-ad47-0936ad7f1e0c tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1318 microversion: 2.1 time: 1.947339 Aug 25 12:59:48.986774 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1702/3337] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:47 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1318 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:49.021392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a277d44-5bfe-4641-a508-01856d871560", "name": "network-vif-deleted", "tag": "c345f056-2073-4666-bd8d-ff11aeb7ea64"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:49.074068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.077208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.079606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:49.138041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] Creating event network-vif-deleted:c345f056-2073-4666-bd8d-ff11aeb7ea64 for instance 6a277d44-5bfe-4641-a508-01856d871560 on n-h1-850468-18 Aug 25 12:59:49.169442 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7df2e60f-acd4-4f20-870b-b1c1b4146f27 req-112605fa-2351-46a6-9b40-2534cd8f09a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176570 Aug 25 12:59:49.172193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1703/3338] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:49.183796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe38ca6-2c1c-4484-84db-3d9c05044b8b", "name": "network-vif-deleted", "tag": "d5fd1beb-ffb5-4424-88da-988de4a6ca1d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:49.207701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.209258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.210729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:49.240538 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] Creating event network-vif-deleted:d5fd1beb-ffb5-4424-88da-988de4a6ca1d for instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b on n-h1-850468-18 Aug 25 12:59:49.253629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-22e0b8da-c7fa-4cdb-953d-190541ab00f9 req-7d877047-3e74-4221-b165-699e7b1b0742 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075328 Aug 25 12:59:49.255081 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1704/3339] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:49.267832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:49.280553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:49.311365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.311716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.338380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:49.339786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:49.341793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:49.352953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.722313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:50.759965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:50.787381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:50.815517 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b58e88d-a4ea-4b32-a09b-d9dbdb8d944f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1661 microversion: 2.42 time: 2.649571 Aug 25 12:59:50.820582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1636/3340] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:48 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1661 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:50.867916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:50.869794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:50.888256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.889867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.891741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.905803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:50.907693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:50.911036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:50.982927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] HTTP exception thrown: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Request method failure captured: Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b HTTP/1.1 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3ITksYCMJbzHvM8Poj7uMRMSFT6JOlM4YbhpJuL2HAQ6UBzbiS_20G5Gg-oaNHC9hr5OnJ7Qb-82D8GEbGEsm2bhOEo_uz5GKfEVDnw_xiyR9Jc0GZVIfeWSwUshchFylqY5nDlrgvUCTsNrHx3lLdqI51jjkO2cmQyI_V28qsXpu0 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5e9c535c1460412aad46e766745d5f72 Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cbe38ca6-2c1c-4484-84db-3d9c05044b8b'} Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:50.993683 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.003307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Returning 404 to user: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:51.013494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0b77b3b-eb47-47f2-9dcb-6be48ce214b4 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 404 len: 111 microversion: 2.21 time: 0.180860 Aug 25 12:59:51.024691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1637/3341] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:50 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:59:51.039639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:51.040962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:51.082059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.084480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.085366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.093850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.095003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.096028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.190538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:51.222542 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-936a2059-4584-4c82-a531-a53bc995b15e tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 1.964365 Aug 25 12:59:51.224742 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1705/3342] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:49 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:51.240764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:51.250907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:51.273153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.274359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.276096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.277500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.278868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.279696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.335095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 HTTP/1.1 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6a277d44-5bfe-4641-a508-01856d871560'} Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:51.339354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:51.355615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7dc4f7a9-c839-4dcf-853b-16bef8561a54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 404 len: 111 microversion: 2.1 time: 0.124619 Aug 25 12:59:51.370011 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1706/3343] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:51 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 12:59:51.407482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de314-a97e-44b0-80ce-8e6781033b34", "name": "network-vif-plugged", "status": "completed", "tag": "7dfb54c0-57ed-4c92-8a06-faefc4d7cffa"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:51.441680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.442721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.443435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.489675 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] Creating event network-vif-plugged:7dfb54c0-57ed-4c92-8a06-faefc4d7cffa for instance 9f0de314-a97e-44b0-80ce-8e6781033b34 on n-h1-850468-18 Aug 25 12:59:51.505931 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d5229f1c-9ef2-4eaa-b7cf-7ba052041f47 req-c9df6480-8382-4474-a446-0e990935f752 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132546 Aug 25 12:59:51.507490 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1707/3344] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:51.533429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:51.535703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:51.555031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.555919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.556658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:51.558329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:51.560007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:51.561461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.346200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:53.373283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:53.400195 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3e51789-bc18-4e4f-85aa-729883552f56 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1318 microversion: 2.1 time: 1.884647 Aug 25 12:59:53.403802 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71c3c74a-e9a0-4851-b7ab-d1a20755f295 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1487 microversion: 2.1 time: 2.377061 Aug 25 12:59:53.415297 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1638/3345] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:51 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1487 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:53.416833 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1708/3346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:51 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1318 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:53.439135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:53.440778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:53.454292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '.version_select at 0x7fc6c1f404c0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:53.455481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:53.465252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.474069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.475545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.481391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.482890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.489446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.512046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.513033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.520969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.522770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.529982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.534971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.875539 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f457f7b-72eb-4ef9-99cd-177ebc7df2b0 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.457138 Aug 25 12:59:53.877123 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1639/3347] 10.222.0.60 () {60 vars in 1337 bytes} [Thu Aug 25 12:59:53 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b/os-instance-actions => generated 611 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 12:59:53.891346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:53.914317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.915267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.916233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.944559 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] Creating event network-changed:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 12:59:53.959303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8277c91b-c384-4de4-8bef-f87ccf9f934f req-050dd18f-2f76-4bc3-bd0e-4a2166e62d93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077921 Aug 25 12:59:53.962455 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1640/3348] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 12:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 12:59:53.979507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:53.981278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:53.994027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.995227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:53.996392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:53.998438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:53.999688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:54.000945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:54.648823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:54.673927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f40f1601-05ca-45e5-a0a2-c39dd171a526 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.255359 Aug 25 12:59:54.688989 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1709/3349] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:53 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:54.710109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:54.711984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:54.751404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:54.753142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:54.759039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:54.761605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:54.765339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:54.772462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:54.908554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:54.942417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:54.953529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:54.962687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08adfb89-4360-41e9-8630-4f921743d185 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1707 microversion: 2.42 time: 0.997843 Aug 25 12:59:54.971516 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1641/3350] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:53 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1707 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:54.986586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:54.990086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:55.029373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.031838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.033319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.035063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.036380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.037532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.854379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:55.876212 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-003d41e2-404e-4eaa-bb11-0201644c75f5 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1487 microversion: 2.1 time: 0.902021 Aug 25 12:59:55.877776 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1642/3351] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:54 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1487 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:55.893005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:55.894866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:55.908614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.911162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.912585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.914442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:55.915955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:55.917197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:55.964618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] HTTP exception thrown: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Request method failure captured: Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b HTTP/1.1 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3ITksYCMJbzHvM8Poj7uMRMSFT6JOlM4YbhpJuL2HAQ6UBzbiS_20G5Gg-oaNHC9hr5OnJ7Qb-82D8GEbGEsm2bhOEo_uz5GKfEVDnw_xiyR9Jc0GZVIfeWSwUshchFylqY5nDlrgvUCTsNrHx3lLdqI51jjkO2cmQyI_V28qsXpu0 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5e9c535c1460412aad46e766745d5f72 Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cbe38ca6-2c1c-4484-84db-3d9c05044b8b'} Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:55.968439 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Returning 404 to user: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:55.978327 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cabc7903-6cfe-4861-9a8d-f8c11f0db278 tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 404 len: 111 microversion: 2.21 time: 0.090730 Aug 25 12:59:55.983510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1643/3352] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 12:59:55 2022] DELETE /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:59:55.994672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:55.997998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:56.016701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.019237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.020648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.022331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.024268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.025393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.125443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:56.156108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d196f573-e31d-478e-95bf-e844cfec3bb0 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 1.461529 Aug 25 12:59:56.158016 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1710/3353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:54 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:56.173470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff836731-a19f-4a73-98dc-6f333c9041ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff836731-a19f-4a73-98dc-6f333c9041ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 163 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": 12345, "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 12345 Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 12:59:56.183392 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 25 12:59:56.194202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.200837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff836731-a19f-4a73-98dc-6f333c9041ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:56.202162 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff836731-a19f-4a73-98dc-6f333c9041ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.039062 Aug 25 12:59:56.203931 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1711/3354] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 12:59:56 2022] POST /compute/v2.1/servers => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:59:56.214169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:56.215276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:56.231968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.233592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.234835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.236712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.238931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.240238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.318345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 12:59:56.605380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d511e11-80b9-42b6-a397-c5b3d8c31c5b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 204 len: 0 microversion: 2.1 time: 0.398753 Aug 25 12:59:56.615862 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1712/3355] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 12:59:56 2022] DELETE /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 12:59:56.625178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:56.626879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] [instance: cbe38ca6-2c1c-4484-84db-3d9c05044b8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:56.645201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.653352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.655380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.656932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.657841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.658705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:56.658964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.702565 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-582a1d0d-1b75-426e-9b81-7274f1a457de tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1508 microversion: 2.1 time: 0.717304 Aug 25 12:59:56.704311 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1644/3356] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:55 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:56.724798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:56.728103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:56.732615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] HTTP exception thrown: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Request method failure captured: Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b HTTP/1.1 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3ITksYCMJbzHvM8Poj7uMRMSFT6JOlM4YbhpJuL2HAQ6UBzbiS_20G5Gg-oaNHC9hr5OnJ7Qb-82D8GEbGEsm2bhOEo_uz5GKfEVDnw_xiyR9Jc0GZVIfeWSwUshchFylqY5nDlrgvUCTsNrHx3lLdqI51jjkO2cmQyI_V28qsXpu0 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.21 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/af077f69bb3d4a20aff3af35151d5e9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: af077f69bb3d4a20aff3af35151d5e9d Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-142752044 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5e9c535c1460412aad46e766745d5f72 Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-InstanceActionsV221TestJSON-142752044-project Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'cbe38ca6-2c1c-4484-84db-3d9c05044b8b'} Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.739522 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] Returning 404 to user: Instance cbe38ca6-2c1c-4484-84db-3d9c05044b8b could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ded1b1c8-1bb0-448a-8b6b-348b00039fba tempest-InstanceActionsV221TestJSON-142752044 tempest-InstanceActionsV221TestJSON-142752044-project] 10.222.0.60 "GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b" status: 404 len: 111 microversion: 2.21 time: 0.128638 Aug 25 12:59:56.755135 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1713/3357] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:56 2022] GET /compute/v2.1/servers/cbe38ca6-2c1c-4484-84db-3d9c05044b8b => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 12:59:56.757653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.760962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.765091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.768343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.773438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.775528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.778900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:56.780067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:56.815810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.816772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.817561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:56.829555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:56.830688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:56.831480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:57.825867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:57.859516 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8c97870-59e4-40b3-8408-e00b75072361 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.103220 Aug 25 12:59:57.861035 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1714/3358] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:56 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 12:59:57.895087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:57.897094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:57.921754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:57.931689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:57.934042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:57.938163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:57.940146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:57.941549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:58.011880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:58.057495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:58.068482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 12:59:58.073998 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e430a924-b957-4505-841c-8c3b7d6b8a97 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1707 microversion: 2.42 time: 1.367318 Aug 25 12:59:58.076786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1645/3359] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 12:59:56 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1707 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 12:59:58.097625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 12:59:58.098974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 12:59:58.117251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:58.118110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:58.118959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:58.120377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 12:59:58.121253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 12:59:58.122114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 12:59:59.999250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:00.035856 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7023e13-aa86-4b2a-8bc4-07827af657d1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 200 len: 1493 microversion: 2.1 time: 2.172011 Aug 25 13:00:00.037995 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1715/3360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:57 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 1493 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:00.053011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:00.064807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:00.086495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:00.088103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:00.089887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:00.092815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:00.094169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:00.095268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:01.109795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:01.134462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aadf71df-45be-4c6f-9a1e-ad55d9e7af4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1508 microversion: 2.1 time: 3.050982 Aug 25 13:00:01.137887 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1646/3361] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 12:59:58 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1508 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:01.148737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:01.151422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:01.202669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:01.203477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:01.204350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:01.205746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:01.206867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:01.207706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:02.999373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:03.061186 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89f7f66d-f724-4c9e-9b18-09ded6969f7a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 3.020674 Aug 25 13:00:03.062641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1716/3362] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:00 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 3024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:03.078763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:03.084397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:03.116536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:03.126325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.127231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.128398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.136986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.141741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.143024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.170451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0cffeda4-256c-4051-a960-f15c697f79c4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.029876 Aug 25 13:00:03.173999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1647/3363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:01 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:03.213004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:03.216788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:03.255468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.256606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.258141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.268493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.273948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.275591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.353453 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 HTTP/1.1 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ab365912-1c79-4919-aec0-cea6a0c602f5'} Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.358823 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.375102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:03.381589 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b36aaa03-a481-4471-9c0a-5711e1b05111 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 404 len: 111 microversion: 2.1 time: 0.188233 Aug 25 13:00:03.384286 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1648/3364] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:03 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:03.397538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:03.404973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:03.419372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.420818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.422241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.424421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.425703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.426959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.576501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:03.613804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f0622eb-801f-46cd-ab92-30333024f7e5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "PUT /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1080 microversion: 2.1 time: 0.226560 Aug 25 13:00:03.633511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1649/3365] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:00:03 2022] PUT /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1080 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:03.649982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab365912-1c79-4919-aec0-cea6a0c602f5", "name": "network-vif-deleted", "tag": "990c2134-fc66-4cc8-b850-407112ea8944"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:03.667105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.668343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.669883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.724675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] Creating event network-vif-deleted:990c2134-fc66-4cc8-b850-407112ea8944 for instance ab365912-1c79-4919-aec0-cea6a0c602f5 on n-h1-850468-18 Aug 25 13:00:03.745716 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0ed31411-e677-4186-af7c-bb3d065c3089 req-b52e9b3f-001a-47ee-8f9e-f9236f29685e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103729 Aug 25 13:00:03.747518 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1650/3366] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:03.760451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:03.773665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:03.795710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.796942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.797327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.798804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.799625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.800429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.864594 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 HTTP/1.1 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ab365912-1c79-4919-aec0-cea6a0c602f5'} Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:03.872855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:03.881984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:03.888836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:03.894064 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d7bcef7-635b-4f4d-ad78-4861438171b1 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 404 len: 111 microversion: 2.1 time: 0.143894 Aug 25 13:00:03.897832 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1651/3367] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:03 2022] DELETE /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:03.932690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-plugged", "status": "completed", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:03.954964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:03.956575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:03.957867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:03.983776 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] Creating event network-vif-plugged:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 13:00:03.996464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-48ded6fa-ab4d-4e2b-a4ec-8a8960f001ff req-cad718b4-e5b5-4462-bf6b-ae7a533d1836 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089356 Aug 25 13:00:04.000448 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1652/3368] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:04.016160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:04.018156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:04.036830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.039406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.040782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.042128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.043066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.044509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.380772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:04.424858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:04.424858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:04.424858 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fd3f55f5-f58d-4d5c-980a-f33a216c95ce tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1753 microversion: 2.42 time: 1.357351 Aug 25 13:00:04.467812 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1717/3369] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:03 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1753 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:04.478436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:04.479860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: ab365912-1c79-4919-aec0-cea6a0c602f5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:04.493196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.494520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.495527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.497836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.498999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.500100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.548854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 HTTP/1.1 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ab365912-1c79-4919-aec0-cea6a0c602f5'} Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:04.552603 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. Aug 25 13:00:04.563955 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:04.571070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance ab365912-1c79-4919-aec0-cea6a0c602f5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:04.572483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa8db3f1-9aa7-4bd2-b54c-5789979b8707 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5" status: 404 len: 111 microversion: 2.1 time: 0.098933 Aug 25 13:00:04.579356 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1718/3370] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:04 2022] GET /compute/v2.1/servers/ab365912-1c79-4919-aec0-cea6a0c602f5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:04.589861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:04.592413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:04.605313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.608050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.609403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.611226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:04.614021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:04.615902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:04.693679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:06.966215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:07.025744 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27a21cd2-b526-451c-b710-80d42ec8b51f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1506 microversion: 2.1 time: 3.018100 Aug 25 13:00:07.040150 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1653/3371] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:04 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1506 bytes in 3031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:07.070223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:07.076306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:07.117845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.123583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.125632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.130888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.136307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.140246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.221361 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f HTTP/1.1 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a801ba20-2b5e-4e8b-a140-fcc95e5af41f'} Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:07.229463 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7972e18-e885-4886-94bb-831cd05e3ed6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 404 len: 111 microversion: 2.1 time: 0.198016 Aug 25 13:00:07.246984 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1654/3372] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:07 2022] DELETE /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:07.255799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:07.257717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:07.281626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.282986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.284847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:07.286764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:07.288094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:07.291054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:08.148904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:08.212214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ff4a682-19e7-454a-b874-d98d9c34852b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1313 microversion: 2.1 time: 3.629950 Aug 25 13:00:08.220071 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1719/3373] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:04 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1313 bytes in 3639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:08.234118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:08.238187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:08.278125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.280939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.289414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:08.291289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:08.292690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:08.294529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.289973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.334933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.347989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.358119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d3f4212-4d1c-4a58-ab91-2e6376098840 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1799 microversion: 2.42 time: 2.114075 Aug 25 13:00:09.359239 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1655/3374] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:07 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1799 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:09.384675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d78d7bd-c2b1-4002-971f-8a84b60409e4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113451125", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "14de50d3-102a-407c-8148-0390f0ed3607", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:09.626117 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9d78d7bd-c2b1-4002-971f-8a84b60409e4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d78d7bd-c2b1-4002-971f-8a84b60409e4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 358 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113451125", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "14de50d3-102a-407c-8148-0390f0ed3607", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: exception: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1113451125', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '14de50d3-102a-407c-8148-0390f0ed3607'}], 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:09.639914 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d78d7bd-c2b1-4002-971f-8a84b60409e4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Block Device 14de50d3-102a-407c-8148-0390f0ed3607 is not bootable. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d78d7bd-c2b1-4002-971f-8a84b60409e4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.283572 Aug 25 13:00:09.649082 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1656/3375] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:00:09.658544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:09.664661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a801ba20-2b5e-4e8b-a140-fcc95e5af41f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:09.666462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:09.693139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd3dc0f2-f2d2-4087-b0a1-1c9bdf5a0865 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1506 microversion: 2.1 time: 1.470361 Aug 25 13:00:09.698012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.712165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1720/3376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:08 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1506 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:09.712165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:09.712733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:09.726897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.732454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.735739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.739813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.741160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.757723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.764780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.767638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.770268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.775187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.780266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.803487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f HTTP/1.1 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a801ba20-2b5e-4e8b-a140-fcc95e5af41f'} Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.807326 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a801ba20-2b5e-4e8b-a140-fcc95e5af41f could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:09.820651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d394922-2568-48c2-a21c-36ab484df118 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f" status: 404 len: 111 microversion: 2.1 time: 0.171960 Aug 25 13:00:09.833919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1657/3377] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:09 2022] GET /compute/v2.1/servers/a801ba20-2b5e-4e8b-a140-fcc95e5af41f => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:09.846643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:09.859421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:09.877275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.890240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.891807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:09.893266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:09.894153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:09.895258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.669037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:10.708226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-721c26f4-15ce-4adf-be4e-e94d766cf770 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1463 microversion: 2.1 time: 1.001201 Aug 25 13:00:10.710617 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1721/3378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:09 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1463 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:10.728018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:10.735542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:10.761928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.764605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.766035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.769116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:10.771215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:10.773536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:10.911330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:10.930352 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9488c81d-4c81-4334-83a3-c64f4b965720 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.094253 Aug 25 13:00:10.943213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:00:10.944234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:00:10.945219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:00:10.945703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1658/3379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:09 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:10.946211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:00:10.946949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:00:10.979037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:10.980690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:11.003776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.006175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.007401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.011166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.015908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.019229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.063574 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 HTTP/1.1 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '13b748c6-40aa-40dd-ba77-7ec6fc53c285'} Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:11.068668 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:11.080342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:11.094537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:11.098245 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-172d1bf0-1c9f-4af5-bd47-82e622d6fad6 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 404 len: 111 microversion: 2.1 time: 0.150501 Aug 25 13:00:11.104899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1659/3380] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:10 2022] DELETE /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:11.114527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:11.116474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:11.129190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:11.130728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.132094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.133319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.135034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.136406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.138222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.165710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.189070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.193103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.194625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.195725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.196362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.297764 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1242975-6838-420e-899b-133c1223bdce tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "POST /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34/action" status: 202 len: 1112 microversion: 2.1 time: 0.584533 Aug 25 13:00:11.316185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1722/3381] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:00:10 2022] POST /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34/action => generated 1112 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 13:00:11.336047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:11.337268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:11.351105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.352840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.353631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:11.354973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:11.355900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:11.356752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.110927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db70bdf9-15a1-44de-bf98-7fca813f9e09 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1616 microversion: 2.1 time: 0.792668 Aug 25 13:00:12.113261 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1723/3382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:11 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1616 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:12.120664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:12.122145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:12.149696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.151522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.153629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.155910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:12.157506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:12.158578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:12.982780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.040456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.047222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.051269 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12c212e9-1095-4f48-92ea-ea4719fed488 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1799 microversion: 2.42 time: 1.943181 Aug 25 13:00:13.053412 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1660/3383] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:11 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1799 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:13.065410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:13.070508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 13b748c6-40aa-40dd-ba77-7ec6fc53c285] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:13.088955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.091414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.092863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.096584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.097806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.098790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.134220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 HTTP/1.1 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '13b748c6-40aa-40dd-ba77-7ec6fc53c285'} Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:13.138168 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 13b748c6-40aa-40dd-ba77-7ec6fc53c285 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-70f6e391-39e7-440e-8a12-b6c01e865d0d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285" status: 404 len: 111 microversion: 2.1 time: 0.086598 Aug 25 13:00:13.150314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1661/3384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:13 2022] GET /compute/v2.1/servers/13b748c6-40aa-40dd-ba77-7ec6fc53c285 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:13.161879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:13.165729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:13.197558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.198706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.200250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.208607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.210848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.211922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.542739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.584370 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-be7e2046-9f73-43d2-92c0-00d8ebb37135 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.466250 Aug 25 13:00:13.589356 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1724/3385] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:12 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:13.611946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:13.613784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:13.639805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.640843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.645384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.649351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:13.654916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:13.656671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:13.849439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77f6b482b5784340b298a855a843f9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d9c92ddaae4ef79be3aa8602b0e933', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:13.850816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] flavor_id is None. Assuming migration. {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 13:00:13.852051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:00:14.412234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:14.454241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e97cffd-9cd4-48dc-a440-9a02e9d7e6a5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1517 microversion: 2.1 time: 1.300218 Aug 25 13:00:14.455332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1662/3386] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:13 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1517 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:14.514913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:14.515897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:14.557426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.558342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.572584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.574149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.585097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.593311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.690346 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 HTTP/1.1 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'de10e4ed-cbc9-42dd-ab1f-008225eb7811'} Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:14.702893 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:14.709032 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:14.727836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:14.730436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-033362d6-3c46-493b-8bdb-36652f37206d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 404 len: 111 microversion: 2.1 time: 0.243781 Aug 25 13:00:14.732712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1663/3387] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:14 2022] DELETE /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:14.749269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:14.774126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:14.810129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.810730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.811601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.813119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:14.829486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:14.830775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:14.983982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c983495-9e51-42a5-ad76-c060513f434c tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0/action" status: 202 len: 0 microversion: 2.1 time: 1.388083 Aug 25 13:00:14.985759 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1725/3388] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:00:13 2022] POST /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0/action => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:00:15.029797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:15.037753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: de10e4ed-cbc9-42dd-ab1f-008225eb7811] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:15.094561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:15.102680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:15.103960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:15.108003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:15.117297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:15.118718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:15.195263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 HTTP/1.1 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'de10e4ed-cbc9-42dd-ab1f-008225eb7811'} Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:15.202824 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. Aug 25 13:00:15.211533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:15.225366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance de10e4ed-cbc9-42dd-ab1f-008225eb7811 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:15.227669 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1848be4f-1f7d-4afd-afbb-69e5a0682248 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811" status: 404 len: 111 microversion: 2.1 time: 0.238801 Aug 25 13:00:15.229394 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1726/3389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:14 2022] GET /compute/v2.1/servers/de10e4ed-cbc9-42dd-ab1f-008225eb7811 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:15.251422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:15.253244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:15.282679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:15.297813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:15.305588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:15.307149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:15.308046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:15.316313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.295441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:16.346454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:16.363531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:16.366499 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77c093c2-31b9-4c24-a4ca-5f9be4567c99 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1833 microversion: 2.42 time: 1.631317 Aug 25 13:00:16.370690 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1664/3390] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:14 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1833 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:16.378704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:16.391644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:16.413821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.422676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.424176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.425855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.431218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.432750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.486837 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 HTTP/1.1 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '3c274471-1ce7-4c7f-b214-0b6054c6c030'} Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:16.499342 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.508235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.514531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:16.522557 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9227166-445c-4561-b515-2ae4f41af98a tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 404 len: 111 microversion: 2.1 time: 0.148816 Aug 25 13:00:16.524173 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1665/3391] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:16 2022] DELETE /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:16.545805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:16.552773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:16.590858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.591591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.594315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.599220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.600548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.605201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.751262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:16.786333 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-78db82f2-a0f3-439e-b42a-40c778723c18 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1472 microversion: 2.1 time: 1.551666 Aug 25 13:00:16.805591 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1727/3392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:15 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1472 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:16.831444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:16.833344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 3c274471-1ce7-4c7f-b214-0b6054c6c030] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:16.872901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.876104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.877562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.880491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:16.881928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:16.885317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:16.928019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 HTTP/1.1 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3c274471-1ce7-4c7f-b214-0b6054c6c030'} Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.932945 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. Aug 25 13:00:16.952897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:16.959164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 3c274471-1ce7-4c7f-b214-0b6054c6c030 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:16.961601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4cff82cd-cfa1-4bd3-aa61-b36898802547 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030" status: 404 len: 111 microversion: 2.1 time: 0.153894 Aug 25 13:00:16.983116 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1728/3393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:16 2022] GET /compute/v2.1/servers/3c274471-1ce7-4c7f-b214-0b6054c6c030 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:17.020193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.023256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.068871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.075594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.077270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.080986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.082994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.084578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.139350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 HTTP/1.1 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '516c777e-b658-4e2a-9d24-4901a53feea4'} Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:17.150741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.165656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:17.169485 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d32e333-5d4e-4177-b530-bb30550fe750 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 404 len: 111 microversion: 2.1 time: 0.184261 Aug 25 13:00:17.171399 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1729/3394] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:16 2022] DELETE /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:17.216695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.221065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 516c777e-b658-4e2a-9d24-4901a53feea4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.256525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:17.272099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.273724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.274994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.276830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.277897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.278945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.327837 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 HTTP/1.1 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '516c777e-b658-4e2a-9d24-4901a53feea4'} Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.332915 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 516c777e-b658-4e2a-9d24-4901a53feea4 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36d9c59c-f1e5-42c2-ad48-541b26b16650 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4" status: 404 len: 111 microversion: 2.1 time: 0.164288 Aug 25 13:00:17.350160 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1730/3395] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:17 2022] GET /compute/v2.1/servers/516c777e-b658-4e2a-9d24-4901a53feea4 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:17.364361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.366050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.383487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.386011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.387609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.389541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.392174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.393704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.441119 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 HTTP/1.1 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'a2b90470-49be-46b0-a25b-d20330f96448'} Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:17.444808 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.459837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:17.465157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bcb80ca-352b-43bf-ac8f-70119144f97f tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448" status: 404 len: 111 microversion: 2.1 time: 0.108553 Aug 25 13:00:17.467224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1731/3396] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:17 2022] DELETE /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:17.477759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.479567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.495955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.499349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.501127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.503202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.506758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.508343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.522605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:17.586580 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7905d617-d837-4964-9c13-9913cbd1c85d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1517 microversion: 2.1 time: 1.056068 Aug 25 13:00:17.590992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1666/3397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:16 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1517 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:17.604939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.607452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: a2b90470-49be-46b0-a25b-d20330f96448] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.622084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.623288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.624018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.625412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.627776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.628499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.659730 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 HTTP/1.1 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a2b90470-49be-46b0-a25b-d20330f96448'} Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.662399 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance a2b90470-49be-46b0-a25b-d20330f96448 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-359f6c2f-afe5-400b-931c-94b39cf331a2 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448" status: 404 len: 111 microversion: 2.1 time: 0.072125 Aug 25 13:00:17.677510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1667/3398] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:17 2022] GET /compute/v2.1/servers/a2b90470-49be-46b0-a25b-d20330f96448 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:17.683043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:17.684520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:17.694857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.696324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.697576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.700195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:17.701256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:17.702360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:17.767856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:00:17.953996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=68 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:18.030208 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9926be96-7aed-4081-ba37-6017c9876469 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 204 len: 0 microversion: 2.1 time: 0.355259 Aug 25 13:00:18.031314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1668/3399] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:17 2022] DELETE /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:18.044305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:18.046185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:18.059584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:18.061646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:18.062736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:18.065571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:18.066994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:18.069213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:18.706616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.766401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.778550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.781146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b7b75b0-7e37-4687-b984-0b3bd3a3a12d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1833 microversion: 2.42 time: 1.311184 Aug 25 13:00:18.795855 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1732/3400] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:17 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1833 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:18.812921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:18.822421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:18.872202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:18.873110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:18.873944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:18.875321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:18.876322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:18.877068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:18.924618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:18.968484 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e03f5586-3d66-4f51-ab51-2463e9e9306f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1472 microversion: 2.1 time: 0.925317 Aug 25 13:00:18.969716 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1669/3401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:18 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1472 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:19.003791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "c655a718-4191-4271-8b72-da916b120196"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:19.082910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.085810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.087340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:19.155296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] Creating event network-changed:c655a718-4191-4271-8b72-da916b120196 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:00:19.219168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-30e660a9-261f-466c-9cc9-6556f01e54a2 req-aba22aad-6744-42cc-959c-65458ac3ae8a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245080 Aug 25 13:00:19.220705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1670/3402] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:19.246718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:19.253371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:19.285127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.295777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.297421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:19.300973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:19.304740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:19.306143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:21.217669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:21.298395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7cc2d9b3-7552-4b4f-9556-ab9774ad90fc tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1479 microversion: 2.1 time: 2.483892 Aug 25 13:00:21.301826 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1733/3403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:18 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1479 bytes in 2505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:21.315173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-193f62c3-0585-451b-a2a8-b99b5d8a4ba0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1742861996", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "destination_type": "local"}, {"source_type": "volume", "uuid": "c58c4150-d597-4fef-9cd9-9b2f06d7483c", "destination_type": "invalid"}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-193f62c3-0585-451b-a2a8-b99b5d8a4ba0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 495 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1742861996", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "destination_type": "local"}, {"source_type": "volume", "uuid": "c58c4150-d597-4fef-9cd9-9b2f06d7483c", "destination_type": "invalid"}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1742861996', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c58c4150-d597-4fef-9cd9-9b2f06d7483c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi 'invalid' Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:21.332250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 25 13:00:21.342016 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:21.347162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-193f62c3-0585-451b-a2a8-b99b5d8a4ba0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:21.348874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-193f62c3-0585-451b-a2a8-b99b5d8a4ba0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.044502 Aug 25 13:00:21.355332 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1734/3404] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:21 2022] POST /compute/v2.1/servers => generated 155 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:00:21.364887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:21.366367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:21.380396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:21.381550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:21.382437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:21.384234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:21.385268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:21.386187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:22.306470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:22.353812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6092531a-4591-44f1-a7ef-835cc3f908ae tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1517 microversion: 2.1 time: 3.130365 Aug 25 13:00:22.358592 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1671/3405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:19 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1517 bytes in 3137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:22.370857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:22.374671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:22.410098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:22.412702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:22.414004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:22.415673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:22.417590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:22.423367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:23.478499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:23.486257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:23.510212 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb83143f-b038-4b58-8663-1f87b53aca70 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1472 microversion: 2.1 time: 1.148740 Aug 25 13:00:23.527260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:23.529651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1672/3406] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:22 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1472 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:23.536948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:23.539457 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-91447493-39e0-4390-8026-917f3ffdd9e7 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1833 microversion: 2.42 time: 2.181207 Aug 25 13:00:23.565342 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1735/3407] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:21 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1833 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:23.601918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:23.605618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:23.618192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:23.620893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:23.624049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:23.625150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:23.626343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:23.628310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:23.629968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:23.631358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:23.663349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:23.664461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:23.667414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:23.673665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:23.674490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:23.675287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:23.701452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:24.148388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:24.160970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:24.205336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f976e570-9619-4a28-8b41-66d770cf3b8b tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1437 microversion: 2.1 time: 0.633354 Aug 25 13:00:24.207057 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1736/3408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:23 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1437 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:24.234259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6", "name": "network-vif-unplugged", "status": "completed", "tag": "12dfa86c-93f8-4132-88d8-d197235d0320"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:24.296450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.296450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.296450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.343556 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] Creating event network-vif-unplugged:12dfa86c-93f8-4132-88d8-d197235d0320 for instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 on n-h1-850468-18 Aug 25 13:00:24.356704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8470b4f2-0730-49a7-8684-8f85f5b7b609 req-5dce3841-0dc1-49bb-b3c0-c902ec8a7c53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145692 Aug 25 13:00:24.357986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1737/3409] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:24.371362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:24.376410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:24.398546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.400321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.401303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:24.403840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:24.409211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:24.410599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:25.428186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:25.460172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71e66066-cc61-4429-a1db-ec112250f542 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.910668 Aug 25 13:00:25.461195 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1673/3410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:23 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:25.512483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:25.514120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:25.525805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:25.527058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:25.530166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:25.532152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:25.533275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:25.534338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:25.990184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:26.014237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cac76957-d6e4-45b4-8c7a-e5bf690f1527 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1517 microversion: 2.1 time: 1.653446 Aug 25 13:00:26.016668 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1738/3411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:24 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1517 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:26.031629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:26.033752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:26.048583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:26.050756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:26.052442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:26.054608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:26.055615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:26.056798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.428683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:27.478121 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db3cfb38-4353-4b8c-a8ec-56b6075058c9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1472 microversion: 2.1 time: 1.982525 Aug 25 13:00:27.479461 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1674/3412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:25 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1472 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:27.502575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "252b1902-0e99-4869-88f0-e2932be678d4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:27.561847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.563159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.568493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.610626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] Creating event network-changed:252b1902-0e99-4869-88f0-e2932be678d4 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:00:27.624796 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-daf525a9-1080-4473-b325-252f85624f99 req-bd5e65dd-0d34-433c-8831-b7144d3e0a17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130059 Aug 25 13:00:27.627515 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1675/3413] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:27.643796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:27.646038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:27.673085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.674403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.675584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.677476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.680099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.681171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.755028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:27.756499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:27.757762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:27.758901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lazy-loading 'fault' on Instance uuid 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:00:27.897150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879716a40c8f4d1b9ee3716a9f7b4048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615a6fd5f398400693b7d6c5f584135a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:27.932536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e7ec2122-be58-4797-8e1b-a8180509a721 tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 200 len: 1283 microversion: 2.1 time: 0.302260 Aug 25 13:00:27.950587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1676/3414] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:27 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 1283 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:27.971406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:27.973254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:28.012543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:28.013387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:28.020969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:28.022361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:28.025617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:28.026559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:28.586383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:28.608635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:28.612652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:28.615870 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ce0a428-a2b5-452c-88da-fc5b1995ad48 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1854 microversion: 2.42 time: 2.595253 Aug 25 13:00:28.629192 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1739/3415] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:26 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1854 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:28.662586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:28.664518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:28.686694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:28.693910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:28.699478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:28.699478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:28.701713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:28.705002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:29.394043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:29.436840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4eefbbbe-5fd5-481c-90aa-91dc1bc84d15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.488979 Aug 25 13:00:29.437847 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1677/3416] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:27 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:29.466428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:29.472339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:29.499867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:29.508162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:29.519380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:29.520995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:29.521860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:29.526909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.332446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:30.352490 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3b5be33-5a3f-4982-8ef3-8be6a102cea1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1523 microversion: 2.1 time: 1.720747 Aug 25 13:00:30.369802 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1740/3417] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:28 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1523 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:30.404287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:30.405777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] [instance: 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:30.435464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.439007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.443928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.445941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.448814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.453197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.502333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:30.527272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] HTTP exception thrown: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. Aug 25 13:00:30.557355 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17c1fe84-f55f-4ba4-9398-f2cad99884db tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1477 microversion: 2.1 time: 1.114355 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Request method failure captured: Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 HTTP/1.1 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Bupgqc1j9NZ8tNZDprAgn0NnDSze6B8ekscDWItkqFr4tmmfxF7e69y0TKU3efq9_UsrzkM6h8MaQF0usoGXnrquaebfZ1OpZNGUq34Bwg2gOSYFS2lBJJqyQfraDxg9QPhp_uH0V47RcMVt0tMRW0i4ZruB5YI2zbgzV8NZLUmtw Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/615a6fd5f398400693b7d6c5f584135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersTestJSON-493604338 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 615a6fd5f398400693b7d6c5f584135a Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersTestJSON-493604338 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersTestJSON-493604338-project Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 879716a40c8f4d1b9ee3716a9f7b4048 Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersTestJSON-493604338-project Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6'} Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.557657 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] Returning 404 to user: Instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a09b71a1-45b9-4ca9-8ac8-a8a298fced9d tempest-ServersTestJSON-493604338 tempest-ServersTestJSON-493604338-project] 10.222.0.60 "GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6" status: 404 len: 111 microversion: 2.1 time: 0.182582 Aug 25 13:00:30.578629 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1741/3418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:30 2022] GET /compute/v2.1/servers/2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:00:30.581519 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1678/3419] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:29 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1477 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:30.597420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de314-a97e-44b0-80ce-8e6781033b34", "name": "network-vif-unplugged", "status": "completed", "tag": "7dfb54c0-57ed-4c92-8a06-faefc4d7cffa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:30.599878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:30.601996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:30.617456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.618515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.619612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.628567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.629460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.630230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.631732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.636393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.637892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.645087 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] Creating event network-vif-unplugged:7dfb54c0-57ed-4c92-8a06-faefc4d7cffa for instance 9f0de314-a97e-44b0-80ce-8e6781033b34 on n-h1-850468-18 Aug 25 13:00:30.656611 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-db44f006-a011-45b8-bd10-936b33e29991 req-e6ef7e17-f4e6-45d5-b70b-1c1a301c86e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081216 Aug 25 13:00:30.658202 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1679/3420] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:30.669810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df73c43d-d92b-475d-9bf5-55412a271520 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561889714", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df73c43d-d92b-475d-9bf5-55412a271520 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 492 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561889714", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1561889714', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.677410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df73c43d-d92b-475d-9bf5-55412a271520 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df73c43d-d92b-475d-9bf5-55412a271520 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019675 Aug 25 13:00:30.688180 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1680/3421] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:00:30.702754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6", "name": "network-vif-deleted", "tag": "12dfa86c-93f8-4132-88d8-d197235d0320"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:30.719958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.722804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.723461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.780728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] Creating event network-vif-deleted:12dfa86c-93f8-4132-88d8-d197235d0320 for instance 2eb6cd9a-0e50-41dc-a0d1-b64d353e65e6 on n-h1-850468-18 Aug 25 13:00:30.817747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f4ae1eac-f37b-4002-bcdf-c568d4885874 req-13e71be2-3675-49aa-8731-2892f35c33cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129614 Aug 25 13:00:30.823718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1681/3422] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:30.850162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:30.855210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:30.900921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.906259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.909929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:30.917522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:30.924436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:30.927524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:31.651752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:31.694688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:31.701422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:31.704212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-87193977-10c3-473d-872d-1d09d60101b6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.130352 Aug 25 13:00:31.705751 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1742/3423] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:30 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:32.063757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:32.092322 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a83218a-e2bb-44a0-8c36-2101d8639035 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.264116 Aug 25 13:00:32.099451 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1682/3424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:30 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:32.115958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:32.124715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:32.169774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:32.177619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:32.179918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:32.200350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:32.201296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:32.202161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:32.407403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-98b8f6e9-11b5-4a2f-9e24-23557232635c tempest-ExtensionsTest-1679884573 tempest-ExtensionsTest-1679884573-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:32.415151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-98b8f6e9-11b5-4a2f-9e24-23557232635c tempest-ExtensionsTest-1679884573 tempest-ExtensionsTest-1679884573-project] 10.222.0.60 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.706241 Aug 25 13:00:32.424327 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1743/3425] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 13:00:31 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:32.432643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:32.437394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:32.449852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:32.452773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:32.453890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:32.455575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:32.456971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:32.457901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:33.272563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:33.289399 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ddc37ee-6a2c-4237-a170-f036aced33ff tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1523 microversion: 2.1 time: 1.187593 Aug 25 13:00:33.291724 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1683/3426] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:32 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1523 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:33.302146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:33.304004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:33.319119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:33.320654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:33.322162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:33.324043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:33.325998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:33.327199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:33.358539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:33.389352 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25dfd7ac-926b-416d-ba4f-bab3b955eceb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1477 microversion: 2.1 time: 0.967143 Aug 25 13:00:33.390453 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1744/3427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:32 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1477 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:33.417299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a124860-42a0-4c0c-902c-0f9ae3b4c983 tempest-ExtensionsTest-1679884573 tempest-ExtensionsTest-1679884573-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:33.422873 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a124860-42a0-4c0c-902c-0f9ae3b4c983 tempest-ExtensionsTest-1679884573 tempest-ExtensionsTest-1679884573-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.026892 Aug 25 13:00:33.437401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1745/3428] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 25 13:00:33 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:00:33.460691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:33.462222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:33.487831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:33.489709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:33.493660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:33.500169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:33.502495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:33.503725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.499866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:34.521666 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b865834e-8f9a-4349-b72d-f8855b9b0022 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.227276 Aug 25 13:00:34.548781 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1684/3429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:33 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:34.572151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "b2cb2cb6-0a37-461c-b67c-d35a7d61d27d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:34.610415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.611760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.613214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.642744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:34.659947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] Creating event network-changed:b2cb2cb6-0a37-461c-b67c-d35a7d61d27d for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:00:34.672326 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a64f7efc-763c-40c8-b418-edc25d9fb614 req-3569a220-f1f3-4236-b865-e93979c66047 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120489 Aug 25 13:00:34.674072 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1685/3430] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:34.685623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.687884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:34.700814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:34.708286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.709878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.712935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.714805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.717200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.718662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.723748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:34.726407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32035509-5e6c-4c4f-a9aa-3c42c1be83ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.286618 Aug 25 13:00:34.737012 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1746/3431] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:33 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:34.770979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:34.776735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:34.816866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.820368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.823921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:34.833514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:34.835263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:34.838995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.378763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:36.404496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e40e7ce-f0f9-43aa-aa28-244f49529281 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1523 microversion: 2.1 time: 1.727310 Aug 25 13:00:36.407902 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1686/3432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:34 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1523 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:36.419132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de314-a97e-44b0-80ce-8e6781033b34", "name": "network-vif-plugged", "status": "completed", "tag": "7dfb54c0-57ed-4c92-8a06-faefc4d7cffa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.454144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.455435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.456316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.486057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] Creating event network-vif-plugged:7dfb54c0-57ed-4c92-8a06-faefc4d7cffa for instance 9f0de314-a97e-44b0-80ce-8e6781033b34 on n-h1-850468-18 Aug 25 13:00:36.503188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3dade951-1832-45b6-8ff9-ba9f47efe9a7 req-b1ca1637-67f8-4898-9602-6d7ad4934732 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091678 Aug 25 13:00:36.506409 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1687/3433] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:36.528953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5b135f8-9a74-4742-a10c-2fe1fe78023c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5b135f8-9a74-4742-a10c-2fe1fe78023c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 416 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.539242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:00:36.546963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5b135f8-9a74-4742-a10c-2fe1fe78023c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:36.562197 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a5b135f8-9a74-4742-a10c-2fe1fe78023c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.051456 Aug 25 13:00:36.563602 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1688/3434] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:36 2022] POST /compute/v2.1/servers => generated 619 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:00:36.583122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:36.589162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:36.612359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.613682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.614898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.616672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.617277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:36.618893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.619972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.644990 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29784987-b079-4be6-93b9-4f8ffc8382d2 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1477 microversion: 2.1 time: 1.905189 Aug 25 13:00:36.649224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1747/3435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:34 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1477 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:36.666331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:36.667295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:36.692662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.693516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.697384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:36.702121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:36.703114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:36.704160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.530923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:38.552396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8f7c24e-54da-417b-9b9f-d52d0c69bf25 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.900243 Aug 25 13:00:38.575703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1748/3436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:36 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:38.594248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:38.608493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.610842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:38.627866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.629996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.631200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.632374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:38.633256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.634454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.635673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.639450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:38.655785 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b82dbd2-0e5e-40c2-8f39-6c830dc1e449 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.086976 Aug 25 13:00:38.657472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1689/3437] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:36 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:38.666921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "85bc99ed-6e9f-4d33-afb7-bdf6f332bf93"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:38.699921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.709129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.713789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.764704 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] Creating event network-changed:85bc99ed-6e9f-4d33-afb7-bdf6f332bf93 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:00:38.775681 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f213f2fc-24b3-4621-937c-84b9e856a708 req-61daef95-be3c-4b71-a7f7-22444c0daabd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115552 Aug 25 13:00:38.780823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1690/3438] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:38.803287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:38.804454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:38.829444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.830135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.830948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:38.832458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:38.833159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:38.833808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:40.808976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:40.869843 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e2c47203-bc02-4cc0-9410-f58e9cdcbf4d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1523 microversion: 2.1 time: 2.288046 Aug 25 13:00:40.873989 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1749/3439] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:38 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1523 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:40.900090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:40.906507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:40.935858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:40.942780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:40.943688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:40.945068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:40.952564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:40.953759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.238677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:41.292286 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1521d028-8cc0-4cf3-b2e3-ee0998e85043 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1477 microversion: 2.1 time: 2.506379 Aug 25 13:00:41.299501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1691/3440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:38 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1477 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:41.315020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:41.320610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:41.345727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.347658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.349068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:41.355922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:41.357671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:41.359389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:43.797271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:43.847616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.967708 Aug 25 13:00:43.889646 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1750/3441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:40 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:43.919904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:43.922112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ed7d068-4f85-42fb-9b8b-e7634447cb49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.018262 Aug 25 13:00:43.940501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1751/3442] 10.222.0.60 () {56 vars in 886 bytes} [Thu Aug 25 13:00:43 2022] GET /compute/ => generated 377 bytes in 50 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 13:00:43.978862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:43.982038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:44.015786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.017348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.019162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.023112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.032162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.033766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.257748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:44.320849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:44.327514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:44.335602 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b359d30d-12ab-466f-b35b-2fb991ff0f1a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 3.032501 Aug 25 13:00:44.341078 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1692/3443] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:41 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:44.358902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:44.360215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:44.391154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.392194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.393027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:44.397284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:44.398262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:44.401730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.160362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:46.194022 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1508 microversion: 2.1 time: 2.251382 Aug 25 13:00:46.208708 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1752/3444] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:43 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1508 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:46.224229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:46.224557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:46.234034 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-551caec7-37da-4f21-af1d-58af344d70e9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.016905 Aug 25 13:00:46.235506 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1753/3445] 10.222.0.60 () {54 vars in 1035 bytes} [Thu Aug 25 13:00:46 2022] GET /compute/v2/ => generated 379 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 25 13:00:46.251458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b15544a-1a68-437c-92b2-f6c724f60b3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1921956129", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": -1, "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:46.253979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-555bf685-4517-4b47-acd2-acaa0c0f2d0b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1476 microversion: 2.1 time: 1.910503 Aug 25 13:00:46.269077 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1693/3446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:44 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1476 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:46.295390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:46.300661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:46.316793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2b15544a-1a68-437c-92b2-f6c724f60b3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Flavor -1 could not be found. Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b15544a-1a68-437c-92b2-f6c724f60b3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 206 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1921956129", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": -1, "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: exception: Flavor -1 could not be found. Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1921956129', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': -1, 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:46.321202 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 25 13:00:46.333070 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.340195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.341664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b15544a-1a68-437c-92b2-f6c724f60b3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:00:46.341664 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b15544a-1a68-437c-92b2-f6c724f60b3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.100128 Aug 25 13:00:46.351959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1754/3447] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:46 2022] POST /compute/v2.1/servers => generated 73 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:00:46.368597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:46.370208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:46.395834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.399266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.401277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:46.404357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:46.406357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:46.409143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.667549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:48.710018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:48.757754 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 200 len: 1508 microversion: 2.1 time: 2.402681 Aug 25 13:00:48.759879 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1755/3448] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:46 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 1508 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:48.760197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:48.763790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:48.766203 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f446d825-2d52-4b1e-90fc-9f60372c7dd9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003137 Aug 25 13:00:48.767487 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1756/3449] 10.222.0.60 () {54 vars in 1041 bytes} [Thu Aug 25 13:00:48 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:48.767961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:48.771078 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b52bcdd5-296f-4209-b961-b98b2646c5f2 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.499479 Aug 25 13:00:48.784174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1694/3450] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:46 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:48.796037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:48.797194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:48.797882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:48.799866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:48.811607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=42 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:48.813941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:48.816578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.817623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.818617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.819037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.819514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.821110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.821529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.822504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.823624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.824586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:48.826046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:48.827035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:48.908668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:50.057010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:50.087382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ba6845c-85d6-4f46-a60b-f9a1fc38f2c3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1476 microversion: 2.1 time: 1.312662 Aug 25 13:00:50.100270 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1695/3451] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:48 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1476 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:50.100270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "ed72a143-bd9e-4526-ac8f-126ba31d5063"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:50.120513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.141752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.143012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.193436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Creating event network-changed:ed72a143-bd9e-4526-ac8f-126ba31d5063 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:00:50.209599 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114943 Aug 25 13:00:50.212273 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1696/3452] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:50.216301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:50.219609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8340c43f-342f-409d-b112-135adfe9ac51 req-9f2457fb-a52d-4e57-b277-9de63e03a97e service nova] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003421 Aug 25 13:00:50.235011 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1697/3453] 10.222.0.60 () {56 vars in 886 bytes} [Thu Aug 25 13:00:50 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 13:00:50.298464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:50.304432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:50.334782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.335844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.341722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.342974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.344264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:50.345414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:50.471678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:00:50.805308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:50.843348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c975372f-eaf7-4db0-ad5f-8e74b3408e56 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.069915 Aug 25 13:00:50.845002 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1757/3454] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:48 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:50.931246 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce06f515-8870-4a58-abcc-991f921c52a7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 204 len: 0 microversion: 2.1 time: 0.663626 Aug 25 13:00:50.937425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1698/3455] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:00:50 2022] DELETE /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:00:50.977632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:50.982469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:50.998016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:50.999531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.001151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.003629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:51.005178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:51.015797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:51.900078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac2d8700-1011-4fc8-b670-c0a9d7611f07 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: .version_select at 0x7fc6c6c313a0>, body: {"keypair": {"name": "tempest-keypair-665572577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvGvseA3a8lQMyqBiN70FtSBpj/gNYOuG1Q2yZofw7+qRH3Kb6p6al7f6cDBiPff6HRa3NvH8WtkWMjUZRC3qQD/zWYK99Kbj8x/Upc/V1ox5zOCZZyS4FDcz56l1RKkw=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:51.989872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ac2d8700-1011-4fc8-b670-c0a9d7611f07 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for project 47d8604d32274a42923d8304d5b191b8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:00:52.019599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ac2d8700-1011-4fc8-b670-c0a9d7611f07 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for user f58d37ebb4c1469fb8bb4973a8bcb602 and project 47d8604d32274a42923d8304d5b191b8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:00:52.126019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac2d8700-1011-4fc8-b670-c0a9d7611f07 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.278432 Aug 25 13:00:52.142016 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1758/3456] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:00:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:52.154281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:52.156516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:52.170707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:52.171707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:52.172579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:52.174257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:52.176447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:52.177996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:52.583286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:52.624745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:52.633814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:52.636300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-94de9fab-859a-4f38-a68e-ccb6b4666eab tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.692360 Aug 25 13:00:52.656247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1699/3457] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:50 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:52.669345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:52.669345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:52.698266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:52.702065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:52.704753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:52.708055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:52.710876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:52.711685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:54.530248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:54.551507 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72ef6d21-84e4-4ca8-9b1d-6004c55c7497 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1476 microversion: 2.1 time: 1.905124 Aug 25 13:00:54.571204 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1700/3458] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:52 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1476 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:54.600558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-408223442", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:54.795210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] validate_networks() for [('0025ebf2-8a1d-4c23-92c6-d85fe3c6bc78', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:00:56.441021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:56.478901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=87 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:00:56.486967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1dc9f555-bcd2-44d9-ae66-4c0d4d4418cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 4.342282 Aug 25 13:00:56.490330 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1759/3459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:52 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 4347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:00:56.506586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:00:56.541800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.544054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.545854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:56.651685 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Creating event network-vif-unplugged:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h2-850468-18 Aug 25 13:00:56.686584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] Instance 78c11d77-5389-42bc-b014-56f64feef1c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:00:56.757788 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fa43781a-3773-4a55-83e9-2d945d438fb7 req-289fe010-b1b2-4015-95b5-2287624284ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.264092 Aug 25 13:00:56.760982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1760/3460] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:00:56.800680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:56.808808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:56.862111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.863920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.865342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:56.875352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:56.880677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:56.881932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:58.445216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:58.487631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:58.504806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:00:58.511682 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89ceca79-460f-4630-bae5-73ed0ae8aaa6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.741156 Aug 25 13:00:58.519808 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1761/3461] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:00:56 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:00:58.549416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:00:58.551500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:00:58.569163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:58.573632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:58.580462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:58.582242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:00:58.583988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:00:58.585416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:00:59.979270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:00:59.980833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:00:59.981071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:00:59.981667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:00:59.982730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:01:00.005069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.013795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.015647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.017742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.023708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.025356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.116715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:00.129080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Getting quotas for user b39d94a9d13d4b739e36f862de62d064 and project 95c52805bbc04e419917f2b94a472a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:00.166400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:01:00.174306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:01:00.360988 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f455865b-43ee-44b7-8665-4e5f7dd62261 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.786817 Aug 25 13:01:00.362667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1701/3462] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 5790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:01:00.377238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:00.389434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0de314-a97e-44b0-80ce-8e6781033b34", "name": "network-vif-deleted", "tag": "7dfb54c0-57ed-4c92-8a06-faefc4d7cffa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:00.421062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.422544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.423744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.441723 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3137f581-eff0-4fa3-ba85-cb07fa6c1b71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1476 microversion: 2.1 time: 1.915785 Aug 25 13:01:00.443236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1762/3463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:00:58 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1476 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:00.500679 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] Creating event network-vif-deleted:7dfb54c0-57ed-4c92-8a06-faefc4d7cffa for instance 9f0de314-a97e-44b0-80ce-8e6781033b34 on n-h1-850468-18 Aug 25 13:01:00.502768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9bfc8949-6e4f-4b63-a3d3-92a981221e89 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1819661982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:00.528675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-598e9b22-1cc6-4444-a63c-1cb0c4d4983b req-a309cc07-31d2-44a7-8ebd-5a9deef0bfc0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151210 Aug 25 13:01:00.534381 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1702/3464] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9bfc8949-6e4f-4b63-a3d3-92a981221e89 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 173 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1819661982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1819661982', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi -1 Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:01:00.536707 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 25 13:01:00.558701 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:00.568357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9bfc8949-6e4f-4b63-a3d3-92a981221e89 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:00.573098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9bfc8949-6e4f-4b63-a3d3-92a981221e89 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.107655 Aug 25 13:01:00.573729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}, {"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "f834b6d9-f32a-4d42-9471-72f10e77b454"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:00.578784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1763/3465] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:00 2022] POST /compute/v2.1/servers => generated 145 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:01:00.610563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:00.622146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:00.633775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.634368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.635218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.646746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.647682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.648811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.650503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:00.651948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:00.653926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:00.694132 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Creating event network-changed:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h2-850468-18 Aug 25 13:01:00.705462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Creating event network-changed:f834b6d9-f32a-4d42-9471-72f10e77b454 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:01:00.722696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] Instance 78c11d77-5389-42bc-b014-56f64feef1c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:01:00.791710 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5c0357bb-b1ae-46b2-97f5-f8473b73a5f7 req-ef18eadb-8d99-4e81-923b-e12478d96cdb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.253199 Aug 25 13:01:00.795221 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1703/3466] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:00.823583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5aa70020-5767-4d51-ae2a-2eb7f0b87727 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:00.825148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5aa70020-5767-4d51-ae2a-2eb7f0b87727 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:01.639836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5aa70020-5767-4d51-ae2a-2eb7f0b87727 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:01.681603 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5aa70020-5767-4d51-ae2a-2eb7f0b87727 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1217 microversion: 2.1 time: 0.866571 Aug 25 13:01:01.688871 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1704/3467] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:00 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1217 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:01.725568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:01.730096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:01.766351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:01.767041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:01.773359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:01.774760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:01.775699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:01.777940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:02.059726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:03.825406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:03.872326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:03.887132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:03.912687 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7076882f-a438-4b30-88ca-6507d61b4e4d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 3.328185 Aug 25 13:01:03.924999 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1764/3468] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:00 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 3344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:03.973043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:03.976262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:04.025360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.029264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.037492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.052010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.057745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.067693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.235741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:04.263961 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed639f96-9b7c-450c-b34e-f136eab5ec40 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.572776 Aug 25 13:01:04.269767 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1705/3469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:01 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:04.289641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:04.291221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:04.325750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.328314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.329640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.343595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.344921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.346063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.696211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:04.721789 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81936325-2c0f-4fa1-9d49-0f663745d479 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1287 microversion: 2.1 time: 0.449723 Aug 25 13:01:04.738092 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1706/3470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:04 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1287 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:04.771105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:04.781009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:04.804612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.808455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.812608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:04.815089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:04.819163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:04.824296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:06.590494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:06.622602 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fce000b4-02b4-4fcf-a898-c878d3f322bc tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1471 microversion: 2.1 time: 2.694643 Aug 25 13:01:06.630081 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1765/3471] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:03 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1471 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:06.654045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:06.669496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:06.697108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:06.705503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:06.707452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:06.712976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:06.714178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:06.715423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:07.617038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:07.662781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da993fa2-77f7-42a5-921c-9bd3ac00fb91 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.918253 Aug 25 13:01:07.687107 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1707/3472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:04 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:07.730519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:07.732810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:07.758994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:07.760934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:07.762691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:07.785237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:07.789409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:07.793792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.265518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:08.316102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e891cb24-4e87-45c4-8eec-d7883613a4ee tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1275 microversion: 2.1 time: 0.625908 Aug 25 13:01:08.325129 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1708/3473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:07 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1275 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:08.354058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:08.357285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:08.384760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:08.400074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.401469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.403779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.406810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.427719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.433515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.445946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:08.456253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:08.464307 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f816d2fe-4da1-484e-95b0-8ed82d5786f9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.831442 Aug 25 13:01:08.473498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1766/3474] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:06 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:08.493619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47cb7b57-4fec-4263-9605-eb9350e94aff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-899499135", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:08.524970 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-47cb7b57-4fec-4263-9605-eb9350e94aff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47cb7b57-4fec-4263-9605-eb9350e94aff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 215 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-899499135", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-899499135', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:08.536261 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 25 13:01:08.548413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:08.550455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47cb7b57-4fec-4263-9605-eb9350e94aff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:08.552704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47cb7b57-4fec-4263-9605-eb9350e94aff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.075608 Aug 25 13:01:08.554951 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1767/3475] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:08 2022] POST /compute/v2.1/servers => generated 123 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:01:08.596571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-plugged", "status": "completed", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:08.648520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.653653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.656645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.696262 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Creating event network-vif-plugged:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h2-850468-18 Aug 25 13:01:08.712670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] Instance 78c11d77-5389-42bc-b014-56f64feef1c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:01:08.752274 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4f32e307-007a-4eb3-9d64-a8333f8afa62 req-87c2a878-4bbb-4f49-9073-24e413d3936d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192905 Aug 25 13:01:08.755622 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1768/3476] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:08.788394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "87500e7b-53b3-44a8-a014-2dcec34ef03e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:08.845646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de08013d-bdfb-475e-8b80-636fcf005662 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "POST /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0/action" status: 202 len: 0 microversion: 2.1 time: 0.516356 Aug 25 13:01:08.847253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.850412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.854572 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1709/3477] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:01:08 2022] POST /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:01:08.855367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.867675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:08.880952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:08.898775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.901100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.903996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.907343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.908950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.910169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.926910 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] Creating event network-changed:87500e7b-53b3-44a8-a014-2dcec34ef03e for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:01:08.947537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a60757b5-bfc0-425e-9086-ec708b2495d0 req-bbe06e68-2fe5-45af-9fee-2b788a8e05bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189646 Aug 25 13:01:08.951197 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1769/3478] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:08.967833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:08.971755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:08.991480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:08.993242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:08.994591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:08.999512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:09.001027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:09.003496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:09.982655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:10.034363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-066baec2-0eac-40ff-906b-3280eaa24cea tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 1.080152 Aug 25 13:01:10.040223 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1770/3479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:08 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:10.057610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:10.063651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:10.067776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:10.098249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.102824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.103905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:10.108554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.113150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.114250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:10.248946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:10.327151 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da62a381-a252-4712-a281-de6a9cb2863a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.465270 Aug 25 13:01:10.329518 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1710/3480] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:08 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:10.383294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:10.384594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:10.413144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.414594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.416390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:10.417536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:10.420291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:10.421426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:11.297633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:11.339636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12a2f228-0114-42da-bf68-54963e8009d7 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1317 microversion: 2.1 time: 1.290261 Aug 25 13:01:11.361061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1771/3481] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:10 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1317 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:11.372899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-335090363", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afca0aa-c188-40d8-babd-39bb18190633"}], "security_groups": [{"name": "tempest-securitygroup--770139624"}], "key_name": "tempest-keypair-665572577", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:11.648937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:11.955916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:12.011319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:12.022914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:12.025450 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a2b2b95-f214-4806-b834-31b84ae7320a tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.680412 Aug 25 13:01:12.026510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1711/3482] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:10 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:12.051498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:12.052968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] validate_networks() for [('5afca0aa-c188-40d8-babd-39bb18190633', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:01:12.058859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:12.085484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:12.086545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:12.087438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:12.096372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:12.097999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:12.103325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:13.063421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:13.089006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:13.096865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38f26c87-af13-4b4d-8f9a-99fc28a9095e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.065527 Aug 25 13:01:13.107899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1712/3483] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:12 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:13.142433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:13.144421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:13.172864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:13.175338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:13.176277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:13.177781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:13.179141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:13.179951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:14.591674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:14.618339 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1679736d-d53e-49f2-9db5-48fc4f1d0c71 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 1.504770 Aug 25 13:01:14.630750 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1713/3484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:13 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:14.642104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:14.643074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:14.674418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:14.675371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:14.678241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:14.680454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:14.685705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:14.686547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.019149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:16.074002 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-80925113-cde8-4f3d-9919-672d498c8a57 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1317 microversion: 2.1 time: 1.437135 Aug 25 13:01:16.078040 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1714/3485] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:14 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1317 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:16.106705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:16.111716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:16.142674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.149620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.152514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.158466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.161574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.165360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.625206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:01:16.626104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:01:16.627046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:01:16.628086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:01:16.629697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:01:16.678517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.687682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.688724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.690255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:16.691131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:16.691940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:16.787980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for project 47d8604d32274a42923d8304d5b191b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:16.827461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for user f58d37ebb4c1469fb8bb4973a8bcb602 and project 47d8604d32274a42923d8304d5b191b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:16.869101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:01:16.879233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:01:17.085892 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fe20776-d5ed-4a28-a6b7-090a62486edb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.722454 Aug 25 13:01:17.090191 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1772/3486] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 5729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:01:17.115412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1262531556", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-key-1175327866", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:17.452729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] validate_networks() for [('54e5edae-5404-46de-ad4a-66afd3679592', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:01:18.207541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:18.255940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:18.259740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:18.263452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-82843b84-f10f-40fa-909c-1b8254d790ed tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.179988 Aug 25 13:01:18.281356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1715/3487] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:16 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:18.307508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e4b51c-114a-42e8-a402-7e908ec7406a", "tag": "3a160063-79b5-4553-ac40-b07218cd1d3c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:18.332179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:18.333548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:18.335053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:19.026099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] Creating event network-changed:3a160063-79b5-4553-ac40-b07218cd1d3c for instance 06e4b51c-114a-42e8-a402-7e908ec7406a on n-h1-850468-18 Aug 25 13:01:19.044632 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-dbef55e9-ee64-4173-aa3f-41b8abe233a6 req-bec9bdf9-1488-4c80-a0de-d5209cee37a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.759437 Aug 25 13:01:19.051757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1716/3488] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:19.083643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:19.087250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:19.097658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:19.101198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:19.102049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:19.102812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:19.104061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:19.105963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:19.107234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:19.286976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:19.308549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Invalid key_name provided. Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 247 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1262531556", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-key-1175327866", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid key_name provided. Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1262531556', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'key_name': 'tempest-key-1175327866', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1175327866 not found for user ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:19.335431 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 25 13:01:19.345025 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:19.365953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid key_name provided. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:19.371969 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e30fca3-0d22-498a-82c9-37bfe186474e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 2.273632 Aug 25 13:01:19.391953 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1773/3489] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:17 2022] POST /compute/v2.1/servers => generated 70 bytes in 2295 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:01:19.414052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:19.416040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:19.450097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:19.456717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:19.458040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:19.464383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:19.466008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:19.467533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.345006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:20.379949 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8e8487b-5627-41ac-b2a3-ab00750fe4f1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1240 microversion: 2.1 time: 0.983136 Aug 25 13:01:20.384310 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1774/3490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:19 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1240 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:20.396569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:20.399184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:20.436780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.439824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.445768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:20.451936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:20.453890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:20.455316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:22.329231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:22.358277 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b925c327-e159-4330-8f4a-3dd0f48c2b8a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 3.300961 Aug 25 13:01:22.362424 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1717/3491] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:19 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 3308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:22.375089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:22.379085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:22.396861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:22.398062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:22.399780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:22.401358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:22.402623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:22.404060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:22.515587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:22.538179 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b5c66fe-7234-4613-a287-ce14740c3ce5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1317 microversion: 2.1 time: 2.147794 Aug 25 13:01:22.538179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1775/3492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:20 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1317 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:22.552502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:22.554314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:22.569650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:22.570519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:22.572079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:22.574558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:22.576035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:22.580473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:24.205225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:24.241516 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-973d516d-15cb-4d6e-85d5-690a7ebd4d57 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.703850 Aug 25 13:01:24.247866 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1776/3493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:22 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:24.257315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:24.258633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:24.289305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:24.329568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:24.330713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:24.331523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:24.333099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:24.334003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:24.334793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:24.362130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:24.378565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:24.380893 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b51cdf6d-42b0-4325-b69d-0d4dbbd45a96 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.018188 Aug 25 13:01:24.393944 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1718/3494] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:22 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:24.417045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:24.520507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:24.521543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:24.528192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:24.602273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Creating event network-vif-unplugged:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 13:01:24.634280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] Instance 78c11d77-5389-42bc-b014-56f64feef1c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:01:24.700271 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4ee929a8-f5bb-4b9b-9eec-28ae464215b5 req-563271ba-3d58-48a1-a05f-ab7285115334 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.308946 Aug 25 13:01:24.701627 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1719/3495] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:24.718214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:24.730057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:24.760153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:24.762040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:24.763243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:24.764788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:24.765980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:24.766812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:25.145819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:25.198478 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23c57079-9c59-4ca3-9d09-dce4b3efe9ae tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1294 microversion: 2.1 time: 0.944017 Aug 25 13:01:25.200026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1777/3496] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:24 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1294 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:25.222437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:25.223626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:25.301818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:25.312396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:25.315703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:25.319893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:25.324319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:25.328206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:26.743924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:26.845053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:27.695448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:27.721340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6939f360-295b-48c7-98e3-1e72ae450052 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 3.017382 Aug 25 13:01:27.733778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1720/3497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:24 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 3031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:27.748564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:27.750465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:27.768416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.770047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.771411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:27.773738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.775947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.779334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:27.867768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:27.885217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=84 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:27.892216 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ecf3c169-c620-4f84-840b-e5a7afae8ff1 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1317 microversion: 2.1 time: 2.686744 Aug 25 13:01:27.909006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1778/3498] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:25 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1317 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:27.939663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:27.942073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:27.960104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.961840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.963039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:27.966306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:27.967493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:27.968591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.652725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:29.685083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:29.690373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cf67418-9aa8-4b45-be44-e157fb941b65 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.945049 Aug 25 13:01:29.697114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1721/3499] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:27 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:29.723839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:29.725971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:29.731825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:29.750414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:29.762284 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b514497-e308-46f1-aee3-9376b838f659 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.843784 Aug 25 13:01:29.764883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1779/3500] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:27 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:29.768379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:29.780918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:29.782479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.787683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:29.788784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:29.792261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.800277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e4b51c-114a-42e8-a402-7e908ec7406a", "name": "network-vif-plugged", "status": "completed", "tag": "3a160063-79b5-4553-ac40-b07218cd1d3c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:29.850538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:29.863166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:29.865868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:29.927797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] Creating event network-vif-plugged:3a160063-79b5-4553-ac40-b07218cd1d3c for instance 06e4b51c-114a-42e8-a402-7e908ec7406a on n-h1-850468-18 Aug 25 13:01:29.952700 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1523a2ad-a69d-4687-bde2-36edf446f1a7 req-b9f00832-8e24-4e8c-91a7-06f215086414 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181752 Aug 25 13:01:29.959960 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1780/3501] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:29.977051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:29.980431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:29.998732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.000728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.002178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:30.003446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.004324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.007947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:30.309845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:30.342373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b2fd0e4f-eb1b-44c5-bbcd-82317015af72 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1294 microversion: 2.1 time: 0.642557 Aug 25 13:01:30.343729 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1722/3502] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:29 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1294 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:30.353311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:30.355475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:30.372931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.375437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.376388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:30.379001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:30.380592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:30.382208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:31.220898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:31.241344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62e70b42-4fb7-4776-9cdf-a6317eb8091f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 1.279161 Aug 25 13:01:31.243011 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1781/3503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:29 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:31.284245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:31.299346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:31.316368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.317423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.318341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:31.336215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b16ce4cc-14e2-430c-a991-aaddf0e10971 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1317 microversion: 2.1 time: 0.973086 Aug 25 13:01:31.340137 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1723/3504] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:30 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:31.363400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-924789005", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:31.379272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Creating event network-changed:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 13:01:31.411987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] Instance 78c11d77-5389-42bc-b014-56f64feef1c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:01:31.476175 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f22ad2d2-43a7-4401-9ae6-5134e667d14d req-3df85bba-873f-4a4a-8310-782da3868868 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211024 Aug 25 13:01:31.478459 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1782/3505] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:31.516097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:31.517676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:31.541459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.543798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.545418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:31.547237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:31.548026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:31.549355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:32.313396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.security_group_api [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Neutron security group does_not_exist not found {{(pid=122700) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 25 13:01:32.315751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 257 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-924789005", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-924789005', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 25 13:01:32.338506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:32.351128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:32.367233 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2365929a-519e-49f0-a544-4e34d0016ac3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.001246 Aug 25 13:01:32.367233 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1724/3506] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:31 2022] POST /compute/v2.1/servers => generated 106 bytes in 1018 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:01:32.379184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:32.381060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:32.395765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:32.396742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:32.397546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:32.400302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:32.400302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:32.401110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.539878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:33.567570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:33.572659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:33.576811 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-07f2955c-bc89-4bb9-b148-43523db4c35d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.088871 Aug 25 13:01:33.578965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1783/3507] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:31 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:33.592059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:33.593795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:33.606818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.608434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.609596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.611235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:33.612468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:33.613489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:33.988793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:34.008525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b1002c09-fb33-46d9-96f2-d9d5db4f4e7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 1.645839 Aug 25 13:01:34.010633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1725/3508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:32 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:34.023022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:34.026021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:34.049360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:34.052405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:34.053491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:34.055785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:34.056675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:34.057418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:35.020638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:35.071697 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf1d5606-9eee-4b86-947a-a5cb3340e21f tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1470 microversion: 2.1 time: 1.490009 Aug 25 13:01:35.077605 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1784/3509] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:33 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1470 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:35.099404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:35.103340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:35.129516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:35.137215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:35.138610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:35.140445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:35.141779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:35.142816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:35.396193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:35.423705 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52bfc2d3-798f-4798-8967-af92039bb100 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.408799 Aug 25 13:01:35.444650 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1726/3510] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:34 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:35.482394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:35.485294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:35.520220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:35.524277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:35.525543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:35.532101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:35.534759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:35.538807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:37.047295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:37.075726 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7042a796-590d-4cff-9d45-f7ce8c57e433 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1508 microversion: 2.1 time: 1.996098 Aug 25 13:01:37.100663 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1785/3511] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:35 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1508 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:37.137764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:37.144586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:37.178270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:37.179273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:37.180093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:37.181537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:37.182435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:37.183817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:37.221297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:37.265637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:37.288493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:37.292060 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb78df43-e2b8-4358-81ba-15e5c4b2e85b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.837007 Aug 25 13:01:37.293665 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1727/3512] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:35 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:37.352403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:37.353630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:37.379389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:37.387544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:37.388483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:37.389891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:37.390787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:37.391627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:39.782500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:39.818500 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-450dd238-98f4-40a3-afb6-7b34113f4b33 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.506428 Aug 25 13:01:39.858912 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1728/3513] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:37 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:39.865571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:39.866523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:39.868211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:39.892893 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a0f59bb8-efd6-4b14-b4bb-f262328bc824 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 2.789700 Aug 25 13:01:39.912928 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1786/3514] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:37 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:39.923584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:39.930495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.931990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.933234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:39.937623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:39.939592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.941008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.942247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:39.958273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.958845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.959908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:39.961274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:39.961899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:39.962683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:41.918616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:41.935773 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02e652c9-84b6-44f0-a76e-d6da5bd61c84 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1508 microversion: 2.1 time: 2.021222 Aug 25 13:01:41.936880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1787/3515] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:39 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1508 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:41.948344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:41.949551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:41.966200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:41.967340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:41.968236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:41.969842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:41.977045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:41.978127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:42.064509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:42.095994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4411d569-ed5f-47d5-9430-9f31a14a0077 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1463 microversion: 2.1 time: 2.235219 Aug 25 13:01:42.097149 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1729/3516] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:39 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1463 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:42.113248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9bbc8eb-7caf-489c-b055-34c0c33302de", "tag": "a1b01388-306b-4ae8-aed8-9c1a5bb435ee"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:42.138989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:42.146326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:42.147674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:42.204713 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] Creating event network-changed:a1b01388-306b-4ae8-aed8-9c1a5bb435ee for instance d9bbc8eb-7caf-489c-b055-34c0c33302de on n-h1-850468-18 Aug 25 13:01:42.237115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ea9ff8a1-1a35-4ef7-92d6-5c182be85def req-3a6230ac-b209-4834-bb64-77c63d00afaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137235 Aug 25 13:01:42.239643 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1730/3517] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:42.265992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:42.268815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 8895f16f-ff41-4d46-bd71-73e53a8561e1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:42.284850 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/8895f16f-ff41-4d46-bd71-73e53a8561e1 HTTP/1.1 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8895f16f-ff41-4d46-bd71-73e53a8561e1'} Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:42.289242 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. Aug 25 13:01:42.298466 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:42.304780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 8895f16f-ff41-4d46-bd71-73e53a8561e1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:42.304780 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5bc0174-1241-479a-9ca5-1602d016e9c8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8895f16f-ff41-4d46-bd71-73e53a8561e1" status: 404 len: 111 microversion: 2.1 time: 0.059646 Aug 25 13:01:42.307154 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1731/3518] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:01:42 2022] DELETE /compute/v2.1/servers/8895f16f-ff41-4d46-bd71-73e53a8561e1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:01:42.817303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7dcdc8b7-946e-4759-a5cd-96e7fe7766a8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: .version_select at 0x7fc6c2ec5d30>, body: {"keypair": {"name": "tempest-keypair-1644697267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBq1MxixSrI1ZujR8QIJFR0wrUXUovg4w8bB/pjL02z5HE8ooc2MWv9rvqEJOWGxxwx3PPbM09HZwXlPM5U9DvKUeLVqv5KkSyT2AsJTKyK5c/uOk/K5Gg+YKaHTQ8GfQ=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:42.861731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7dcdc8b7-946e-4759-a5cd-96e7fe7766a8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:01:42.875540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7dcdc8b7-946e-4759-a5cd-96e7fe7766a8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:01:42.936551 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7dcdc8b7-946e-4759-a5cd-96e7fe7766a8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.625997 Aug 25 13:01:42.946143 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1732/3519] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:01:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:42.977129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:42.978332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:43.017676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.018525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.019249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:43.020479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.021209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.021916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:43.898401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:43.945070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:43.949395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:43.952508 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5d15661-2ffc-4955-b0fe-a2da37d57640 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.013551 Aug 25 13:01:43.954976 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1788/3520] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:41 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:43.966065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:43.971917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:43.986437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.987924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.989303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:43.991160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:43.992555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:43.993723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.243830 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1694d9b3-89b7-405e-b51f-acb87747e68a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "PUT /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1080 microversion: 2.1 time: 0.286386 Aug 25 13:01:44.280385 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1789/3521] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:01:43 2022] PUT /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1080 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:44.318700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:44.324083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:44.341288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.343029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.344216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.347979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.349690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.352977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.893032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:44.900507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:44.934278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d862ba9-4405-4535-a2f7-d2018d337305 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 1.986018 Aug 25 13:01:44.935320 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1733/3522] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:42 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:44.944438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:44.945671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:44.980764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.981629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.988013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:44.989593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:44.990451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:44.991261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:45.655276 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-981c6411-67d2-45cd-98ad-7ea64088b503 tempest-MigrationsAdminTest-1290252318 tempest-MigrationsAdminTest-1290252318-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1616 microversion: 2.1 time: 1.366769 Aug 25 13:01:45.662344 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1790/3523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:44 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1616 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:45.683791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-plugged", "status": "completed", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:45.717092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:45.718317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:45.719353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:45.795875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] Creating event network-vif-plugged:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 13:01:45.821311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-11c4ba71-d4f3-4d15-9edd-31a7afd01bae req-c0f6a4ad-705b-4f30-bdfc-2be95cca6f18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158451 Aug 25 13:01:45.823469 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1791/3524] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:45.857609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:45.859447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:45.880369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:45.884344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:45.885458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:45.888918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:45.890111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:45.891705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:45.897525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:45.981374 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b4a29f4b-ee33-477b-805c-cfaae7a06c31 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.039791 Aug 25 13:01:45.982911 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1734/3525] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:44 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:46.017002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:46.022745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:46.047340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.050158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.051491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.053215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.054604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.055905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.793590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.830572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a37315b4-3b56-4f12-9ba0-7f32f53026c5 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1506 microversion: 2.1 time: 0.991367 Aug 25 13:01:46.831672 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1792/3526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:45 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1506 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:46.883305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:46.884293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:46.897029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.898421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.899438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.907840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.915132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:46.915132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:46.915132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:46.950464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.954308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:46.957575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d038ec0-59cb-4994-acd7-3edac8198558 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 0.965493 Aug 25 13:01:46.958638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1735/3527] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:45 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:46.983614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:46.990629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:47.030175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.032214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.035004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:01:47.037748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.041165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.044540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.047224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.392354 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd51e00b-24a2-474c-92ef-acb83ff321a1 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "DELETE /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 204 len: 0 microversion: 2.1 time: 0.545382 Aug 25 13:01:47.394337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1793/3528] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:01:46 2022] DELETE /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:01:47.410263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:47.417796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:47.446176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.450122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.453751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.458106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.459704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.466458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.664588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:47.694367 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b48f573f-d2d4-4852-9e74-47e0925bbe10 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 0.733339 Aug 25 13:01:47.695499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1736/3529] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:46 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:47.713515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:47.721386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:47.743027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.748732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.749516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:47.750820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:47.751650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:47.752448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.140324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:49.207770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:49.224903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e05e8dd6-3e19-4abe-bde7-3443f63e82a6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.826574 Aug 25 13:01:49.234659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1794/3530] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:49.254354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:49.256268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:49.338992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.342869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.350827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.353807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.363513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.366353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.733598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:49.779463 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-816352e5-a14d-43ee-96ae-90d489bfb326 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1506 microversion: 2.1 time: 2.072830 Aug 25 13:01:49.782010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1737/3531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:47 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1506 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:49.805700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:49.810153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:49.835507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:49.855140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.856571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.857345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:49.858760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:49.859673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:49.860892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.053042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:52.093965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:52.106317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:52.116899 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-400fcb29-5f7e-4887-9546-a2b47091bf03 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 2.332378 Aug 25 13:01:52.141704 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1738/3532] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:49 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:52.163918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:52.165465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:52.191032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.198490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.202224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.208907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.210206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.214389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.374443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:52.431013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-135a7b5d-4cbd-4969-82d5-fa59b91ad493 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 200 len: 1469 microversion: 2.1 time: 3.194313 Aug 25 13:01:52.439611 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1795/3533] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:49 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 1469 bytes in 3204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:52.460547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:52.466666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 13:01:52.468079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9223372036854775808 could not be found. Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9223372036854775808'} Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:52.479367 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:52.485285 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:52.485285 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:52.485285 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:52.485285 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 25 13:01:52.485285 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:01:52.498321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:52.500738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38ba38fa-1185-4eef-8cfe-58ed87ca3a2f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.058715 Aug 25 13:01:52.502151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1796/3534] 10.222.0.60 () {58 vars in 1188 bytes} [Thu Aug 25 13:01:52 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:01:52.523332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:52.530610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:52.542796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:52.546315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.547972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.549655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.551438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.552669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.553730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.889496 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c11087a7-eb48-4411-8ca4-e9b3b0082223 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "PUT /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1082 microversion: 2.1 time: 0.384640 Aug 25 13:01:52.890696 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1797/3535] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:01:52 2022] PUT /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1082 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:52.892959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:01:52.911691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:52.912823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:52.959199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.960189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.965642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:52.967510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:52.972616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:52.976735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:55.778003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:55.825868 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b7057db-ccb2-4f0b-844c-8f6441aea354 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 3.681890 Aug 25 13:01:55.830526 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1739/3536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:52 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 3688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:55.841614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:55.843181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:55.857769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:55.859035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:55.860177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:55.862028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:55.863278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:55.864860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:56.630294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:56.676304 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ac3b20e-7f6a-49a0-ad8a-b6d174051a08 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 3.779026 Aug 25 13:01:56.677238 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1798/3537] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:52 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 3786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:56.717930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:56.725999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:56.765402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:56.766393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:56.767216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:56.768601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:56.769471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:56.770269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.208872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:57.266992 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e230cfb1-0b1f-4cad-a36d-52173521c3a0 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1508 microversion: 2.1 time: 1.430746 Aug 25 13:01:57.268332 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1740/3538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:55 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1508 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:57.295479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:57.301110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 78c11d77-5389-42bc-b014-56f64feef1c0] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:57.329348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.331403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.332920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.335125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.336982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.338064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.376349 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] HTTP exception thrown: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Request method failure captured: Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 HTTP/1.1 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Cbo9Oib4sXqQNOok72rswPAKk39u4xNN8LEPqeoePE0IwHBVgYbxccMhtruAkb5FNYtWa7H1kmEDNsvuWwwTlHpvImdbRp5EBEqta5iWK-YgEu-AZmpPu_OE7cgsDRsGfshOy2lLNRRvSyoY0SpQ9iBbwcyubceJ28TbQpThbulvA Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3713bafd03504284b0123f1ad434abe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MigrationsAdminTest-2102381392 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: e2d13befb47c4236a104a8d5feb949d8 Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '78c11d77-5389-42bc-b014-56f64feef1c0'} Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:01:57.381057 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. Aug 25 13:01:57.392735 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:01:57.396152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Returning 404 to user: Instance 78c11d77-5389-42bc-b014-56f64feef1c0 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:01:57.400623 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc1f6ffe-4b35-4130-935d-80aee12e2e38 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0" status: 404 len: 111 microversion: 2.1 time: 0.125670 Aug 25 13:01:57.412260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1741/3539] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:57 2022] GET /compute/v2.1/servers/78c11d77-5389-42bc-b014-56f64feef1c0 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:01:57.429544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c11d77-5389-42bc-b014-56f64feef1c0", "name": "network-vif-deleted", "tag": "c256d014-99cf-45fc-bdc7-fc72140f3463"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:57.469241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.473826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.476811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.515520 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] Creating event network-vif-deleted:c256d014-99cf-45fc-bdc7-fc72140f3463 for instance 78c11d77-5389-42bc-b014-56f64feef1c0 on n-h1-850468-18 Aug 25 13:01:57.530074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-44d70df8-3474-4ec4-8732-f6a76d2d13e4 req-c04838d2-5762-4d02-a4e2-50abdf509280 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114480 Aug 25 13:01:57.532791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1742/3540] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:01:57.547139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:57.547402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:57.550763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:57.569914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.571079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.572944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.575312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.576472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.577638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.597288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:57.603274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:57.607288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddc888c2-dcf0-4a8e-b156-c4a7f5460898 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 0.928196 Aug 25 13:01:57.629109 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1799/3541] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:01:56 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:01:57.668574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:57.672013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:57.717503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.718447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.719318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:57.720761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:57.721652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:57.731962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:58.145133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:58.188655 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d736513b-a7d0-4f59-be26-2f9209b28fd2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.650470 Aug 25 13:01:58.197620 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1743/3542] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:57 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:58.221566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332655263", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a60d176-8c8c-4348-8828-aa3cd40d7203"}], "security_groups": [{"name": "tempest-securitygroup--1845090633"}], "key_name": "tempest-keypair-1644697267", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:01:58.400904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:58.478391 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e9af3d1-4162-4221-a2f3-c71d0dece8d7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 0.847095 Aug 25 13:01:58.482780 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1800/3543] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:57 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:58.497137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:58.502718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:58.530824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:58.536846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:58.539514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:58.547054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:58.549445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:58.553018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:58.659680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] validate_networks() for [('2a60d176-8c8c-4348-8828-aa3cd40d7203', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:01:59.355038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:01:59.390773 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c458ff14-290b-4cb5-8624-7e11a0f1aac9 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1508 microversion: 2.1 time: 0.900548 Aug 25 13:01:59.393294 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1801/3544] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:01:58 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1508 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:01:59.419768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:01:59.440424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:01:59.457240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:59.458504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:59.459080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:59.461320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:01:59.461619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:01:59.462683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:01:59.575741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:00.047555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3144e058-c7c7-4b2d-bdaf-80038f400ed3 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 204 len: 0 microversion: 2.1 time: 0.636546 Aug 25 13:02:00.049212 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1802/3545] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:01:59 2022] DELETE /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:00.077942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:00.079324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Failed to fetch instance by id -1 {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 13:02:00.080965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance -1 could not be found. Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance -1 could not be found. Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '-1'} Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:00.085380 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:00.092807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:00.092807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:00.092807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 25 13:02:00.092807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:00.097715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:00.099713 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f84d0b2d-f559-425a-9b43-e5a27e07489c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.047187 Aug 25 13:02:00.101586 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1803/3546] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 13:02:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:02:00.112317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9bbc8eb-7caf-489c-b055-34c0c33302de", "name": "network-vif-plugged", "status": "completed", "tag": "a1b01388-306b-4ae8-aed8-9c1a5bb435ee"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:00.143898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.145454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.146718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.173663 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] Creating event network-vif-plugged:a1b01388-306b-4ae8-aed8-9c1a5bb435ee for instance d9bbc8eb-7caf-489c-b055-34c0c33302de on n-h1-850468-18 Aug 25 13:02:00.187812 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-dde10667-7511-4c5d-a8b0-7b382f108ba9 req-d76a625f-3275-40c0-899b-e7552d4f6fa4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082974 Aug 25 13:02:00.198522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1804/3547] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:00.248025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:00.249180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:00.270409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.272914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.278742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.293789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.295172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.296437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.317503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:02:00.319250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:02:00.321102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:02:00.322116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:02:00.323448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:02:00.361828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.366240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.367438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.369222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.373328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.374716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.468712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:02:00.488173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:02:00.569285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:02:00.584564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:02:00.894249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71347103-f65f-4d52-8a88-1a196fa17b04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.689411 Aug 25 13:02:00.908689 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1744/3548] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:01:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:02:00.930889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:00.931813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:00.951027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:00.965251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.966155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.967391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.985128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:00.986037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:00.986926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:00.998865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:01.007627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:01.010253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3707e4f6-4abb-43c4-b809-1fd87cc2a4b4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 0.805895 Aug 25 13:02:01.057122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1805/3549] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:00 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:01.087748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:01.093743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:01.098263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:01.122378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.128561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.137692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.139512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.140831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.141955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.491797 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bde4e9e2-75df-4c08-8c74-f9cd053c562d tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 204 len: 0 microversion: 2.1 time: 0.580032 Aug 25 13:02:01.494601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1745/3550] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:00 2022] DELETE /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:01.507175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:01.520354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:01.553832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.556807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.558629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.571885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:01.577735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:01.583085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:01.935620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:01.966983 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56f5a3d8-8f21-4920-90e2-253df2493112 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 0.904872 Aug 25 13:02:01.972036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1806/3551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:01 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:02.001363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:02.006313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:02.049891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.055636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.059470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.064633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.075376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.079011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.313121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:02.342477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa3021ee-c1f6-4e50-bf3e-0437e52c1f2a tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1533 microversion: 2.1 time: 0.843804 Aug 25 13:02:02.343824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1746/3552] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:01 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1533 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:02.365821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-80a95009-f7ac-475a-b01e-c99e7f8e9aff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:02.367695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-80a95009-f7ac-475a-b01e-c99e7f8e9aff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:02.514615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:02.571451 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f049fcd0-5304-45b6-a1d9-3c8579a551b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.591541 Aug 25 13:02:02.572876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1807/3553] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:01 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:02.609760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-80a95009-f7ac-475a-b01e-c99e7f8e9aff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:02.611804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:02.612794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:02.642587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-80a95009-f7ac-475a-b01e-c99e7f8e9aff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1242 microversion: 2.1 time: 0.294888 Aug 25 13:02:02.647279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.653319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1747/3554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:02 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1242 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:02.654494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.655318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.656856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.657853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.661465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.670070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:02.673734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:02.703777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.704719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.705193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.709297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:02.713105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:02.714575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:02.811689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:03.050541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Instance is already in deleting state, ignoring this request Aug 25 13:02:03.053603 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-323bd629-96cc-4f35-a24b-f8112c0e2591 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 204 len: 0 microversion: 2.1 time: 0.475715 Aug 25 13:02:03.059536 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1808/3555] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:02 2022] DELETE /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:03.086605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:03.091670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:03.126054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.134921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.137219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.141921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.143141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.148547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.768226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:03.795949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:03.806491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:03.809812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef079d3c-4e34-4e73-9852-cfe38c99de16 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.153773 Aug 25 13:02:03.816557 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1748/3556] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:02 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:03.827630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:03.836996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:03.853242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:03.862572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.863914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.865380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.867443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.868060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.869106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.900713 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2db871a-69c2-4f13-a179-c9e55e1b2e90 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.837279 Aug 25 13:02:03.906746 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1809/3557] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:03 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:03.922843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:03.924530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:03.939331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.940636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.941473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.943438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:03.944865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:03.947003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:03.980480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:04.282377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:04.301598 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-618e765d-cfee-461d-b2bb-fdc7533e5e80 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 0.482034 Aug 25 13:02:04.318235 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1749/3558] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:03 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:04.339930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:04.343752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:04.363138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.371709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.372696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.374255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.375153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.375926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.390646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:04.407162 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc22882d-74a1-4148-9b57-c2931363b35e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1514 microversion: 2.1 time: 0.490963 Aug 25 13:02:04.409167 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1810/3559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:03 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1514 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:04.429014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:04.430372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:04.457344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.458503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.460201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.461916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.463093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.464203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.668346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:04.683924 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ff071f6-bfa5-463c-90ce-5c02e8c7a831 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1238 microversion: 2.1 time: 0.272467 Aug 25 13:02:04.686500 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1811/3560] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:04 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1238 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:04.712405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:04.716410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: e384bba6-f247-4831-af03-a72b4f59540c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:04.733280 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/e384bba6-f247-4831-af03-a72b4f59540c/action HTTP/1.1 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 19 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: {"forceDelete": {}} Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e384bba6-f247-4831-af03-a72b4f59540c', 'body': {'forceDelete': {}}} Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:04.745622 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance e384bba6-f247-4831-af03-a72b4f59540c could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d69888a6-eb1e-458f-a52d-4a7c675ad07c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/e384bba6-f247-4831-af03-a72b4f59540c/action" status: 404 len: 111 microversion: 2.1 time: 0.059744 Aug 25 13:02:04.752881 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1812/3561] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:04 2022] POST /compute/v2.1/servers/e384bba6-f247-4831-af03-a72b4f59540c/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:04.770252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:04.771561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:04.785441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.786699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.787594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.787763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:04.789830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.790992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.792184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.804515 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a21bb9fe-9016-4e8a-ab29-e18cde9bda55 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1533 microversion: 2.1 time: 0.483947 Aug 25 13:02:04.806030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1750/3562] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:04 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1533 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:04.871573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:04.872849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:04.893418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.895252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.897199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:04.902035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:04.904428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:04.906067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.311012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.332988 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-604b397b-2116-4d65-b971-99a34e1f671a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.573098 Aug 25 13:02:05.334603 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1813/3563] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:04 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:05.376542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:05.387654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:05.401656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.402899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.403787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.405434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.406275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.407081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.410394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.416300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:05.439234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.443440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:05.446497 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-44867714-510c-4260-85a0-a3b4adbb1d82 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 0.583486 Aug 25 13:02:05.447878 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1751/3564] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:04 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:05.460026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:05.461260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:05.476736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.476736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.476736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:05.477946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:05.480028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:05.481384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.533915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:06.563982 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f841cad-8434-4031-9316-2d129822f736 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1361 microversion: 2.1 time: 1.208865 Aug 25 13:02:06.574033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1814/3565] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:05 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1361 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:02:06.596254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:06.597932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:06.629208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.630128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.630942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.632854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.634117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.636748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.693181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:06.718103 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bb7e868e-14cf-40ff-b3ba-21ce2ec3ff1b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.267078 Aug 25 13:02:06.735574 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1752/3566] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:05 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:06.771682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:06.773514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:06.787991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.789499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.790716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:06.793347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:06.795079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:06.796898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:07.758609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:07.802934 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1d6c4e8-f5f9-4bfa-9976-9ad530f300ff tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1294 microversion: 2.1 time: 1.051280 Aug 25 13:02:07.832315 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1753/3567] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:06 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1294 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:07.871957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:07.875185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:07.909367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:07.912977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:07.919465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:07.924375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:07.926911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:07.930649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:08.599019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:08.629910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe7ae3fe-9abe-4398-ac3b-94b26b8a500b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 200 len: 1491 microversion: 2.1 time: 0.784316 Aug 25 13:02:08.632301 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1754/3568] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:07 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 1491 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:08.653221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:08.660254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:08.687253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:08.690165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:08.696724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:08.699062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:08.707482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:08.707482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.024002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:10.026642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b39d94a9d13d4b739e36f862de62d064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c52805bbc04e419917f2b94a472a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:10.055306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:10.064398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:10.069163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4dd54d50-8b5d-4bb3-ab54-99ca36e65989 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.432229 Aug 25 13:02:10.078994 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1755/3569] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:08 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:10.097880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:10.102986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: cd5482b0-047e-489c-b9d4-73433365729d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:10.127918 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/cd5482b0-047e-489c-b9d4-73433365729d/action HTTP/1.1 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 39 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: {"os-getConsoleOutput": {"length": 10}} Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cd5482b0-047e-489c-b9d4-73433365729d', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:10.139522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. Aug 25 13:02:10.147682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:10.149865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance cd5482b0-047e-489c-b9d4-73433365729d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:10.156907 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98a18c50-79fd-4356-96be-ba8b646c3e79 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/cd5482b0-047e-489c-b9d4-73433365729d/action" status: 404 len: 111 microversion: 2.1 time: 0.075145 Aug 25 13:02:10.158881 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1756/3570] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:10 2022] POST /compute/v2.1/servers/cd5482b0-047e-489c-b9d4-73433365729d/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:10.179717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:10.185163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:10.215585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.216982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.218114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.220204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.221401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.222419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.417009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:10.699033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c9ffada-4f79-49b9-8f08-d7c58729ff1e tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 200 len: 1514 microversion: 2.1 time: 4.122006 Aug 25 13:02:10.699508 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1815/3571] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:06 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 1514 bytes in 4125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:10.708674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:10.709983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:10.722739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.724069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.725258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:10.726946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:10.728219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:10.729986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.357586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:11.390903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-537e46c3-e49e-4cb3-bdff-b9cbf9c7760c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1300 microversion: 2.1 time: 0.689398 Aug 25 13:02:11.401081 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1816/3572] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:10 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1300 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:11.410802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5663c33d-412d-47e6-b1ed-75a5d7285508", "name": "network-vif-deleted", "tag": "1b55f398-7d01-4399-92e2-7c10c5b35fbd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:11.452909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.465187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.469176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.491972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:11.515258 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] Creating event network-vif-deleted:1b55f398-7d01-4399-92e2-7c10c5b35fbd for instance 5663c33d-412d-47e6-b1ed-75a5d7285508 on n-h1-850468-18 Aug 25 13:02:11.536385 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8615a5fd-8ac7-4c93-8610-83bb2b6d4f97 req-e8bde02f-4b2e-4ce6-9a30-8b6018f15cee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132377 Aug 25 13:02:11.538373 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1817/3573] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:11.552893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:11.554963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 5663c33d-412d-47e6-b1ed-75a5d7285508] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:11.567661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.569338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.570820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.574658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.576712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.577897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.581601 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e2e2ba6-5da8-4f0a-bab8-66f698828776 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1545 microversion: 2.1 time: 1.405157 Aug 25 13:02:11.596171 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1757/3574] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:10 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1545 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:11.628756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] HTTP exception thrown: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Request method failure captured: Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 HTTP/1.1 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Cbo9Oib4sXqQNOok72rswPAKk39u4xNN8LEPqeoePE0IwHBVgYbxccMhtruAkb5FNYtWa7H1kmEDNsvuWwwTlHpvImdbRp5EBEqta5iWK-YgEu-AZmpPu_OE7cgsDRsGfshOy2lLNRRvSyoY0SpQ9iBbwcyubceJ28TbQpThbulvA Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3713bafd03504284b0123f1ad434abe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: e2d13befb47c4236a104a8d5feb949d8 Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5663c33d-412d-47e6-b1ed-75a5d7285508'} Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:11.632799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. Aug 25 13:02:11.640265 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:11.640981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:11.643401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:11.644070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Returning 404 to user: Instance 5663c33d-412d-47e6-b1ed-75a5d7285508 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:11.646205 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5d4a6e5-5230-483e-b542-1d15cc225255 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508" status: 404 len: 111 microversion: 2.1 time: 0.105266 Aug 25 13:02:11.653713 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1818/3575] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:11 2022] GET /compute/v2.1/servers/5663c33d-412d-47e6-b1ed-75a5d7285508 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:11.665385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:11.667695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:11.679926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.681365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.681679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.683448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.685271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.686356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.686877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.687722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.688433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:11.692583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:11.693625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:11.694776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:12.641192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:13.081243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.112338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c3bdfce6-3be0-4029-aa2d-b7639ccf64f8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.510960 Aug 25 13:02:13.113431 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1758/3576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:11 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:13.132655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.141462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.167421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.171717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.173119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.178601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.183054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.191580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.309218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.377931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.384609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:13.389056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac304cd5-2891-46b5-8b8f-cc27e8ff8b33 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.732717 Aug 25 13:02:13.396200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1819/3577] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:11 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:13.410987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f50325f1-c91c-41c4-bdc8-1c0e06c7c744 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '.version_select at 0x7fc6c19ad940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.477607 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f50325f1-c91c-41c4-bdc8-1c0e06c7c744 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498471445" status: 202 len: 0 microversion: 2.1 time: 0.078894 Aug 25 13:02:13.480534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1820/3578] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498471445 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:02:13.507002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.508328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 06e4b51c-114a-42e8-a402-7e908ec7406a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.527693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.528733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.530294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.532384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.533670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.534792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.588782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] HTTP exception thrown: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Request method failure captured: Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a HTTP/1.1 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3GiYNdDjwMJIKMJAlf-uTs33SVY3ODoL1OF--LJgaUZMBOd-BcilvkFI2LrnkB_VWa-LF3-_nz3yr1DZgO-PslkqSwbWNKBP9-jCpV4QLjS8OmoU6eXJRkSywXt7kdZrFMmn8_-mc-BW2xezp-MXW1oQJdvDuPwGLbTRWKIbObrPuU Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b39d94a9d13d4b739e36f862de62d064 Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '06e4b51c-114a-42e8-a402-7e908ec7406a'} Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:13.593844 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Returning 404 to user: Instance 06e4b51c-114a-42e8-a402-7e908ec7406a could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:13.601960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3236258b-0581-41ed-a017-c56bbfc0de6a tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a" status: 404 len: 111 microversion: 2.1 time: 0.112663 Aug 25 13:02:13.605066 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1821/3579] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/06e4b51c-114a-42e8-a402-7e908ec7406a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:13.616017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.617268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.631461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.632515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.633355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.634901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.636548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.637657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.673189 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7294daf7-3970-41bd-af62-7c61379e43d6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.554280 Aug 25 13:02:13.692108 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1759/3580] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-interface => generated 284 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:13.709394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:13.711243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:13.731664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.732808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.734494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:13.737411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:13.738848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:13.740225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.630695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:14.660592 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-052c4050-81e1-4e62-a5dc-678dd7db2de8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.053373 Aug 25 13:02:14.666158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1822/3581] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:14.687576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e4b51c-114a-42e8-a402-7e908ec7406a", "name": "network-vif-deleted", "tag": "3a160063-79b5-4553-ac40-b07218cd1d3c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:14.721748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.723190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.724299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.765328 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] Creating event network-vif-deleted:3a160063-79b5-4553-ac40-b07218cd1d3c for instance 06e4b51c-114a-42e8-a402-7e908ec7406a on n-h1-850468-18 Aug 25 13:02:14.788895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fdb8f477-5e7f-48f4-9b74-9b0d97c79fbc req-e3e4bafe-47b3-4af3-bbde-38182357b9a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116562 Aug 25 13:02:14.794454 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1823/3582] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:14.810975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:14.813387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:14.836758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.837719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.839131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.852790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.853872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.855343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.859349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:14.883920 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] HTTP exception thrown: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Request method failure captured: Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 HTTP/1.1 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3GiYNdDjwMJIKMJAlf-uTs33SVY3ODoL1OF--LJgaUZMBOd-BcilvkFI2LrnkB_VWa-LF3-_nz3yr1DZgO-PslkqSwbWNKBP9-jCpV4QLjS8OmoU6eXJRkSywXt7kdZrFMmn8_-mc-BW2xezp-MXW1oQJdvDuPwGLbTRWKIbObrPuU Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b39d94a9d13d4b739e36f862de62d064 Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9f0de314-a97e-44b0-80ce-8e6781033b34'} Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:14.888517 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:14.897290 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.913351 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8c36dc0f-872e-4b89-9964-93bb821204e1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.202734 Aug 25 13:02:14.913351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1760/3583] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:13 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:14.921601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:14.924656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:14.929128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Returning 404 to user: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:14.931081 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3be932df-1277-466f-9b71-c1688aa1ac0f tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 404 len: 111 microversion: 2.1 time: 0.133180 Aug 25 13:02:14.939113 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1824/3584] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:14 2022] DELETE /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:14.941183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.942385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:14.942997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.943185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 72e51159-d955-4929-9547-0cee7edf1b7d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:14.946266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.949945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:14.950933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:14.951721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:14.955665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/72e51159-d955-4929-9547-0cee7edf1b7d HTTP/1.1 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '72e51159-d955-4929-9547-0cee7edf1b7d'} Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:14.959046 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:14.966969 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:14.966969 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:14.966969 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:14.966969 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. Aug 25 13:02:14.966969 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:14.967869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 72e51159-d955-4929-9547-0cee7edf1b7d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:14.969088 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-398e2d3c-ed60-4b5c-8122-84fbd03d6c83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/72e51159-d955-4929-9547-0cee7edf1b7d" status: 404 len: 111 microversion: 2.1 time: 0.032342 Aug 25 13:02:14.970396 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1825/3585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:14 2022] GET /compute/v2.1/servers/72e51159-d955-4929-9547-0cee7edf1b7d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:14.986645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:14.989549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 9f0de314-a97e-44b0-80ce-8e6781033b34] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:15.013240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.014717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.016078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.018308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.019766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.021094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.083062 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] HTTP exception thrown: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Request method failure captured: Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 HTTP/1.1 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3GiYNdDjwMJIKMJAlf-uTs33SVY3ODoL1OF--LJgaUZMBOd-BcilvkFI2LrnkB_VWa-LF3-_nz3yr1DZgO-PslkqSwbWNKBP9-jCpV4QLjS8OmoU6eXJRkSywXt7kdZrFMmn8_-mc-BW2xezp-MXW1oQJdvDuPwGLbTRWKIbObrPuU Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b39d94a9d13d4b739e36f862de62d064 Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9f0de314-a97e-44b0-80ce-8e6781033b34'} Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:15.086191 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. Aug 25 13:02:15.092393 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:15.096000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Returning 404 to user: Instance 9f0de314-a97e-44b0-80ce-8e6781033b34 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:15.099769 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fbdd05ca-2f15-48d2-9a17-104f9a4e9936 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34" status: 404 len: 111 microversion: 2.1 time: 0.122368 Aug 25 13:02:15.101372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1826/3586] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:14 2022] GET /compute/v2.1/servers/9f0de314-a97e-44b0-80ce-8e6781033b34 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:15.118614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:15.119941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:15.131813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.132677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.133506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:15.134870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:15.136368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:15.137225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.168200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:16.195794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:16.210086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:16.214451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f5f56f5-8d98-4828-8274-e7c56726d282 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.309425 Aug 25 13:02:16.218356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1761/3587] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:14 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:16.238404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:16.239946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:16.248642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:16.282359 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da93e393-a534-472d-92bd-4f24ec7b4464 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.178367 Aug 25 13:02:16.283570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1827/3588] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:15 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:16.285540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.287037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.290124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.299226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.307952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.314932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.330782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:16.337397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:16.359367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.360804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.362723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.367076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.368322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.380032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.404448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] HTTP exception thrown: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Request method failure captured: Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e HTTP/1.1 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3GiYNdDjwMJIKMJAlf-uTs33SVY3ODoL1OF--LJgaUZMBOd-BcilvkFI2LrnkB_VWa-LF3-_nz3yr1DZgO-PslkqSwbWNKBP9-jCpV4QLjS8OmoU6eXJRkSywXt7kdZrFMmn8_-mc-BW2xezp-MXW1oQJdvDuPwGLbTRWKIbObrPuU Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b39d94a9d13d4b739e36f862de62d064 Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85c746c0-9899-4852-91bf-e4dd6e85828e'} Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:16.422085 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:16.433987 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:16.445123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Returning 404 to user: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:16.451446 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9376c5a-ae41-46aa-8130-00f9dfa3ac62 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "DELETE /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 404 len: 111 microversion: 2.1 time: 0.226743 Aug 25 13:02:16.462688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1762/3589] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:16 2022] DELETE /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:16.477530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:16.480848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:16.497369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.499205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.501261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:16.503050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:16.504628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:16.505483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.047384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:18.081395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3446c19-6e54-4222-a3fb-252c2a9422dd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.613017 Aug 25 13:02:18.092848 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1763/3590] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:16 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:18.154534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:18.157995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:18.161347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] [instance: 85c746c0-9899-4852-91bf-e4dd6e85828e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:18.206501 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b0f722b-35bb-4659-9a56-b84d0e664dda tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.904725 Aug 25 13:02:18.210194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.211466 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1828/3591] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:16 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:18.226695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.227932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.230252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.231483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.232595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.249363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:18.254371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:18.287860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.295543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.297750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.299545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.301045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.302161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.318896 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] HTTP exception thrown: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Request method failure captured: Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e HTTP/1.1 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3GiYNdDjwMJIKMJAlf-uTs33SVY3ODoL1OF--LJgaUZMBOd-BcilvkFI2LrnkB_VWa-LF3-_nz3yr1DZgO-PslkqSwbWNKBP9-jCpV4QLjS8OmoU6eXJRkSywXt7kdZrFMmn8_-mc-BW2xezp-MXW1oQJdvDuPwGLbTRWKIbObrPuU Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/95c52805bbc04e419917f2b94a472a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 95c52805bbc04e419917f2b94a472a5a Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1982054087 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b39d94a9d13d4b739e36f862de62d064 Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerDiskConfigTestJSON-1982054087-project Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '85c746c0-9899-4852-91bf-e4dd6e85828e'} Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:18.322292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] Returning 404 to user: Instance 85c746c0-9899-4852-91bf-e4dd6e85828e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:18.328999 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1df23049-546e-4ba5-8111-e3fbdd138566 tempest-ServerDiskConfigTestJSON-1982054087 tempest-ServerDiskConfigTestJSON-1982054087-project] 10.222.0.60 "GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e" status: 404 len: 111 microversion: 2.1 time: 0.223421 Aug 25 13:02:18.331884 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1764/3592] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:18 2022] GET /compute/v2.1/servers/85c746c0-9899-4852-91bf-e4dd6e85828e => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:18.425829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9bbc8eb-7caf-489c-b055-34c0c33302de", "tag": "a1b01388-306b-4ae8-aed8-9c1a5bb435ee"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:18.462444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.463836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.464698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.519842 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] Creating event network-changed:a1b01388-306b-4ae8-aed8-9c1a5bb435ee for instance d9bbc8eb-7caf-489c-b055-34c0c33302de on n-h1-850468-18 Aug 25 13:02:18.537840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9587c83d-8925-4bf9-b432-a7f121c1abb5 req-a03c7736-1aad-4c2a-8a5b-e61c969c3a55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118552 Aug 25 13:02:18.539394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1765/3593] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:02:18.550592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:18.551705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:18.599947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.600914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.601742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.603105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:18.604074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:18.605377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:18.772953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:19.144862 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35c642c6-d431-4054-9949-b23a572d1abb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "DELETE /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 204 len: 0 microversion: 2.1 time: 0.601046 Aug 25 13:02:19.156748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1766/3594] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:18 2022] DELETE /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:19.171288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eaff53be-a84d-4f63-bfc8-ace0f51d5082 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298572451", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eaff53be-a84d-4f63-bfc8-ace0f51d5082 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 237 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298572451", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-298572451', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.226984 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 25 13:02:19.235838 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:19.238809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eaff53be-a84d-4f63-bfc8-ace0f51d5082 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:19.251707 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eaff53be-a84d-4f63-bfc8-ace0f51d5082 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.092425 Aug 25 13:02:19.258840 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1767/3595] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:19.281198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb7ef98-982d-48b7-8a79-dde08ea77ee7", "tag": "63eb7e29-17aa-452b-a2d9-bd7d61d02d32"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:19.302896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.304052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.305146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.344025 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] Creating event network-changed:63eb7e29-17aa-452b-a2d9-bd7d61d02d32 for instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 on n-h1-850468-18 Aug 25 13:02:19.379286 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e9928377-6f44-409b-b046-a9dd160076e3 req-c0a44d25-b159-4a30-9545-1919a70074c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107429 Aug 25 13:02:19.384101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1768/3596] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:19.402029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "c655a718-4191-4271-8b72-da916b120196"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:19.464642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.465172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.466010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.504310 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] Creating event network-vif-plugged:c655a718-4191-4271-8b72-da916b120196 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:19.527698 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6778021a-bdfd-4f83-8a63-6940b07b9abd req-e6a7cfa3-992d-4f63-a3e6-e7ce159f78fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137150 Aug 25 13:02:19.534920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1769/3597] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:19.558547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:19.559878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:19.581514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.582455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.583927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:19.587868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:19.590119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:19.595799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:20.106070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:20.153242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:20.156688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:20.164806 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-554d98de-572d-4ad8-9601-7db97c54578d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.951051 Aug 25 13:02:20.173673 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1829/3598] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:18 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:20.189416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:20.193815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:20.221005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:20.221930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:20.222760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:20.230550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:20.234466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:20.235996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:21.983679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:21.991720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:22.018792 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ecb085fb-cbb5-47c2-a7c7-bf58a5ddc2ac tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1468 microversion: 2.1 time: 2.480785 Aug 25 13:02:22.035079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-06986025-8c66-4d7e-b2bc-15fe4e0b639f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.859210 Aug 25 13:02:22.035473 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1770/3599] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:19 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1468 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:22.039496 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1830/3600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:20 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:22.061502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:22.062761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:22.065976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:22.075801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:22.086512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:22.090226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.090831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.091749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.092710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:22.093331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.094048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.094677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:22.094891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.095692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:22.097079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:22.098256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:22.099346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.750718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:23.758074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:23.788776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:23.799393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36fcdfb0-bc05-436d-94a3-1686bfeaf776 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.761631 Aug 25 13:02:23.803459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:23.806114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1771/3601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:22 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:23.809881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee577136-a1f4-4fd5-98db-1100122f1c4f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.764585 Aug 25 13:02:23.811077 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1831/3602] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:22 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:23.829782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "b2cb2cb6-0a37-461c-b67c-d35a7d61d27d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:23.838751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:23.840033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:23.866452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:23.874891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:23.876398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:23.883029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:23.884502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:23.886239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.887701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:23.888524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.889961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:23.890935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:23.948417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] Creating event network-vif-plugged:b2cb2cb6-0a37-461c-b67c-d35a7d61d27d for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:23.986467 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-dc91a44a-28ed-4251-9881-5fa6058877b6 req-9f5c7a7c-d93d-473b-aad6-b180101e5385 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172188 Aug 25 13:02:23.988261 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1772/3603] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:24.013418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:24.018349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:24.047835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:24.051787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:24.056167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:24.061731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:24.065782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:24.071299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:24.099960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:25.265683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:25.292050 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bfedc1e2-4b36-4592-b5cc-f7f2b9bae7cb tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1468 microversion: 2.1 time: 1.476315 Aug 25 13:02:25.300807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1832/3604] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:23 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1468 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:25.314113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:25.323703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:25.347671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:25.351981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:25.357171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:25.358455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:25.359335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:25.360438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:25.403675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:25.444947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cce07fa5-e4e3-4cf6-b321-0458c6260c6b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.452002 Aug 25 13:02:25.452841 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1773/3605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:23 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:26.114852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:26.140154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7aa41a7e-ee82-4f55-9397-d24d65f416b4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.837229 Aug 25 13:02:26.147478 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1833/3606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:25 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:26.338171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:26.339363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:26.381841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:26.386337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:26.390205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:26.399112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:26.414331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:26.419432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:26.717722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c6375b-030f-4c2f-8a26-79c4f77ba192", "name": "network-vif-deleted", "tag": "c98e23dd-e986-420e-9817-6f7be2812234"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:26.770767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:26.771690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:26.772560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:26.812134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:26.833197 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] Creating event network-vif-deleted:c98e23dd-e986-420e-9817-6f7be2812234 for instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 on n-h1-850468-18 Aug 25 13:02:26.860169 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cf7d9920-572f-4e75-aa70-ff6b0069d2dd req-c4dd7f53-0466-485e-ba9b-2340d2100051 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.709924 Aug 25 13:02:26.862107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1834/3607] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:26.872811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "252b1902-0e99-4869-88f0-e2932be678d4"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "87500e7b-53b3-44a8-a014-2dcec34ef03e"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "ed72a143-bd9e-4526-ac8f-126ba31d5063"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "f834b6d9-f32a-4d42-9471-72f10e77b454"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-plugged", "status": "completed", "tag": "85bc99ed-6e9f-4d33-afb7-bdf6f332bf93"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:26.927710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:26.929097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:26.930516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:26.962564 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Creating event network-vif-plugged:252b1902-0e99-4869-88f0-e2932be678d4 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:26.966177 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Creating event network-vif-plugged:87500e7b-53b3-44a8-a014-2dcec34ef03e for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:26.969265 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Creating event network-vif-plugged:ed72a143-bd9e-4526-ac8f-126ba31d5063 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:26.970861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Creating event network-vif-plugged:f834b6d9-f32a-4d42-9471-72f10e77b454 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:26.972295 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] Creating event network-vif-plugged:85bc99ed-6e9f-4d33-afb7-bdf6f332bf93 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:26.986968 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cad36365-7917-4fcf-af7d-148048d7e731 req-5ef494bf-7daf-45a7-9327-4bf3709a8222 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.121209 Aug 25 13:02:26.989055 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1835/3608] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:27.002857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:27.004982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:27.021269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.023344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.024397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.028621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.029796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.030680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.126287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.127644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.128831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.130032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lazy-loading 'fault' on Instance uuid 66c6375b-030f-4c2f-8a26-79c4f77ba192 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:02:27.730466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:27.785553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29f809cd-90d5-46b9-876e-63f6e4624bd9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 200 len: 1302 microversion: 2.1 time: 0.792845 Aug 25 13:02:27.788383 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1836/3609] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:26 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 1302 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:27.800039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:27.801868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:27.815970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.817352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.818424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:27.820600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:27.821817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:27.823494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.620610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:28.678786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:28.685054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:28.688083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20224c22-fba9-4761-b84e-c31a220d7ad8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 3.229160 Aug 25 13:02:28.689453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1774/3610] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:25 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:28.747535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84b762a5-3488-433f-b25b-da5b53c959a0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-182663436", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:28.754994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:28.775355 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab8fb29c-6de2-4b21-ba51-a00e7aa49a73 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 0.984075 Aug 25 13:02:28.778370 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1837/3611] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:27 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84b762a5-3488-433f-b25b-da5b53c959a0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 234 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-182663436", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-182663436', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.781625 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 25 13:02:28.789899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.795146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84b762a5-3488-433f-b25b-da5b53c959a0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:28.797250 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84b762a5-3488-433f-b25b-da5b53c959a0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.083855 Aug 25 13:02:28.799444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1775/3612] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:02:28 2022] POST /compute/v2.1/servers => generated 133 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:02:28.814800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:28.816796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:28.837728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:28.839994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 66c6375b-030f-4c2f-8a26-79c4f77ba192] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:28.853301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.860351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.864349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.872443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.872698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.873819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.883830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.884867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.896964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.898684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:28.901979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:28.902912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:28.974658 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] HTTP exception thrown: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Request method failure captured: Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 HTTP/1.1 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Cbo9Oib4sXqQNOok72rswPAKk39u4xNN8LEPqeoePE0IwHBVgYbxccMhtruAkb5FNYtWa7H1kmEDNsvuWwwTlHpvImdbRp5EBEqta5iWK-YgEu-AZmpPu_OE7cgsDRsGfshOy2lLNRRvSyoY0SpQ9iBbwcyubceJ28TbQpThbulvA Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3713bafd03504284b0123f1ad434abe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: e2d13befb47c4236a104a8d5feb949d8 Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '66c6375b-030f-4c2f-8a26-79c4f77ba192'} Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:28.978606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. Aug 25 13:02:28.990237 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:28.993126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Returning 404 to user: Instance 66c6375b-030f-4c2f-8a26-79c4f77ba192 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:28.995388 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1ae7938-4154-4698-9299-4f2cdd42965b tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192" status: 404 len: 111 microversion: 2.1 time: 0.172293 Aug 25 13:02:28.997441 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1776/3613] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:28 2022] GET /compute/v2.1/servers/66c6375b-030f-4c2f-8a26-79c4f77ba192 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:29.019674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:29.022869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:29.036574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:29.038345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:29.039507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:29.042055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:29.043500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:29.044918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:29.133914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:02:29.476259 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf982f9f-e6c6-481a-ae01-f8d20c071e34 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 204 len: 0 microversion: 2.1 time: 0.463809 Aug 25 13:02:29.478490 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1777/3614] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:02:29 2022] DELETE /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:02:29.494017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:29.497892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:29.516877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:29.519784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:29.520962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:29.522642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:29.523717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:29.524758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:30.977724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:31.003090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3b78566c-092c-4693-b50f-e48eff39208d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 2.195852 Aug 25 13:02:31.003705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1838/3615] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:28 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:31.014368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:31.015043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:31.046059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.046593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.047133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:31.048008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.048520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.048964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:31.115557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:31.144457 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-727c7586-05c5-4e25-ab5d-5930c0df74a9 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1469 microversion: 2.1 time: 1.655824 Aug 25 13:02:31.147969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1778/3616] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:29 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1469 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:31.165449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:31.167256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:31.188923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.192496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.195389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:31.202731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:31.204216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:31.205328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:32.920816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:32.944194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:32.949443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-75aee88d-7b83-4f13-aef1-fc896ae3ff4b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.799400 Aug 25 13:02:32.965313 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1779/3617] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:31 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:32.973912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:32.980655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:32.986380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f4e800e-f4ef-4e77-a120-43e324a9be49 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1875 microversion: 2.42 time: 1.978841 Aug 25 13:02:32.989161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1839/3618] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:31 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1875 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:32.995678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:32.997775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:33.011237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:33.012814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:33.014013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:33.017047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:33.018608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:33.020003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:33.022623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:33.028219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:33.044913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:33.048018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:33.049525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:33.053662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:33.055158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:33.057809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:33.839536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:33.862390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:33.875224 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86772c7a-3e3d-481b-b6e7-b02c11147558 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.903724 Aug 25 13:02:33.879981 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1780/3619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:32 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:33.893270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-062106bb-e17e-4514-9e70-5e08e78fa4ba tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1469 microversion: 2.1 time: 0.901405 Aug 25 13:02:33.908795 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1840/3620] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:32 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1469 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:33.952332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:33.955346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 63889a7f-297b-445e-9143-86e82062a325] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:33.972786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/63889a7f-297b-445e-9143-86e82062a325/action HTTP/1.1 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 13 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: {"pause": {}} Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '63889a7f-297b-445e-9143-86e82062a325', 'body': {'pause': {}}} Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:33.982307 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:33.995043 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:33.995043 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:33.995043 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. Aug 25 13:02:33.995043 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:33.999135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 63889a7f-297b-445e-9143-86e82062a325 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:34.001139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9f4a354-36bf-45a6-849f-0aa77db3623c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/63889a7f-297b-445e-9143-86e82062a325/action" status: 404 len: 111 microversion: 2.1 time: 0.076885 Aug 25 13:02:34.008557 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1841/3621] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:33 2022] POST /compute/v2.1/servers/63889a7f-297b-445e-9143-86e82062a325/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:02:34.031493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:34.034502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:34.056157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:34.057788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:34.059082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:34.061459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:34.065209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:34.066659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:34.243233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb7ef98-982d-48b7-8a79-dde08ea77ee7", "name": "network-vif-plugged", "status": "completed", "tag": "63eb7e29-17aa-452b-a2d9-bd7d61d02d32"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:34.271483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:34.272802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:34.275271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:34.305845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] Creating event network-vif-plugged:63eb7e29-17aa-452b-a2d9-bd7d61d02d32 for instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 on n-h1-850468-18 Aug 25 13:02:34.314898 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4a5f344e-573e-4793-a156-4d837548e7c0 req-bce8ad02-d20b-4407-847f-eca7ceefe4f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.432818 Aug 25 13:02:34.316554 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1781/3622] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:34.330854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:34.332300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:34.349297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:34.350732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:34.352053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:34.354359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:34.356752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:34.358006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.241838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:35.286218 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40efd9c7-a9aa-4723-8519-7ca73144c876 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 1.273387 Aug 25 13:02:35.290687 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1842/3623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:34 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:35.312759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:35.314571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:35.344907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.348474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:35.349350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.356101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.358388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.358923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.360959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.375521 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d20d8ba2-eb5b-43fb-8e5b-e423879335b5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.052815 Aug 25 13:02:35.377101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1782/3624] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:34 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:35.388838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:35.394218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:35.430384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.433267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.437038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.439112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.440381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.441064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.517933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.523174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.525627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.529026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lazy-loading 'fault' on Instance uuid 3e92056f-13e1-49a3-bd4a-5bce90517577 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:02:35.790993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d13befb47c4236a104a8d5feb949d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3713bafd03504284b0123f1ad434abe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:35.815712 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-321b6c18-9175-4acb-bd8a-8a345505e024 tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 200 len: 1303 microversion: 2.1 time: 0.433671 Aug 25 13:02:35.817394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1783/3625] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:35 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 1303 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:35.847879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e92056f-13e1-49a3-bd4a-5bce90517577", "name": "network-vif-deleted", "tag": "a24cc5d4-77fb-4872-b5db-34e7f0fe270d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:35.875962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.876822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.877499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.912901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] Creating event network-vif-deleted:a24cc5d4-77fb-4872-b5db-34e7f0fe270d for instance 3e92056f-13e1-49a3-bd4a-5bce90517577 on n-h2-850468-18 Aug 25 13:02:35.927634 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1710865b-df71-4c8c-9dd0-898d88adfb2f req-91f58eb2-3522-49dc-bd34-62a81bb084d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107990 Aug 25 13:02:35.929814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1784/3626] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:35.943129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:35.945337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:35.977222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.978756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.982054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:35.984636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:35.985887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:35.987370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.436866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:36.482836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:36.494832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:36.499098 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-097d52b0-5d95-47dc-a615-db7f0b6b4642 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2830 microversion: 2.42 time: 1.204516 Aug 25 13:02:36.501206 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1843/3627] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:02:35 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2830 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:36.534612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:36.536569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:36.556074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.558891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.560397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.563950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.567394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.569103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.628470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:36.658031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3321a794-cd16-488e-b230-5a2188792d10 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.725786 Aug 25 13:02:36.666071 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1785/3628] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:35 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:36.701514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:36.702991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:36.722650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.723622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.724526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:36.727173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:36.727965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:36.729409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.202292 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b291508-c1d5-45bd-9248-7026938b470e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.531543 Aug 25 13:02:37.204328 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1786/3629] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 13:02:36 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e/os-interface => generated 1828 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:02:37.214316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:37.227678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:37.270274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.271753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.275173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.277683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.286688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.287804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.411274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:37.435104 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89afc9b8-bf47-4cb3-8557-b91ffd286ea5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1368 microversion: 2.1 time: 0.930638 Aug 25 13:02:37.468990 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1844/3630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:36 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1368 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:37.484539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:37.485937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] [instance: 3e92056f-13e1-49a3-bd4a-5bce90517577] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:37.513350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.514936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.516747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.520535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3ea01e3-68fb-4161-849e-3fa25eedf3f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 0.313321 Aug 25 13:02:37.520958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.527403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.528814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.537733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1787/3631] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:37 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:02:37.575412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:37.576641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] HTTP exception thrown: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. Aug 25 13:02:37.577850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Request method failure captured: Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 HTTP/1.1 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Cbo9Oib4sXqQNOok72rswPAKk39u4xNN8LEPqeoePE0IwHBVgYbxccMhtruAkb5FNYtWa7H1kmEDNsvuWwwTlHpvImdbRp5EBEqta5iWK-YgEu-AZmpPu_OE7cgsDRsGfshOy2lLNRRvSyoY0SpQ9iBbwcyubceJ28TbQpThbulvA Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3713bafd03504284b0123f1ad434abe5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3713bafd03504284b0123f1ad434abe5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3713bafd03504284b0123f1ad434abe5 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-MigrationsAdminTest-2102381392 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: e2d13befb47c4236a104a8d5feb949d8 Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-MigrationsAdminTest-2102381392-project Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3e92056f-13e1-49a3-bd4a-5bce90517577'} Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:37.580843 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. Aug 25 13:02:37.588023 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:37.592964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] Returning 404 to user: Instance 3e92056f-13e1-49a3-bd4a-5bce90517577 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:37.593895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-badee447-43c2-47b8-a5ee-b9020570d48c tempest-MigrationsAdminTest-2102381392 tempest-MigrationsAdminTest-2102381392-project] 10.222.0.60 "GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577" status: 404 len: 111 microversion: 2.1 time: 0.121906 Aug 25 13:02:37.595550 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1845/3632] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:37 2022] GET /compute/v2.1/servers/3e92056f-13e1-49a3-bd4a-5bce90517577 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:37.633855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.635710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.636649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:37.638374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:37.639653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:37.641066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:38.495299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:38.497851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:38.510504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:38.512553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:38.514260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:38.516199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:38.519541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:38.521229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:38.697950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:38.723910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88397b32-cba0-4985-ae61-f5bf27b97444 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1509 microversion: 2.1 time: 1.178539 Aug 25 13:02:38.738472 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1788/3633] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:37 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1509 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:39.087671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:39.121752 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ada37125-a5e2-4e30-b243-143d748dad72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1558 microversion: 2.1 time: 0.642649 Aug 25 13:02:39.132698 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1846/3634] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:38 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1558 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:39.176768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:39.177850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:39.205701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:39.206714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:39.207705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:39.209769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:39.210954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:39.212027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:39.631847 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d4e2851c-1aad-4263-b756-69bdaa11dabd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.464307 Aug 25 13:02:39.646808 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1789/3635] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:02:39 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-interface => generated 284 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:02:39.783650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:39.784524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:39.799192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:39.799817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:39.800333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:39.807940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:39.808486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:39.808947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:41.309121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "tag": "c655a718-4191-4271-8b72-da916b120196"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:41.329695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:41.331069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:41.332228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:41.359733 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] Creating event network-changed:c655a718-4191-4271-8b72-da916b120196 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:02:41.371437 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6c70343c-9bc7-41ee-ad20-79c88443cc79 req-54f06502-e700-4e90-94af-c480baca993d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072739 Aug 25 13:02:41.373678 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1790/3636] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:41.862277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:41.895526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff510dee-b613-412c-9c84-fa12d1357cda tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1489 microversion: 2.1 time: 2.116504 Aug 25 13:02:41.900410 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1847/3637] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:39 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1489 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:41.944777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:41.949349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:41.966968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:41.968303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:41.969410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:41.971269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:41.975092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:41.975930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:41.995073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:42.044162 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'pause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state paused Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 13 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: {"pause": {}} Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'pause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state paused Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'pause': {}}} Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state paused. Cannot pause while the instance is in this state. Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state paused Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:42.048489 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state paused Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'pause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state paused {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4eeca9a1-6b21-451b-84aa-4abc90f64efd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 143 microversion: 2.1 time: 0.116513 Aug 25 13:02:42.056005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1791/3638] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:41 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 143 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:02:42.069115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:42.071053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:42.084039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.085414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.086571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.089560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.090900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.092087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.313349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dad9e4c8-f78e-4900-8f75-98285db6ca51 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 0.251457 Aug 25 13:02:42.314266 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1848/3639] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:42 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:02:42.346632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:42.349645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:42.422742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.429989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.438216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:42.445464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:42.446257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:42.450576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:43.795817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:43.853711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88a54d04-b93f-4269-9b80-089493ab8588 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1496 microversion: 2.1 time: 1.528899 Aug 25 13:02:43.860886 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1792/3640] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:42 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1496 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:44.922670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:44.926300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:44.948341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:44.950249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:44.951445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:44.954073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:44.957441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:44.961665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:45.670350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:45.707446 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b148bad-819e-4e0c-9a1b-e8919fdac9ae tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.799316 Aug 25 13:02:45.722345 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1849/3641] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:44 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:45.759597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:45.773239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:45.818184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:45.821735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:45.824999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:45.827815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:45.829276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:45.831151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.127235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:47.148562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb7ef98-982d-48b7-8a79-dde08ea77ee7", "tag": "63eb7e29-17aa-452b-a2d9-bd7d61d02d32"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:47.177176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-474565ad-7837-4e51-a229-d71f22d8d3bc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.428099 Aug 25 13:02:47.192158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1793/3642] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:45 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:47.197371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:47.199274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:47.200451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.237254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:47.242292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] Creating event network-changed:63eb7e29-17aa-452b-a2d9-bd7d61d02d32 for instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 on n-h1-850468-18 Aug 25 13:02:47.249856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:47.262090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7cce7508-7382-440e-a2b3-5aa6f4009f35 req-0abfc3cd-bf97-434e-aa1e-42335ddccf7f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121689 Aug 25 13:02:47.264857 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1850/3643] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:47.285464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:47.286841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:47.288526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.290666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:47.294230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:47.297994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.341157 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action HTTP/1.1 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 28 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: {"reboot": {"type": "SOFT"}} Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6a277d44-5bfe-4641-a508-01856d871560', 'body': {'reboot': {'type': 'SOFT'}}} Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:47.351246 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:47.362824 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:47.366511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:47.376851 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-03178142-afab-459a-a98f-afcbd077900a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action" status: 404 len: 111 microversion: 2.1 time: 0.159745 Aug 25 13:02:47.378976 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1794/3644] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:47 2022] POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:47.404617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:47.407753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:47.438867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:47.439913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:47.440775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.442071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:47.444661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:47.446496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:47.889541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:47.921221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02111659-a1f5-454d-8a18-681e8fcbb840 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.534417 Aug 25 13:02:47.925456 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1851/3645] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:47.992573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:48.000005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:48.027585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.029878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.035364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:48.036934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:48.040870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:48.043615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:49.217002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:49.250570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5715623-983b-4513-8d05-4f485bafe27d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.282836 Aug 25 13:02:49.257594 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1795/3646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:49.338636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:49.366792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 1ca14395-51ca-436c-b717-c7442c512f38] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:49.402694 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/1ca14395-51ca-436c-b717-c7442c512f38/action HTTP/1.1 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 28 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: {"reboot": {"type": "SOFT"}} Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '1ca14395-51ca-436c-b717-c7442c512f38', 'body': {'reboot': {'type': 'SOFT'}}} Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. Aug 25 13:02:49.406196 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:49.414625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 1ca14395-51ca-436c-b717-c7442c512f38 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:49.419809 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d56ef26-9d6b-42cc-93ea-33396b480107 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/1ca14395-51ca-436c-b717-c7442c512f38/action" status: 404 len: 111 microversion: 2.1 time: 0.097934 Aug 25 13:02:49.424212 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1852/3647] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:49 2022] POST /compute/v2.1/servers/1ca14395-51ca-436c-b717-c7442c512f38/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:49.441457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:49.443112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:49.470123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:49.471063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:49.471901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:49.473295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:49.474305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:49.481033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.773276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:50.810510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1df92fdb-870a-4138-be87-c8ff4254a3cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.378477 Aug 25 13:02:50.812598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1796/3648] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:49 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:50.860515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:50.875880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:50.914186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.916856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.919948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:50.921903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:50.924813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:50.926750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:51.696858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:51.736816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ab6d08c-7151-4116-a742-9636defab440 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.872285 Aug 25 13:02:51.739365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1853/3649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:50 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:51.782569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:51.813848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:51.898508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:51.920432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:51.926859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:51.933446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:51.934525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:51.935359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:52.019789 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action HTTP/1.1 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 65 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6a277d44-5bfe-4641-a508-01856d871560', 'body': {'rebuild': {'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5'}}} Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 13:02:52.029394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:02:52.037267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:52.044933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:52.052860 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-587606fb-6ceb-4912-8267-4eb845483e49 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action" status: 404 len: 111 microversion: 2.1 time: 0.278310 Aug 25 13:02:52.054816 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1797/3650] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:51 2022] POST /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560/action => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:52.078553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:52.101505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:52.127111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.137456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.138257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:52.143707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.144809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.148586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:52.159113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:52.797522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:52.817429 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4275f77d-e9dd-4a6e-9943-41b02189b45b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.754469 Aug 25 13:02:52.819600 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1854/3651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:52 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:52.865863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:52.868383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:52.880243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:52.886249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.887739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.888889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:52.891004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:52.892359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:52.893693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.307769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:53.333856 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d317bb7d-c5f5-4695-bb8f-d3b5179bb5b3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.476013 Aug 25 13:02:53.349175 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1798/3652] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:52 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:53.381242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:53.394805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: a536f3af-bf63-463a-9b31-ba10926b6aea] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:53.409260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/a536f3af-bf63-463a-9b31-ba10926b6aea/action HTTP/1.1 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 65 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a536f3af-bf63-463a-9b31-ba10926b6aea', 'body': {'rebuild': {'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5'}}} Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 25 13:02:53.413477 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. Aug 25 13:02:53.421738 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:53.426361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance a536f3af-bf63-463a-9b31-ba10926b6aea could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:53.428696 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-015a1846-1187-433e-965c-9da8e5b9b783 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/a536f3af-bf63-463a-9b31-ba10926b6aea/action" status: 404 len: 111 microversion: 2.1 time: 0.056427 Aug 25 13:02:53.430275 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1799/3653] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:53 2022] POST /compute/v2.1/servers/a536f3af-bf63-463a-9b31-ba10926b6aea/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:02:53.448492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:53.449805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:53.471875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:53.475328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:53.477071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.479925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:53.481319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:53.482655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:53.772694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a1fbc774-5e14-4e24-b2f7-176b0b5feb6d tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] Calling method '.version_select at 0x7fc6c6c31c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:54.185972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:54.203902 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be9b8d2e-77ce-4a6b-95bc-65646273d064 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.764726 Aug 25 13:02:54.224323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1800/3654] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:53 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:54.256348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:54.257640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:54.276215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:54.278000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:54.279454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:54.285145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:54.293019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:54.294603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:54.719647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a1fbc774-5e14-4e24-b2f7-176b0b5feb6d tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 8062 microversion: 2.1 time: 1.804850 Aug 25 13:02:54.721565 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1855/3655] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 13:02:52 2022] GET /compute/v2.1/os-networks => generated 8062 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:54.741890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a6872b2-d6ab-490b-bf0a-af63b04dfb7a tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] Calling method '.version_select at 0x7fc6c6c82af0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:55.067241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:55.096739 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a96a5d7-e9d2-4604-9d9d-3fcc379587bf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.849665 Aug 25 13:02:55.130656 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1801/3656] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:54 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:55.158124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:55.161313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: e67f6908-dc7f-4798-97fa-a705db2be6f5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:55.181320 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a6872b2-d6ab-490b-bf0a-af63b04dfb7a tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks/67ab369b-7bc4-4554-ad49-c1ad8f1d8495" status: 200 len: 652 microversion: 2.1 time: 0.447069 Aug 25 13:02:55.183200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1856/3657] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:02:54 2022] GET /compute/v2.1/os-networks/67ab369b-7bc4-4554-ad49-c1ad8f1d8495 => generated 652 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:02:55.209843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. Aug 25 13:02:55.215315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0dae7102-c259-4234-8645-713164066eca tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] Calling method '.version_select at 0x7fc6c6c824c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/e67f6908-dc7f-4798-97fa-a705db2be6f5/action HTTP/1.1 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: {"restore": {}} Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'e67f6908-dc7f-4798-97fa-a705db2be6f5', 'body': {'restore': {}}} Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:55.225043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance e67f6908-dc7f-4798-97fa-a705db2be6f5 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e18117c6-ffb2-4805-bac5-3fd607925a62 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/e67f6908-dc7f-4798-97fa-a705db2be6f5/action" status: 404 len: 111 microversion: 2.1 time: 0.082335 Aug 25 13:02:55.234319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1802/3658] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:55 2022] POST /compute/v2.1/servers/e67f6908-dc7f-4798-97fa-a705db2be6f5/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:02:55.260999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:55.262229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:55.295420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:55.296398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:55.300470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:55.308698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:55.309471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:55.310122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:55.766639 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0dae7102-c259-4234-8645-713164066eca tempest-NetworksTest-1411882554 tempest-NetworksTest-1411882554-project-admin] 10.222.0.60 "GET /compute/v2.1/os-networks" status: 200 len: 8062 microversion: 2.1 time: 0.573619 Aug 25 13:02:55.768713 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1857/3659] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 13:02:55 2022] GET /compute/v2.1/os-networks => generated 8062 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:02:55.986909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.021142 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe36c9f0-dc49-465e-b36e-3258f3d17738 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.768307 Aug 25 13:02:56.023003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1803/3660] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:55 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:56.070115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:56.078669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:56.083338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=48 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:02:56.095743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.102395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.104192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.105585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.107457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.113039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.566656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:56.601205 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e563d374-8808-4945-8acd-430872ab97e0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.535020 Aug 25 13:02:56.632975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1858/3661] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:56 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:56.652518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:56.655899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:56.670402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.671545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.672794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.674732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.676357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.677490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.740317 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'restore' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: {"restore": {}} Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'restore' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'restore': {}}} Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state active. Cannot restore while the instance is in this state. Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:56.744749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:56.752842 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:56.752842 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:56.752842 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:56.752842 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:02:56.752842 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:02:56.754605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'restore' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:56.755783 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d16c8a4d-e93e-4d0d-a8e1-e3e961e8c44a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 145 microversion: 2.1 time: 0.111366 Aug 25 13:02:56.757909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1804/3662] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:56 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:02:56.771830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:56.780310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:56.804967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.805592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.806393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:56.808291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:56.809067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:56.809815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:57.848809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:57.871745 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cfdb00b1-003d-44d5-bb48-29d1aba934c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.106822 Aug 25 13:02:57.892934 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1859/3663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:56 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:57.927356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:57.930683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:57.953614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:57.955126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:57.958490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:57.961305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:57.962870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:57.965048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:58.948862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:02:58.984905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d55d9a1-3d59-43c6-a2d3-95ba7202dd4a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.070228 Aug 25 13:02:58.988880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1805/3664] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:57 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:02:59.038871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:02:59.043515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: be173b3d-4691-4aff-a0ee-31c5b0506eb4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:59.073478 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/be173b3d-4691-4aff-a0ee-31c5b0506eb4/action HTTP/1.1 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 14 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: {"resume": {}} Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'be173b3d-4691-4aff-a0ee-31c5b0506eb4', 'body': {'resume': {}}} Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:02:59.093082 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:02:59.100675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:02:59.100675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:02:59.100675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. Aug 25 13:02:59.100675 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:02:59.103178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance be173b3d-4691-4aff-a0ee-31c5b0506eb4 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:02:59.106395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-047aa6fd-0eea-44d7-b626-5eabb9b762cb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/be173b3d-4691-4aff-a0ee-31c5b0506eb4/action" status: 404 len: 111 microversion: 2.1 time: 0.077016 Aug 25 13:02:59.111769 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1860/3665] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:02:59 2022] POST /compute/v2.1/servers/be173b3d-4691-4aff-a0ee-31c5b0506eb4/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:02:59.122962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:02:59.128587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:02:59.154986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:59.162337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:59.164635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:02:59.167361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:02:59.183612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:02:59.189747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.259540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.292328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3b35279-8a60-47bb-b886-dae9cab5c69d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.176054 Aug 25 13:03:00.312378 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1806/3666] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:02:59 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:00.352909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:00.359689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:00.392543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:00.397369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:00.398830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.404820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:00.409213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:00.413815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:00.938663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:00.968502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d83d45f9-e618-42c2-9a87-3f07a67129d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.623437 Aug 25 13:03:00.973517 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1861/3667] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:00 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:01.019080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:01.021406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:01.036996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.038629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.039878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.042898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.044157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.046320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.144010 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'resume' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 14 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: {"resume": {}} Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'resume' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'resume': {}}} Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state active. Cannot resume while the instance is in this state. Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:01.147235 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:03:01.152669 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:01.164927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'resume' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:03:01.167339 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b070b02-afac-4dba-b569-fd56ff3a2d8a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 144 microversion: 2.1 time: 0.160075 Aug 25 13:03:01.177937 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1807/3668] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:03:01 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 144 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:03:01.228440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:01.233133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:01.272837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.273852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.274707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:01.276784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:01.278134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:01.279352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:02.904277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:02.974541 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-59809145-92cc-4ab3-be0e-4618d6e67e15 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.784935 Aug 25 13:03:02.977481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1862/3669] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:01 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:03.040722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:03.045909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:03.084483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:03.085080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:03.086150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:03.089152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:03.090534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:03.091626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:04.595191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:04.626444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-658cb820-9d48-44f5-8212-8296bf81abed tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.600602 Aug 25 13:03:04.627970 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1808/3670] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:03 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:04.935963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-701f264a-51fa-40a0-ac89-9d23a1b49f45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-701f264a-51fa-40a0-ac89-9d23a1b49f45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 160 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": "", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "54e5edae-5404-46de-ad4a-66afd3679592"}]}} Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'server': {'name': '', 'imageRef': '3f4244a5-c143-4666-878e-6ff8b102f5a5', 'flavorRef': '452', 'networks': [{'uuid': '54e5edae-5404-46de-ad4a-66afd3679592'}]}}} Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '' Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:03:04.947413 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:03:04.955313 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:03:04.960952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-701f264a-51fa-40a0-ac89-9d23a1b49f45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:03:04.961867 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-701f264a-51fa-40a0-ac89-9d23a1b49f45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.034902 Aug 25 13:03:04.965097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1863/3671] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:04 2022] POST /compute/v2.1/servers => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:03:04.988908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:04.990969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:05.012919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:05.014175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:05.015176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:05.020945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:05.022228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:05.024674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:05.505502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:05.526436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58360044-6345-44b7-a066-6f924710a831 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.552635 Aug 25 13:03:05.529721 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1809/3672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:04 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:05.581075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:05.582764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:05.597188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:05.598155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:05.599147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:05.601219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:05.602551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:05.610454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:06.383500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:06.407512 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a51e7e3c-0996-4fa0-8fd6-d2c2fffa1852 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.841367 Aug 25 13:03:06.409123 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1864/3673] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:05 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:06.457238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:06.461640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 5a536c8d-c470-49aa-8e1c-87145fd80654] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:06.510929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/5a536c8d-c470-49aa-8e1c-87145fd80654/action HTTP/1.1 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 14 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: {"shelve": {}} Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5a536c8d-c470-49aa-8e1c-87145fd80654', 'body': {'shelve': {}}} Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:03:06.540050 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:03:06.555955 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:03:06.555955 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:03:06.555955 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. Aug 25 13:03:06.555955 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:03:06.555955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 5a536c8d-c470-49aa-8e1c-87145fd80654 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:03:06.576684 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a899d0a-a0d6-4c43-b600-f9918de2e917 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/5a536c8d-c470-49aa-8e1c-87145fd80654/action" status: 404 len: 111 microversion: 2.1 time: 0.108476 Aug 25 13:03:06.585151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1810/3674] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:03:06 2022] POST /compute/v2.1/servers/5a536c8d-c470-49aa-8e1c-87145fd80654/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:03:06.603463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:06.606039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:06.625112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:06.626078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:06.627059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:06.629453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:06.631650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:06.633656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:07.497388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:07.542737 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-769e20c9-2086-4ee5-8ccd-4ccf2186beb1 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.949055 Aug 25 13:03:07.546864 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1865/3675] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:06 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:07.596530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:07.597658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:07.641688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:07.643079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:07.646296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:07.654244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:07.656562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:07.658199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.285239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:08.322114 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6d6fd52-50e5-4de7-89c7-5e4bfbeb487f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.734656 Aug 25 13:03:08.324050 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1811/3676] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:07 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:08.374842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:08.375933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:08.413404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.427812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.428933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.430954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:08.431735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:08.439735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:08.580177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lazy-loading 'flavor' on Instance uuid 485bbda2-f007-480b-9cc0-1ab14dbc4a58 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:03:09.385617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eeb08aa6-71ec-4b79-bba4-71c01c97b685 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 1.026199 Aug 25 13:03:09.398021 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1866/3677] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:03:08 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:03:09.420936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:09.428545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:09.479082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.489089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.490762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:09.494878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:09.499505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:09.502525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:10.279253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:10.305352 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3981adcd-6006-4ec0-99a7-68c2e25d78ce tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 0.905642 Aug 25 13:03:10.308099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1812/3678] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:09 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:10.859278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9f41d84-31ea-4974-8e26-6b70d6fbf26c tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] Calling method '.version_select at 0x7fc6c6c824c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:10.899583 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9f41d84-31ea-4974-8e26-6b70d6fbf26c tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 1.161633 Aug 25 13:03:10.901365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1867/3679] 10.222.0.60 () {60 vars in 1226 bytes} [Thu Aug 25 13:03:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:03:10.929063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f2eef42-0db7-43d9-bb94-e7cf8ac450d8 tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c161fa60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:11.292948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f2eef42-0db7-43d9-bb94-e7cf8ac450d8 tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.377801 Aug 25 13:03:11.294926 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1813/3680] 10.222.0.60 () {62 vars in 1247 bytes} [Thu Aug 25 13:03:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:11.313326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd640e22-84f5-4446-85e5-1b5e346c048b tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] Calling method '.version_select at 0x7fc6c1994280>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:11.347455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd640e22-84f5-4446-85e5-1b5e346c048b tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042372 Aug 25 13:03:11.350231 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1868/3681] 10.222.0.60 () {60 vars in 1226 bytes} [Thu Aug 25 13:03:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:11.358850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:11.363029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:11.374581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-588dba23-f726-4fc5-a039-86cc1cbd1766 tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c1994e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:11.391592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:11.395148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:11.396629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:11.401556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:11.405852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:11.407611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:11.515202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:11.601483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-588dba23-f726-4fc5-a039-86cc1cbd1766 tempest-QuotaClassesAdmin257Test-1384669553 tempest-QuotaClassesAdmin257Test-1384669553-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.238492 Aug 25 13:03:11.612789 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1869/3682] 10.222.0.60 () {62 vars in 1247 bytes} [Thu Aug 25 13:03:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:12.316906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:12.356663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-221945ea-f27e-4b3a-9d6b-438b28217bc8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 1.010267 Aug 25 13:03:12.357728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1814/3683] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:11 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:13.412731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:13.418248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:13.442319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.443974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.445333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:13.447788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:13.449256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:13.452069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:14.008776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1124831129", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d0b7aa63-ef3e-4dbb-9dca-dd2f8b6a649b"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:14.165752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:14.205061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15782cd7-4d18-4100-8ac3-f4e48355019b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 0.803041 Aug 25 13:03:14.209857 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1870/3684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:13 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:14.219735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] validate_networks() for [('d0b7aa63-ef3e-4dbb-9dca-dd2f8b6a649b', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:15.251747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:15.261301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:15.279267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:15.280318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:15.281050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:15.282455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:15.283466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:15.296364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:15.969057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:15.996032 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1332cc0-3e19-4ba4-b9c5-19bf45016b93 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 0.751380 Aug 25 13:03:15.997121 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1871/3685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:15 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:16.444642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:16.445673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:16.446158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:16.448207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:16.449847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:16.475350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:16.478206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:16.479613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:16.481654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:16.484992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:16.486841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:16.550736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Getting quotas for project 33cb404a4b5f4180b56439f0b9db2c87. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:16.566807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Getting quotas for user 4eed20a471794e8488f9b3f999ab7e28 and project 33cb404a4b5f4180b56439f0b9db2c87. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:16.616595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Going to run 3 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:16.623970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:16.699015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:16.828928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=fb6834ff-a57c-420a-beb1-c7449dba692d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:17.048432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:17.050320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:17.057622 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f8603bc-b89d-4946-b89e-5c6b90e29b12 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.471882 Aug 25 13:03:17.058457 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1815/3686] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:03:17.078860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:17.089841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:17.091575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:03:17.109979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.111091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.111926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.113461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.117745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.117745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.184096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.185360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.194383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.196519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:17.198028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:17.199099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:17.317888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-83e47567-9185-4f14-8eda-194d79505993 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.246927 Aug 25 13:03:17.320983 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1816/3687] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 13:03:17 2022] GET /compute/v2.1/servers => generated 1018 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:17.342366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e6ddc1d-04fb-4ede-8caf-b65d784dfa88 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:17.349441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e6ddc1d-04fb-4ede-8caf-b65d784dfa88 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:17.820908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3e6ddc1d-04fb-4ede-8caf-b65d784dfa88 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:17.854597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e6ddc1d-04fb-4ede-8caf-b65d784dfa88 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1223 microversion: 2.1 time: 0.519415 Aug 25 13:03:17.870399 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1817/3688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:17 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1223 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:18.061881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:18.099226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f022ea2-142b-480c-8743-6f961ca4df3d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 1.062233 Aug 25 13:03:18.129617 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1872/3689] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:17 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:18.895993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-54f3d3cc-3639-4bb5-95ed-f2cd974f0147 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:18.898804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-54f3d3cc-3639-4bb5-95ed-f2cd974f0147 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:19.165409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:19.170866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:19.219043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:19.221103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:19.222026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:19.223442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:19.226021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:19.226985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:19.239753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-54f3d3cc-3639-4bb5-95ed-f2cd974f0147 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:19.304753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-54f3d3cc-3639-4bb5-95ed-f2cd974f0147 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1223 microversion: 2.1 time: 0.396139 Aug 25 13:03:19.305954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1818/3690] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:18 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1223 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:20.063710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.083628 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a153c02d-f382-4cdb-9ccb-6ae3b648b303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 0.940909 Aug 25 13:03:20.089310 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1873/3691] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:19 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:20.356386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb736a49-6bb7-4746-a020-4cf6f290a654 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:20.358291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eb736a49-6bb7-4746-a020-4cf6f290a654 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:20.684479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eb736a49-6bb7-4746-a020-4cf6f290a654 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:20.716493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb736a49-6bb7-4746-a020-4cf6f290a654 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1223 microversion: 2.1 time: 0.373464 Aug 25 13:03:20.721761 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1819/3692] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:20 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1223 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:21.146927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:21.152823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:21.192760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:21.193687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:21.194541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:21.195877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:21.214303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:21.215190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:21.601465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:21.785825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-446e52e9-b321-456e-86ee-6fb21049e77f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:21.818204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-446e52e9-b321-456e-86ee-6fb21049e77f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:22.520658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-446e52e9-b321-456e-86ee-6fb21049e77f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.543703 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-446e52e9-b321-456e-86ee-6fb21049e77f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1223 microversion: 2.1 time: 0.774482 Aug 25 13:03:22.549775 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1820/3693] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:21 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1223 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:22.719474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:22.745753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:22.750747 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0c72146-cb1f-4d4e-9b6d-e8c33a990f54 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 1.618397 Aug 25 13:03:22.777462 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1874/3694] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:21 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:23.610572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:23.614985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:23.630887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=7,nova_api:INSERT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:23.664254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.669326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.674008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.677710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.680781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.686555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.818309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:23.822193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:23.847407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.849409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.850617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.853823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:23.856326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:23.857746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:23.939265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:23.987735 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e1716f0-84ed-4090-bf16-56e70d53a810 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1275 microversion: 2.1 time: 0.396730 Aug 25 13:03:23.994798 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1821/3695] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:23 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:24.878337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:24.909985 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c20632d-3b73-4779-b803-21993809bde9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1531 microversion: 2.1 time: 1.109211 Aug 25 13:03:24.937527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1875/3696] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:23 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1531 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:25.046563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:25.050627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:25.083458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.084393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.085235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.086567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.087412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.101306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.570171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c2923280>, body: {"quota_set": {"ram": "5120"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:25.774190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.777338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.780147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.781766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.782992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.801282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.845013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:25.878956 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4017c81d-b1c0-48de-b9f5-c79532bba9ea tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1281 microversion: 2.1 time: 0.843051 Aug 25 13:03:25.885973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1822/3697] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:25 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1281 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:25.960544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:25.962099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:25.977705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.988939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.991639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:25.991639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:25.992501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:25.993767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.048093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3753145a-ef70-44b1-8974-b584f90724c5 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874" status: 200 len: 240 microversion: 2.36 time: 0.936575 Aug 25 13:03:26.060270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1876/3698] 10.222.0.60 () {62 vars in 1303 bytes} [Thu Aug 25 13:03:25 2022] PUT /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874 => generated 240 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:26.070143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Calling method '.version_select at 0x7fc6c1994ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:26.221735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=7,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:26.269099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.269099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.269099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.271937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:26.271937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:26.271937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:26.324838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5fe083c-e42b-487a-bc39-108e4aeb9036 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874/detail" status: 200 len: 672 microversion: 2.36 time: 0.259130 Aug 25 13:03:26.325841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1877/3699] 10.222.0.60 () {60 vars in 1304 bytes} [Thu Aug 25 13:03:26 2022] GET /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874/detail => generated 672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:26.779424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Action: 'update', calling method: .version_select at 0x7fc6c6c82790>, body: {"quota_set": {"ram": "2048"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:27.138541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.141728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.148577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.153849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.155963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.156854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.269590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:27.366291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.369824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.372415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.377966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.378896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.388358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.529766 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48ac70ef-df78-4a17-a671-f871a4152652 tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874?user_id=5e742479330243539fba323f703f094f" status: 200 len: 240 microversion: 2.36 time: 0.761175 Aug 25 13:03:27.530909 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1878/3700] 10.222.0.60 () {62 vars in 1384 bytes} [Thu Aug 25 13:03:26 2022] PUT /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874?user_id=5e742479330243539fba323f703f094f => generated 240 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:03:27.542148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:27.544435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:27.565610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.567339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.568460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:27.569907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:27.570715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:27.571524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:28.211473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:28.236290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-333aa66c-7f97-4f0b-b43b-44bb95db7dcc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1531 microversion: 2.1 time: 2.291109 Aug 25 13:03:28.238196 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1823/3701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:25 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1531 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:28.248719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "name": "network-vif-plugged", "status": "completed", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:28.283038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:28.285425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:28.286937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:28.327185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] Creating event network-vif-plugged:6b7cb724-42ee-45e9-9503-617f9e0edc50 for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 on n-h1-850468-18 Aug 25 13:03:28.346939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a23d9b78-a154-458e-b1cc-f284b995a240 req-e72fb708-e55a-4363-90c4-ed706e4ee1f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105629 Aug 25 13:03:28.361057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1824/3702] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:28.372234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ea03e68-05af-4fff-8d38-8dbbc78e337e tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] Calling method '.version_select at 0x7fc6c6bab3a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:28.729577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:28.768850 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84c0c67f-fa0e-4b15-8763-20dd4e9a6d0b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1281 microversion: 2.1 time: 1.224100 Aug 25 13:03:28.780379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1879/3703] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:27 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1281 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:29.283380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:29.284532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:29.309364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.310243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.322649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:29.324065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.329508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.329940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:29.542164 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ea03e68-05af-4fff-8d38-8dbbc78e337e tempest-QuotasAdminTestV236-879779267 tempest-QuotasAdminTestV236-879779267-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874?user_id=5e742479330243539fba323f703f094f" status: 200 len: 282 microversion: 2.36 time: 1.178710 Aug 25 13:03:29.563231 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1825/3704] 10.222.0.60 () {60 vars in 1364 bytes} [Thu Aug 25 13:03:28 2022] GET /compute/v2.1/os-quota-sets/3ee05278cbeb4387adf5632dc68e4874?user_id=5e742479330243539fba323f703f094f => generated 282 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:03:29.822080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:29.827576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:29.870695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.871568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.872363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:29.873603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:29.882019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:29.883069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.815745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:30.856695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6ee468d-6657-48d1-897c-ae00d3248db2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1281 microversion: 2.1 time: 1.045191 Aug 25 13:03:30.863115 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1826/3705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:29 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1281 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:30.890456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:30.891706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:30.925124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.929322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.936815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.938712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:30.945985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:30.950093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:30.975420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:31.044365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b42c5e78-0a9c-4c37-b71c-4a886e78f255 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1531 microversion: 2.1 time: 1.767625 Aug 25 13:03:31.052705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1880/3706] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:29 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1531 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:31.106912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:31.108241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:31.116888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-354be276-29a1-4f79-a4f8-8daf3ec3dc3f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/ips" status: 200 len: 143 microversion: 2.1 time: 0.251578 Aug 25 13:03:31.118044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1827/3707] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:03:30 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/ips => generated 143 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:31.166284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:31.166284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:31.166747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:31.167488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:31.168371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:31.169172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:31.950680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:31.955645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:31.990359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:31.991286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:31.992070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:31.997751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:31.998634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:32.004223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:32.486457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:32.546537 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a989a563-7f8a-47f8-a6ea-4cacebd93932 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1281 microversion: 2.1 time: 0.623996 Aug 25 13:03:32.548037 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1828/3708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:31 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1281 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:32.591930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:32.595593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:32.625051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:32.627706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:32.629037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:32.637406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:32.639044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:32.642416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:33.256179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:33.322807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:33.333568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:33.338677 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5b34032-9f83-4f70-a081-cd3e910c1295 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2949 microversion: 2.42 time: 2.283726 Aug 25 13:03:33.347127 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1881/3709] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:03:31 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2949 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:33.420230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:33.425268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:33.481085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.485153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.488275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:33.491482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:33.496621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:33.498002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:34.783967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d9967ab-5da7-4c78-9a45-81aec9812efd tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e/os-interface" status: 200 len: 1828 microversion: 2.42 time: 1.378006 Aug 25 13:03:34.787830 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1882/3710] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 13:03:33 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e/os-interface => generated 1828 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:03:34.810251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:34.822839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:34.858150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:34.869545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:34.870876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:34.872628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:34.873843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:34.874947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:35.385125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:35.404664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:35.416720 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0d18835-3c6a-4c58-a541-a4ae5e55d3c6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.861378 Aug 25 13:03:35.417647 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1829/3711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:32 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:35.460692 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0780d85e-bf47-4bba-a6fc-088c6825511f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1281 microversion: 2.1 time: 0.670297 Aug 25 13:03:35.474563 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1883/3712] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:34 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1281 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:36.466237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:36.467333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:36.483810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.487017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.488349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:36.490186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.491604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.496575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:36.521051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:36.532495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:36.584757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.585933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.586652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:36.596091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:36.597079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:36.597792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:37.414754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=9 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:37.518359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=22 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:38.472653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:38.519019 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1baa211e-dd40-429b-8ae7-7ab5769f58a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.052527 Aug 25 13:03:38.519899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1830/3713] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:36 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:38.559482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661d9c61-2d03-4adb-a89c-aeb965ac8ed6"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:38.585385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:38.601427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:38.603595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:38.605296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:38.607830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:38.609303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:38.610648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:38.922051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:38.963275 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c99496e-eaff-4858-aab5-f0b103b4203d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.455675 Aug 25 13:03:38.972348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1884/3714] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:36 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:39.494807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:39.570056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:39.571418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:39.651022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:39.652937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:39.654963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:39.656663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:39.657938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:39.660035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:39.661710 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-07917a85-ed5a-4319-9ebd-5cb7cdf67b70 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111451 Aug 25 13:03:39.663040 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1831/3715] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:03:38 2022] POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:40.019317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:40.021604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:40.066016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.067074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.072225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:40.076699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:40.078008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:40.083398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:42.310784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:42.361849 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43b50867-dbc1-4a54-9667-b1e4cb5be7eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.806878 Aug 25 13:03:42.366203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1885/3716] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:39 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:42.392010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5", "tag": "c5b2d1ba-503b-46d8-9f78-6f7da3edcb05"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:42.446646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:42.454048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:42.455335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:42.509441 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] Creating event network-changed:c5b2d1ba-503b-46d8-9f78-6f7da3edcb05 for instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 on n-h1-850468-18 Aug 25 13:03:42.530813 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-36c85778-24b9-4776-943a-561dad73673b req-d72c2c9a-8a20-49f9-9362-c561a270f129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159210 Aug 25 13:03:42.531966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1886/3717] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:42.759998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:42.800312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:42.826988 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ddf7911f-0b4f-42b9-9471-ef597d02e5f2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.823691 Aug 25 13:03:42.841505 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1832/3718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:40 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:43.418291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:43.419676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:43.456999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:43.457930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.458774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:43.460141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:43.474450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.475211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:43.882904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:43.883918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:43.955971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:43.956642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.965424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:43.967029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:43.967777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:43.975534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.608528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.646265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:46.653339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-531c5752-7743-4ae0-accf-e004471dc4cc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 3.235233 Aug 25 13:03:46.655194 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1887/3719] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:43 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 3250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:46.664339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6834ff-a57c-420a-beb1-c7449dba692d", "tag": "9e23353d-91fa-4826-88cf-6e50db8f54e3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:46.677597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7b9237b-515b-443e-949c-dfec5ca78de2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.801696 Aug 25 13:03:46.686809 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1833/3720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:43 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:46.729963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:46.741067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:46.742249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:46.783093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] Creating event network-changed:9e23353d-91fa-4826-88cf-6e50db8f54e3 for instance fb6834ff-a57c-420a-beb1-c7449dba692d on n-h1-850468-18 Aug 25 13:03:46.804337 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1431ecea-fbbe-410e-8905-51dc24427b32 req-4232c674-7392-4f9d-ba51-fbe5c470659d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146587 Aug 25 13:03:46.812968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1888/3721] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:47.717082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:47.725474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:47.725784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:47.727550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:47.772958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.776740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.777928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.779576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.781335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.782254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.783437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.792016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.793411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:47.794824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:47.795717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:47.796534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.022481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:49.051203 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6adacbf-9231-49c0-b412-9dffd2b48c72 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 1.353291 Aug 25 13:03:49.057605 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1834/3722] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:49.080005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd19d46e-efc9-47c0-8c8b-528390e5e113", "tag": "07e4a235-684e-4cd1-93fb-8680d18bdbd5"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:49.146577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:49.147625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:49.151617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:49.192521 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] Creating event network-changed:07e4a235-684e-4cd1-93fb-8680d18bdbd5 for instance cd19d46e-efc9-47c0-8c8b-528390e5e113 on n-h1-850468-18 Aug 25 13:03:49.213182 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6babed35-8fb1-41a4-85ac-29aed47dab32 req-5f95baae-e361-425b-9a09-af51fade1a94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147797 Aug 25 13:03:49.220670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:49.225964 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1835/3723] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:03:49.241102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0b7078b-c921-4d44-8f66-02799e40fdfd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.519904 Aug 25 13:03:49.248650 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1889/3724] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:47 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:49.675417 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:03:49.675694 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:03:49.836438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1433473177", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:50.106249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:50.107086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:50.109616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:50.193638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:50.197242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:50.200656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:50.204841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:50.210070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:50.213937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:52.911217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:52.926782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:52.927898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:52.928630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:52.929347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:52.933426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:52.942841 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbf59e20-8151-41df-be53-2d312d296904 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.847330 Aug 25 13:03:52.945026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1890/3725] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:50 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:52.993033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:52.996250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:52.997899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:52.999994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.017790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.027859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.030514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.037025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.037943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.038534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.038765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.040234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:53.041740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:53.071243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:53.153956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:53.178323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for user 2678c6b68a0c4ad8b9b72dea2ec21741 and project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:53.249223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:53.253737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:53.438173 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e2a1d7d7-f57a-4036-904a-2a9cf009f5f3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.160618 Aug 25 13:03:53.441986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1836/3726] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:03:53.776548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:53.807870 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-508235ec-9a73-47e4-86f2-78678cb397ce tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 0.856933 Aug 25 13:03:53.814577 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1891/3727] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:52 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:54.030597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1962783382", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:03:54.050399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:54.062977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:54.089347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.094444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.097037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.099422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:54.101614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:54.102959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:54.124173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:54.245160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=85 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:54.331998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:03:56.329080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:03:56.330850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:03:56.332341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:03:56.345727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:03:56.346731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:03:56.355047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:56.382694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.383780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.386020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.388990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.390105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.391128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.401944 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b68ff90-be28-4f13-ae54-740faaed9ad8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.398211 Aug 25 13:03:56.437334 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1892/3728] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:54 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:56.445041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:03:56.469745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:56.471283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:56.502885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:03:56.507969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.510517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.511838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.514544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:56.516050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:56.516873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for user 2678c6b68a0c4ad8b9b72dea2ec21741 and project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:03:56.518778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:56.657964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:03:56.682703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:03:56.979910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d5d5043-f792-434f-b422-84311dbbf51f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.977157 Aug 25 13:03:56.984594 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1837/3729] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:03:57.005099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71dab5ce-c440-4853-91ce-d5ed6b02d2ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:57.011369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71dab5ce-c440-4853-91ce-d5ed6b02d2ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:57.859649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71dab5ce-c440-4853-91ce-d5ed6b02d2ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:57.897742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71dab5ce-c440-4853-91ce-d5ed6b02d2ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1214 microversion: 2.1 time: 0.898815 Aug 25 13:03:57.903475 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1838/3730] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:56 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1214 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:03:57.931914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:57.939010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:57.972269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.975974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.980826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:57.985106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:03:57.987662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:03:57.997796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:03:58.846920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:58.907738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e94a02d-c314-4e96-bdf2-467d83555e0c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.466855 Aug 25 13:03:58.921187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1893/3731] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:56 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:58.955775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2759b644-c1b0-4ff3-b013-4cc5e7529a2d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:58.962926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2759b644-c1b0-4ff3-b013-4cc5e7529a2d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:03:59.324983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2759b644-c1b0-4ff3-b013-4cc5e7529a2d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:03:59.366857 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2759b644-c1b0-4ff3-b013-4cc5e7529a2d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1214 microversion: 2.1 time: 0.422240 Aug 25 13:03:59.379898 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1894/3732] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:58 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:03:59.957832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:03:59.963982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:00.003358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.005696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.006758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:00.010544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:00.013795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:00.014833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:01.237364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:01.275827 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d5eeec9-bd66-45a1-acfd-e94175eb812f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 3.366205 Aug 25 13:04:01.284921 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1839/3733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:57 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 3381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:01.311634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:01.316590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:01.362830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.363828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.371480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:01.374062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:01.375019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:01.375832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.119258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:02.181691 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ed0997e-9b1a-4f2d-8878-b104bb8c2104 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1274 microversion: 2.1 time: 0.894202 Aug 25 13:04:02.183164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1840/3734] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:01 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1274 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:02.205191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:02.213888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:02.254531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:02.268953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:02.270459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.272370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:02.280937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:02.282185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.386940 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4fbfe9f0-b880-4cbf-9cc5-b65e5ae9ad70 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/ips" status: 200 len: 150 microversion: 2.1 time: 0.201340 Aug 25 13:04:02.395523 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1841/3735] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:04:02 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/ips => generated 150 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:02.479681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5", "name": "network-vif-plugged", "status": "completed", "tag": "c5b2d1ba-503b-46d8-9f78-6f7da3edcb05"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:02.596412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:02.602147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:02.612771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.758271 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] Creating event network-vif-plugged:c5b2d1ba-503b-46d8-9f78-6f7da3edcb05 for instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 on n-h1-850468-18 Aug 25 13:04:02.799168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d1c2e2f8-629e-42b2-a14f-48233e8de21e req-0c7817f7-df91-499e-b7dd-e7819be93432 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.361970 Aug 25 13:04:02.805158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1842/3736] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:02.854936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:02.856233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:02.913122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:02.914175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:02.925244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:02.926892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:02.928047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:02.949201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.287452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:04.316964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6fa90fb0-b635-498f-bfee-be68f1b90596 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 4.367673 Aug 25 13:04:04.327068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1895/3737] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:03:59 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 4379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:04.339816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:04.365422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.366474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.367642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.437211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:04:04.533702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:04.585120 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2b0293db-4022-4177-9757-54959f6644d0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 1.769525 Aug 25 13:04:04.593987 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1843/3738] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:02 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:04.628037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:04.629851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:04.657048 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8532d5d1-9240-4e5d-82b9-fea36594db9a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action" status: 202 len: 0 microversion: 2.1 time: 0.324041 Aug 25 13:04:04.665820 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1896/3739] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:04:04 2022] POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:04:04.678736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.683121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:04.686517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.687458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.691019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.692701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:04.693900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.699559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.729298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.737876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.738767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:04.740058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:04.740934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:04.742600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.694207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:05.771424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-313050e6-4573-4a15-ad34-a91a0ec465bc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1272 microversion: 2.1 time: 1.160100 Aug 25 13:04:05.778361 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1844/3740] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:04 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1272 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:05.800007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:05.807896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:05.831430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.842006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.843452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:05.845247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:05.851677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:05.853957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:06.409059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:06.818873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:06.872777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8db19cf-a695-4abf-bb9b-934b77bb2300 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 2.195537 Aug 25 13:04:06.892185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1897/3741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:04 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:06.908976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:06.916257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:06.935179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:06.936730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:06.938230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:06.944457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:06.946023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:06.948228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.047515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.079074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1db4623a-7db5-49a1-ad52-19fff6a8ace0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.298293 Aug 25 13:04:07.120944 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1845/3742] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:05 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:07.185656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:07.196189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:07.231121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.232459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.233371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.234500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.235342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.237235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.445966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.458363 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-419a7041-0fa2-4a0e-a2b9-3c233bc627e8 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1272 microversion: 2.1 time: 0.331270 Aug 25 13:04:07.473106 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1846/3743] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:07 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:07.715485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:07.736750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50dd9cb4-09f9-46fe-b1b0-f2fccee52c6f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 0.856090 Aug 25 13:04:07.737942 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1898/3744] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:06 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:07.893307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66afa70b-5f1d-49fb-9aaf-640c8d75d37b"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:07.911279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:07.926061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:07.933006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:07.938714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:07.950913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.958148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.959427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.961121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.965734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.966629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.967412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.968791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:07.969673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.970889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:07.971778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:07.979303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:08.959350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:08.992151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c58e7236-393d-4606-a71f-77ef3ed689ea tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.067860 Aug 25 13:04:09.012950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1899/3745] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:07 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:09.035167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:09.043555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:09.073904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.074830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.076236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.077478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.078175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.078805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.097026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18836ad4-27c2-45b6-b485-386cef9da044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209948 Aug 25 13:04:09.100770 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1847/3746] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:04:07 2022] POST /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 194 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:09.115432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:09.121596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:09.146197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.147912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.149186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.151618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.153340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.154634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.333757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:09.867888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:09.921522 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-214c7d18-e734-480e-bd53-b67c15b508ed tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1272 microversion: 2.1 time: 0.817837 Aug 25 13:04:09.925845 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1848/3747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:09 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1272 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:09.947892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:09.963486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:09.984384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.985839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:09.987044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:09.988736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:09.990269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:10.006963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.196240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.209016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:11.233230 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28e76a80-fc8a-4aea-b068-22b201973623 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.206491 Aug 25 13:04:11.235038 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64a6c39d-e821-4c26-804f-6b3e52f376dc tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 1.306756 Aug 25 13:04:11.236625 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1849/3748] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:09 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:11.240749 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1900/3749] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:09 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:11.249847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:11.264414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:11.265562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:11.266435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:11.283058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:11.285679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:11.292216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:11.293090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.294382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:11.295567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:11.296320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.297101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:11.298322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:11.299109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:11.302188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:11.303195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.498129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:13.548934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bed9baca-ad80-4e67-92db-ea4202bd859c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 2.302419 Aug 25 13:04:13.556152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1901/3750] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:11 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:13.590395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:13.595816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:13.637856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.648298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.651964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.653990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.660166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.668444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.714762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:13.779252 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dd2c10ab-0491-4df1-89d9-31582d8d465d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 2.540407 Aug 25 13:04:13.780403 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1850/3751] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:11 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:13.834461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:13.849153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:13.893154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.901178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.904647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:13.906616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:13.913070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:13.913070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:14.018046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:16.218785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.262467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-685c618e-6af6-41b5-8472-051b4df165bf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 2.703592 Aug 25 13:04:16.286107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1902/3752] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:13 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 2724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:16.311855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:16.337767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:16.357949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.362797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.364208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.371845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.373295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.378475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.694104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:16.723372 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8789e6c5-bc6a-478d-9b61-66cb14395a24 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.936141 Aug 25 13:04:16.736650 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1851/3753] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:13 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:16.746734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6834ff-a57c-420a-beb1-c7449dba692d", "name": "network-vif-plugged", "status": "completed", "tag": "9e23353d-91fa-4826-88cf-6e50db8f54e3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:16.809489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.815902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.817306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.865747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] Creating event network-vif-plugged:9e23353d-91fa-4826-88cf-6e50db8f54e3 for instance fb6834ff-a57c-420a-beb1-c7449dba692d on n-h1-850468-18 Aug 25 13:04:16.891520 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-dd5cc95c-8d9f-4616-9f18-ee6a42e2b2b2 req-7ca9d250-dc0e-402a-86f8-fc583bb0d727 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152086 Aug 25 13:04:16.898464 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1852/3754] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:16.918037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:16.930149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:16.953499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.963184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.964517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:16.970596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:16.971925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:16.979974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.374622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:19.402146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8113f023-7cae-486f-926a-ecb0b3a8ca88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 3.113162 Aug 25 13:04:19.404064 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1903/3755] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:16 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 3117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:19.416173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1ffb5c-998a-42af-91c0-a175d309a3b4", "tag": "e6019d06-c951-4639-9b3e-0410e45fd4c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:19.445822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.447884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.450413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.480930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] Creating event network-changed:e6019d06-c951-4639-9b3e-0410e45fd4c6 for instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 on n-h1-850468-18 Aug 25 13:04:19.494108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fca8d8e3-0728-48bd-8ded-6f07fc989feb req-3831e64e-8d9b-4b65-8d02-e141d497beff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084964 Aug 25 13:04:19.496290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1904/3756] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:19.513573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:19.515991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:19.542415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.544500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.547136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.551649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.557290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.559188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.735539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:19.783300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fad0404b-5a39-450b-87af-dc1fcffbd1b6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 2.881325 Aug 25 13:04:19.784924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1853/3757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:16 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:19.813194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:19.825640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:19.857808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.859173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.860460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:19.862163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:19.873423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:19.874702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:20.922796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:20.956690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b264e84-479b-47fd-968e-1cbc7c809891 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.457426 Aug 25 13:04:20.984831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1905/3758] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:19 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:21.013600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd19d46e-efc9-47c0-8c8b-528390e5e113", "name": "network-vif-plugged", "status": "completed", "tag": "07e4a235-684e-4cd1-93fb-8680d18bdbd5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:21.047786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.068922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.069781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.106530 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] Creating event network-vif-plugged:07e4a235-684e-4cd1-93fb-8680d18bdbd5 for instance cd19d46e-efc9-47c0-8c8b-528390e5e113 on n-h1-850468-18 Aug 25 13:04:21.126475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-42a5f4fc-ee27-4ce8-97be-d20c517fdc21 req-f7d82cf9-3291-4825-abc4-6b1b4805e177 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139279 Aug 25 13:04:21.154280 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1906/3759] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:21.167223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:21.177358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:21.195832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.197894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.199155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.200967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:21.202199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:21.203268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:21.961196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:22.001512 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-870cd5b2-c493-4344-9e69-d6aacfc5dbf2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 2.207304 Aug 25 13:04:22.003502 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1854/3760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:19 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:22.010617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:22.022846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:22.054487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.056630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.058678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.064661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.065710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.069801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.276753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:22.312481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c48db77a-8731-4f4d-8789-58961df5dddf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 1.153733 Aug 25 13:04:22.314781 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1907/3761] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:21 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:22.344736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:22.347037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:22.377607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.404291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.405119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:22.406476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:22.418225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:22.419211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.063713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:23.154284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d2c1b5d-d53a-46e7-a333-b5924ecfa513 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.138296 Aug 25 13:04:23.155478 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1855/3762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:22 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:23.173966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:23.213233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.221571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.225128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.310036 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] Creating event network-changed:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:04:23.341476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4539e6ac-c184-4bf3-9aba-175a889fba56 req-ca10b64e-8d13-4fac-98a2-3be45566997b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176129 Aug 25 13:04:23.343437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1856/3763] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:23.367059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:23.387561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:23.392627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:23.413908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bdd55399-d10e-4324-874e-2545c5fa48f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.094537 Aug 25 13:04:23.419622 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1908/3764] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:22 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:23.429057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.431701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.436750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:23.437493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.438729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:23.439169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.440470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.441474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.471856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.475887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.485340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.487198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:23.495703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:23.500002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:23.976015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.015932 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5e56ecd-db10-453a-8095-a3bf3798e62e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 0.593583 Aug 25 13:04:24.019128 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1909/3765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:23 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:24.215208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:24.225752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:24.246120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.254762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.255939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.257588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.269678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.271059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.281124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:24.361825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:24.391616 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7467f58f-2d76-445f-a1af-b35595a3988b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 1.033222 Aug 25 13:04:24.392479 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1857/3766] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:23 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:24.476200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:24.479970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:24.509584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:24.514383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.520651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.524004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:24.526055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:24.526882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:24.529066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.307151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:25.357013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7579e5fa-efe5-418c-b9b3-e9f8355a0028 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.149406 Aug 25 13:04:25.372257 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1910/3767] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:24 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:25.392702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:25.392702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:25.417435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.418237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.419041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.420445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.421301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.432816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.513425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:25.541554 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f8c4f30-3151-46c9-8b6d-9df9246887f1 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.080993 Aug 25 13:04:25.544694 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1858/3768] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:24 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:25.591576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:25.596270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:25.623678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.625158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.633166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:25.637515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:25.638660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:25.643292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.565147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:26.593972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:26.594996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-30291f51-affc-4dd4-b59b-38e0612f0201 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 1.234565 Aug 25 13:04:26.599468 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1911/3769] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:25 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:26.619260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b59875f-edca-4181-91e8-18e3157c3e02 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1526 microversion: 2.1 time: 1.066144 Aug 25 13:04:26.627774 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1859/3770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:25 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1526 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:26.632951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:26.637747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:26.657154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:26.658508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:26.686829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=40 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:26.691556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.692372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.693126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.694481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.695336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.696164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.701017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.708058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.714584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:26.716679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:26.717948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:26.723025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.147598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:28.190719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:28.211063 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf418d4a-a924-4fbf-9cb8-11b5a6a68ebd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.575437 Aug 25 13:04:28.236508 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1860/3771] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:26 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:28.239745 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c17d602a-e208-413c-a0d5-24a696b58dd6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.629719 Aug 25 13:04:28.247029 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1912/3772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:26 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:28.276416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:28.277230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:28.277811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:28.288971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:28.299769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.300826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.301645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.308482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.309492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.312369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.313306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.315684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.318438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:28.322826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:28.324358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:28.325210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.147711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:29.177394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1313533-6e9b-4e7b-bc59-79d2ecc24b72 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 0.938097 Aug 25 13:04:29.181522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1861/3773] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:28 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:29.239996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:29.266586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:29.281116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:29.288242 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-07c26296-6c5a-4a7f-a62f-e67737e4ba07 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1508 microversion: 2.1 time: 1.036212 Aug 25 13:04:29.331963 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1913/3774] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:28 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1508 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:29.333068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.334001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.334831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.336237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.337775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.338596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.362489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:29.366701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:29.394906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.394906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.426410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:29.428420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:29.429290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:29.430119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:30.864525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.901732 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a794794-6536-479c-81d4-a9e069177cec tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1323 microversion: 2.1 time: 1.643003 Aug 25 13:04:30.909459 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1862/3775] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:29 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1323 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:30.933707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:30.934830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:30.939178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:30.975719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:30.982491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:30.983331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:30.984790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:30.985678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:30.986081 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-878ec155-beb2-48dd-8124-a46f4c7d9fe7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.649891 Aug 25 13:04:30.989134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1914/3776] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:29 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:30.995616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.010333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:31.014035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:31.048487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.056052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.057385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.059087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:31.060357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:31.061464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:31.967257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:31.973062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.005334 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-30c9adb7-ad25-4a3c-be34-533a9f6992d7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1508 microversion: 2.1 time: 1.013206 Aug 25 13:04:32.006608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5426888-2aca-4721-819c-18fb2d6d996b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 1.094134 Aug 25 13:04:32.010107 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1863/3777] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:30 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:32.026883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1915/3778] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:30 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1508 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:32.033470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.050250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.055700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.061824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.078405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.079745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.080921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.082520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.083686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.084813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.085747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.086073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.091657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.093966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.095229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.098929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.758779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:32.796304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52b76826-25d5-413e-9a05-1e42aef1ce45 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 200 len: 1515 microversion: 2.1 time: 0.781647 Aug 25 13:04:32.799413 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1864/3779] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:32 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 1515 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:32.839421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:32.840529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:32.851980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.853728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.854660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:32.858452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:32.859711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:32.861864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.183789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:33.217767 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99f4084f-37c1-44dd-a2a4-cbbb0cd3d3bc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.170916 Aug 25 13:04:33.227681 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1916/3780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:32 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:33.244565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:33.248648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:33.274326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.277875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.281225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.283438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.292827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.294079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.815785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:33.851661 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27c12c4a-5713-4010-b99f-cc5f51421df7 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1516 microversion: 2.1 time: 1.020209 Aug 25 13:04:33.872074 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1865/3781] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:32 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1516 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:33.909059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:33.911842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:33.931588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.934225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.935618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:33.937367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:33.939767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:33.941944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.009055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:34.040586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c674d11-e810-472f-8079-9494e6a3b3c4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 0.809831 Aug 25 13:04:34.045007 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1917/3782] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:33 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:34.068531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:34.069808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:34.100597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.122093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.123846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:34.132222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:34.143088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:34.144822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.242611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:35.295677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df7d79c9-00e8-458d-81e4-89907c9964f4 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1508 microversion: 2.1 time: 1.418542 Aug 25 13:04:35.322391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1866/3783] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:33 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1508 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:35.342683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:35.348610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:35.363902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.365861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.368787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.370255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.371670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.373017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.407235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:35.464902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-185274c7-9e70-4225-b437-817ab1377dd2 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 200 len: 1516 microversion: 2.1 time: 1.380994 Aug 25 13:04:35.466727 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1918/3784] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:34 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 1516 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:35.479938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1ffb5c-998a-42af-91c0-a175d309a3b4", "name": "network-vif-plugged", "status": "completed", "tag": "e6019d06-c951-4639-9b3e-0410e45fd4c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:35.522150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.527677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.530684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.601912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] Creating event network-vif-plugged:e6019d06-c951-4639-9b3e-0410e45fd4c6 for instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 on n-h1-850468-18 Aug 25 13:04:35.634222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-06323e09-185f-42cf-ac23-ab0bed5b7d59 req-8c090a96-4210-46f3-9ad2-9314ce7bbc14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156960 Aug 25 13:04:35.639642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1919/3785] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:35.675737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:35.677161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:35.710187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.716787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.719891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:35.724883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:35.735861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:35.739930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:36.443101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:36.531229 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73d488c2-5432-4994-89c4-5197374afd50 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1719 microversion: 2.1 time: 1.206532 Aug 25 13:04:36.556517 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1867/3786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:35 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1719 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:36.592470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:36.607397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:36.634131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:36.635650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:36.636863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:36.638868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:36.640053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:36.652010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:36.655078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:36.676950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93376c62-bf45-41b2-b4d0-688f9e58494a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 1.032135 Aug 25 13:04:36.679439 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1920/3787] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:35 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:36.701351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: .version_select at 0x7fc6c6ad8550>, body: {"keypair": {"name": "tempest-keypair-216652431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBIsHtZuOJo+wCkb6OSIbhiO4QFjl3fXxVBYEBPprOKhDKWi/K2eSvRHwZ5b+w5bAcjXfC8HqmLvvYabVEth43eCuRzMdcfnSguqidU0xacgTuMXq4hL2yGI2K1UuJXxw=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:36.786975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:36.789626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:04:36.828310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:36.845491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:04:36.897397 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [240fb10b-69ec-4ee0-811e-acdb72400662] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:04:37.017755 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-848e6853-7848-4bde-8199-6e132852076b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 204 len: 0 microversion: 2.1 time: 0.455006 Aug 25 13:04:37.020002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1868/3788] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:36 2022] DELETE /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:37.054433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:37.055980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:37.078535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:37.080954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:37.082399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:37.085275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:37.087551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:37.089032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:37.658541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:37.675922 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d4f8ecc8-6a1a-45fc-b090-3ccf94808ebd tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1451 microversion: 2.1 time: 0.651451 Aug 25 13:04:37.678559 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1869/3789] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:37 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1451 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:37.688253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:37.689913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:37.703321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:37.707654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:37.709154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:37.711014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:37.713066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:37.714534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:37.918486 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [240fb10b-69ec-4ee0-811e-acdb72400662] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37082. Aug 25 13:04:37.957414 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81b4da30-aadd-448f-b501-c22346029bed tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.275492 Aug 25 13:04:37.959320 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1921/3790] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:04:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:37.982112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:37.985471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:37.999652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.006552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.008003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.010715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.012239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.013787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.466401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.515336 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebce9719-04f2-4249-8f7a-d4b0d04eb0cf tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 200 len: 1522 microversion: 2.1 time: 0.834312 Aug 25 13:04:38.519806 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1870/3791] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:37 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:38.559347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:38.561238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:38.579126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.580250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.581281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.583775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:38.584878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:38.587543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:38.934609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:38.965850 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb369377-6de3-486a-84e8-f72a3e61f248 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1696 microversion: 2.1 time: 1.000737 Aug 25 13:04:38.986999 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1922/3792] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:37 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1696 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:39.026357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:39.031558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:39.052895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.060824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.064044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.069572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.075044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.076601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.515323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:39.564738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f82d219f-8e26-4324-a4ea-2154c430faff tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1314 microversion: 2.1 time: 1.031065 Aug 25 13:04:39.566753 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1871/3793] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:38 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:39.592038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "name": "network-vif-unplugged", "status": "completed", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}, {"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:39.646561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.647708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.648289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.700674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.server_external_events [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Unable to find a host for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58. Dropping event network-vif-unplugged {{(pid=122700) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 13:04:39.701650 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] Creating event network-vif-plugged:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:04:39.739472 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-49d092ef-32f0-41c7-88c5-3977480f79fb req-add6d7f7-0c68-42a3-b9a4-4b9656bcb6df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.170181 Aug 25 13:04:39.740663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1872/3794] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 173 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 13:04:39.761791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:39.782053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:39.782568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:39.783098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:39.909687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Going to try to start instance {{(pid=122700) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:04:40.103088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0583203b-3086-4ad3-bd23-fb8b16a50c62 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action" status: 202 len: 0 microversion: 2.1 time: 0.359702 Aug 25 13:04:40.109762 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1873/3795] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:04:39 2022] POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:04:40.127875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:40.129234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:40.147106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.148365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.150068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.151724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.152799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.153548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.257135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:40.301507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5cdde080-3390-4cca-9b18-ed120f0295cf tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1451 microversion: 2.1 time: 1.307761 Aug 25 13:04:40.330309 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1923/3796] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:38 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1451 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:40.376670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:40.380801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:40.441004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.449601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.450828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:40.453748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:40.460954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:40.464229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.436725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:41.442313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:41.466306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-054ac979-45d9-43df-a34c-c7805aa3d304 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 200 len: 1522 microversion: 2.1 time: 1.353188 Aug 25 13:04:41.474621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d39fbf9-0397-4c74-aee3-6a6509cb1316 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1705 microversion: 2.1 time: 1.124613 Aug 25 13:04:41.488203 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1874/3797] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:40 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 1522 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:41.489040 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1924/3798] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:40 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1705 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:41.518511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:41.521476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.527547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:41.528776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.546696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.547611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.554515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.556963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.558013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.558224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.559403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.560341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.561027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.561209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.562068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.563242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.681203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lazy-loading 'flavor' on Instance uuid 485bbda2-f007-480b-9cc0-1ab14dbc4a58 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:04:41.737685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'shelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state shelved_offloaded Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 14 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: {"shelve": {}} Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'shelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state shelved_offloaded Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'shelve': {}}} Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:04:41.763661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state shelved_offloaded Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state shelved_offloaded Aug 25 13:04:41.777585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:41.779208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'shelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state shelved_offloaded {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:41.781483 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e61f96b0-1594-4fc3-a404-b3be60548be0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 155 microversion: 2.1 time: 0.294878 Aug 25 13:04:41.794463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1875/3799] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:04:41 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 155 bytes in 307 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:04:41.806769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:41.808778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:41.827966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.829830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.831423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:41.834513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:41.836051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:41.838118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.514588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:42.550289 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-efbc2ed2-ed93-4de7-ab90-190df8fe7129 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1464 microversion: 2.1 time: 1.056465 Aug 25 13:04:42.553620 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1925/3800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:41 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1464 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:42.578977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:42.581239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:42.598974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.604752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.606442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.616028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:42.617380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:42.619065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:42.741922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122700) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:04:42.996591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:43.052865 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e1f9a45-5196-4a6c-992d-8c2b73701ada tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 200 len: 1480 microversion: 2.1 time: 0.478944 Aug 25 13:04:43.054895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1926/3801] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:42 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 1480 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:43.080644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:43.082482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:43.104813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b19b867-57fd-4758-b8f6-03373e33f515 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 1.300523 Aug 25 13:04:43.114273 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1876/3802] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:04:41 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:04:43.128487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.137381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.139266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.144474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.146385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.154186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.182400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:43.190990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:43.232217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.235595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.238380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:43.241263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:43.245440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:43.248938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.062173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.068907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.090491 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a2a464a6-a306-42f0-a0a5-c7b92b191161 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1314 microversion: 2.1 time: 1.972276 Aug 25 13:04:45.092914 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1877/3803] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:43 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1314 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:45.098458 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c91968e-ffbe-4e22-b2ad-18006949b333 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1705 microversion: 2.1 time: 2.040491 Aug 25 13:04:45.105772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5", "name": "network-vif-deleted", "tag": "c5b2d1ba-503b-46d8-9f78-6f7da3edcb05"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:45.113747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1927/3804] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:43 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1705 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:45.136722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.139407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.140467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.140897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.142509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:45.162211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.165174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.166785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.168934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.170425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.171979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.172647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] Creating event network-vif-deleted:c5b2d1ba-503b-46d8-9f78-6f7da3edcb05 for instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 on n-h1-850468-18 Aug 25 13:04:45.186098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-493c5ae8-0eb5-4357-b724-7f8f0c5e2395 req-c75f5337-2322-4d3c-8b01-0f05f6960905 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090378 Aug 25 13:04:45.192675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1878/3805] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:45.229300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.231490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:45.250003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.252517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.254116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.257682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:45.262372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.262372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.262372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.321419 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] HTTP exception thrown: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 HTTP/1.1 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5'} Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.325988 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 404 to user: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:45.333551 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7dda6881-f108-4e75-a7a4-a09e9d93406d tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 404 len: 111 microversion: 2.1 time: 0.133815 Aug 25 13:04:45.341158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1879/3806] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:45.348798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.362899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.364728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:45.377241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.379212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.380457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.382292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.383713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.384791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.599160 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1872fe6b-e32a-494f-a061-aa0adcb4c02c tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.255763 Aug 25 13:04:45.646326 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1880/3807] 10.222.0.60 () {58 vars in 1230 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:04:45.672233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8415b22f-f6d7-4ea0-890d-9250c46dfbd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8415b22f-f6d7-4ea0-890d-9250c46dfbd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 13:04:45.683949 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8415b22f-f6d7-4ea0-890d-9250c46dfbd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:45.694965 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8415b22f-f6d7-4ea0-890d-9250c46dfbd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.037521 Aug 25 13:04:45.700899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1881/3808] 10.222.0.60 () {58 vars in 1182 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:04:45.713480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:45.729371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:45.731589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:45.746787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.748176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.749051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.751148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:45.752519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:45.753636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:45.816958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:45.917169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59fb9387-4832-4db2-9ad8-06b4d983d6c4 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.210199 Aug 25 13:04:45.918840 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1882/3809] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers => generated 683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:45.967633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:46.001866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:46.004281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.servers [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Removing options 'limit' from query {{(pid=122700) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 25 13:04:46.004941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:46.045636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.048000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.049226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.054656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.060752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.064458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.167414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:46.270493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b685a321-bb74-4a90-abc3-9da1781f86fd tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.317486 Aug 25 13:04:46.287705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1883/3810] 10.222.0.60 () {58 vars in 1144 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:04:46.311643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:46.329351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:46.340930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.353126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.354089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.355562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.356506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.357329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.813281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:46.837779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-950daa7f-f252-47be-8d53-df27f82b71a2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1459 microversion: 2.1 time: 1.719854 Aug 25 13:04:46.840885 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1928/3811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:45 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1459 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:46.851471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:46.854823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:46.873229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.874930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.876407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.878597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:46.880183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:46.881457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:46.883798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:47.107033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:47.133898 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5cd9a7ac-82ae-40fa-88c9-855914be228f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1464 microversion: 2.1 time: 0.844061 Aug 25 13:04:47.143695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1884/3812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:46 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1464 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:47.162500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56b74cf5-5dcd-435e-aa3e-80711b8e7bee tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56b74cf5-5dcd-435e-aa3e-80711b8e7bee tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '-1' Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 13:04:47.192187 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 25 13:04:47.200470 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.205651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56b74cf5-5dcd-435e-aa3e-80711b8e7bee tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:47.216062 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56b74cf5-5dcd-435e-aa3e-80711b8e7bee tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.068648 Aug 25 13:04:47.217404 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1885/3813] 10.222.0.60 () {58 vars in 1142 bytes} [Thu Aug 25 13:04:47 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:04:47.240283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06ad8fc4-02e3-48e7-bf38-2ff77eb3c75e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06ad8fc4-02e3-48e7-bf38-2ff77eb3c75e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: action_args: {} Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'testing' Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 25 13:04:47.254884 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 25 13:04:47.263453 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:04:47.280457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06ad8fc4-02e3-48e7-bf38-2ff77eb3c75e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:47.282369 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-06ad8fc4-02e3-48e7-bf38-2ff77eb3c75e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.056216 Aug 25 13:04:47.300534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1886/3814] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:04:47 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:04:47.349924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a5540ff-61f1-41ef-8591-6e338963f695 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:47.372632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8a5540ff-61f1-41ef-8591-6e338963f695 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:47.392558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a5540ff-61f1-41ef-8591-6e338963f695 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:47.414275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.servers [None req-8a5540ff-61f1-41ef-8591-6e338963f695 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Flavor 'non_existing_flavor' could not be found {{(pid=122700) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 25 13:04:47.423025 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a5540ff-61f1-41ef-8591-6e338963f695 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.107933 Aug 25 13:04:47.426714 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1887/3815] 10.222.0.60 () {58 vars in 1178 bytes} [Thu Aug 25 13:04:47 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:04:47.458044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:47.483620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:47.485982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:47.526586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:47.528795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:47.530824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:47.534821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:47.535453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:47.536005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:47.750728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:47.790522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:47.797223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-023b02b5-dfa8-4abc-8712-4309a08c6585 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.349307 Aug 25 13:04:47.813248 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1888/3816] 10.222.0.60 () {58 vars in 1174 bytes} [Thu Aug 25 13:04:47 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:04:47.813678 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae885133-5ce7-48f1-ac9a-94f7a3bd65c2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1705 microversion: 2.1 time: 0.956784 Aug 25 13:04:47.825751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1289484160", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:47.826393 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1929/3817] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:46 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1705 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:47.860919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-973198620", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a60d176-8c8c-4348-8828-aa3cd40d7203"}], "security_groups": [{"name": "tempest-securitygroup--399607737"}], "key_name": "tempest-keypair-216652431", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:04:48.006399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:04:48.545857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] validate_networks() for [('2a60d176-8c8c-4348-8828-aa3cd40d7203', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:04:50.490159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:04:50.491280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:04:50.492156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:04:50.493667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:04:50.495101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:04:50.514222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:50.515091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:50.516068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:50.517884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:50.519157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:50.520253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:50.574646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:04:50.590286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Getting quotas for user 2678c6b68a0c4ad8b9b72dea2ec21741 and project 10a6e77cb29d430eb88d06ef30013a59. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:04:50.624009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:04:50.629450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:04:50.767144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e06453d-3776-45c9-989a-eeef34f7713d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.959441 Aug 25 13:04:50.769803 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1889/3818] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:04:50.790302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:50.801075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:50.802901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:50.814147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:50.815318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:50.816434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:50.829846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:50.841609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:50.843083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:51.092020 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c2b04a6-58ae-4a60-b755-636101f6b8b5 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.308872 Aug 25 13:04:51.094236 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1890/3819] 10.222.0.60 () {58 vars in 1184 bytes} [Thu Aug 25 13:04:50 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:04:51.118931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:51.120798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:51.134477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:51.135652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:51.136475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:51.137802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:51.149652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:51.152281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.307758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:52.355962 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d919d525-67a8-420e-93c7-3f7c86ba5555 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.258073 Aug 25 13:04:52.381089 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1891/3820] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:51 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:52.403195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:52.404460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:52.417577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.418685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.419665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.421193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.422144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.423001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.620807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:04:52.624486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:04:52.626590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:04:52.628087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:04:52.629669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:04:52.722470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.726777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.732462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.737796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:52.739933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:52.744594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:52.870740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:04:52.921069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:04:52.986370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.033805 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-810c7e5d-be2c-430e-a899-e3734d85870e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1709 microversion: 2.1 time: 0.650387 Aug 25 13:04:53.044653 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1892/3821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:52 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1709 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:53.066056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:04:53.070941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:53.073626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:53.090126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.091337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.092167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.093670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.094389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:04:53.094778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.095987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.348411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d67a59e-82e8-45db-a081-8c7564888d5c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.504323 Aug 25 13:04:53.360496 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1930/3822] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:04:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 5522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:04:53.363090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.380141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:53.391466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.393475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:53.409243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.410128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.410955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.412472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.413574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.415120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.426532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5fd54aa0-331c-4628-8d48-b32bf773edbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1210 microversion: 2.1 time: 0.364481 Aug 25 13:04:53.444597 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1893/3823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:53 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1210 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:53.467748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1fcdd5d2-4712-46a0-a41f-2e5419ae9f6d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:53.469455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1fcdd5d2-4712-46a0-a41f-2e5419ae9f6d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:53.631120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:53.697440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1fcdd5d2-4712-46a0-a41f-2e5419ae9f6d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.723205 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1fcdd5d2-4712-46a0-a41f-2e5419ae9f6d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1240 microversion: 2.1 time: 0.275763 Aug 25 13:04:53.729015 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1894/3824] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:53 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1240 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:53.761382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:53.763248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:53.793005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.802258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.808521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.811553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.824640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:53.827636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.831283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:53.856023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:53.864657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:53.870682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.566331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:54.582910 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21a2ca43-d735-47d1-976a-faa24967c02b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.230472 Aug 25 13:04:54.583959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1931/3825] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:04:53 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:54.612475 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a75af46-cdf1-4c35-b5af-eb8de3ceeb39 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.870497 Aug 25 13:04:54.637672 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1895/3826] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:53 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:54.661186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:54.680866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:54.686535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-80ae6c52-f030-4e75-8e1f-347f48ec3448 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:54.715716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-80ae6c52-f030-4e75-8e1f-347f48ec3448 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:54.724829 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-80ae6c52-f030-4e75-8e1f-347f48ec3448 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.079849 Aug 25 13:04:54.727141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1896/3827] 10.222.0.60 () {58 vars in 1178 bytes} [Thu Aug 25 13:04:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:04:54.727828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.728989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.736319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.745733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.752557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.760108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:54.762052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.812995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:54.817722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Searching by: {'deleted': False, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:04:54.825464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:54.857861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.859110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.862204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.864575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:54.873789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:54.875124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:54.983593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:04:55.104664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.129260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19dc6abf-447f-4157-8854-a6041cc14be9 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.379409 Aug 25 13:04:55.132056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3745b929-2c31-44c4-862a-59fb6f0c8a19 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1274 microversion: 2.1 time: 0.532561 Aug 25 13:04:55.138066 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1897/3828] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 13:04:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:04:55.149418 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1932/3829] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:54 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1274 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:55.173406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a24bb102-3f87-4897-b73a-645c9f51a909 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.176568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.178016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.179559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a24bb102-3f87-4897-b73a-645c9f51a909 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.192734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.194000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.196948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.199771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.201404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.205857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.283020 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] HTTP exception thrown: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 HTTP/1.1 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5'} Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:55.300637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:55.309548 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:55.313001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 404 to user: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:55.315081 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-94b348c0-898d-4b1a-b4ed-3277e720beac tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 404 len: 111 microversion: 2.1 time: 0.158718 Aug 25 13:04:55.316939 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1933/3830] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:55 2022] DELETE /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:55.334117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.341424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.377672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.387415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.391423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.403498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.405948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.410869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.533789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:55.739133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a24bb102-3f87-4897-b73a-645c9f51a909 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:55.760824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a24bb102-3f87-4897-b73a-645c9f51a909 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1240 microversion: 2.1 time: 0.620053 Aug 25 13:04:55.763308 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1898/3831] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:55 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1240 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:55.778346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.780336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.811352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.816381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.817663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.819292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.823473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.825759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.860252 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2595cfc7-4654-461b-89ab-f19c1208129e tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 204 len: 0 microversion: 2.1 time: 0.534697 Aug 25 13:04:55.866696 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1934/3832] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:55 2022] DELETE /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:55.884023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:55.889605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:55.936571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.940711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.949792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:55.951881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:55.953280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:55.954531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.101446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:04:56.374249 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1a19fe4-42f3-489c-a446-f6fa0e906f54 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 204 len: 0 microversion: 2.1 time: 0.503985 Aug 25 13:04:56.375960 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1935/3833] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:04:55 2022] DELETE /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:04:56.388420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.390009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.402757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.404047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.404967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.406330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.407216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.408058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.621294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:56.642764 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-661c36e1-e4f3-4343-bdcf-5d8bb6769f81 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1272 microversion: 2.1 time: 0.263481 Aug 25 13:04:56.644384 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1936/3834] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:56.655531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.657152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.671055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.672052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.673904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.675376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.676801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.679421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.698928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:56.727697 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dd5fe481-ccb5-40e4-9326-67e6bcecfe45 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.957677 Aug 25 13:04:56.733835 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1899/3835] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:55 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:56.738587 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] HTTP exception thrown: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 HTTP/1.1 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5'} Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.744294 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 404 to user: Instance 6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f50046b-f6df-4439-9820-9c48888b4264 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5" status: 404 len: 111 microversion: 2.1 time: 0.100897 Aug 25 13:04:56.752424 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1937/3836] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/6ea20a6b-e29f-4e3b-a9c5-fd2a168dacc5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:04:56.765293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.767853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.785141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.785741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.786617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.788394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.789388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.791545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.809047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:56.810293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:56.822572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:04:56.827536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.828491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.829317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:56.831495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:56.832540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:56.833346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.106415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:57.120405 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df7f229f-b4d6-4b02-bf61-21126a209de4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1236 microversion: 2.1 time: 0.319196 Aug 25 13:04:57.133387 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1938/3837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1236 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:57.345103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:57.375307 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-80c3c2f4-f265-49a2-9adf-d4b66e05133f tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1522 microversion: 2.1 time: 0.618160 Aug 25 13:04:57.376715 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1900/3838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:56 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:57.709860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:57.719384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:57.755034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.755936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.756747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.758132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.759588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.765155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.822588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:57.827242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:57.871065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.879161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.888760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:57.895829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:57.901673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:57.903962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.097501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:58.132584 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8bdbc3ca-a404-4cc6-94ec-302909dba5f9 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1272 microversion: 2.1 time: 0.444647 Aug 25 13:04:58.156578 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1939/3839] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:57 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:58.182541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:58.183750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:58.221729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.223062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.224015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.226414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.226675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.228202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.638334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:58.658580 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93584db4-68fc-40d2-b836-770e13b2e539 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1236 microversion: 2.1 time: 0.491290 Aug 25 13:04:58.684693 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1940/3840] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:58 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1236 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:58.703900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:58.717508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:58.729037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.729941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.730819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.740424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:58.741517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:58.742483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:58.840303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:58.897362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e83496f-b0ec-4781-93c8-f29055b5a303 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.109617 Aug 25 13:04:58.901812 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1901/3841] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:57 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:04:59.177274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:59.184742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:59.215710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.237714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.238953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.240723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.242023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.244830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.571915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:59.610610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7418961a-4cfe-4c70-8f6f-ed229ca31765 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1272 microversion: 2.1 time: 0.440688 Aug 25 13:04:59.616359 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1902/3842] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:59 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:04:59.702850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:04:59.725604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:04:59.766676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.767558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.768408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.774317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:04:59.776047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:04:59.776047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:04:59.927659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:04:59.997478 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67392b7d-876b-4336-a46a-b4700951476b tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1522 microversion: 2.1 time: 1.310470 Aug 25 13:05:00.018640 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1941/3843] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:58 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1522 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:00.065340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:00.066522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:00.132796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.135718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.146952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.150161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.159133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.166040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.350622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:00.380050 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8812bb2-f48c-4373-9423-7a1a4bc7cd1b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1236 microversion: 2.1 time: 0.677585 Aug 25 13:05:00.384198 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1903/3844] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:04:59 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1236 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:00.659800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:00.661480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:00.677682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.678691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.679400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:00.680931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:00.681608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:00.682291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:01.574472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:01.670241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3ea5d5d1-32c6-4b42-89c7-bf507663b597 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1272 microversion: 2.1 time: 1.022574 Aug 25 13:05:01.671549 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1904/3845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:00 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1272 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:01.712209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:01.721683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:01.769459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:01.771518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:01.772971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:01.779083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:01.781303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:01.785422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:02.349659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:02.388470 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba56d706-63a6-4177-bbc2-d6265b68578c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 2.354124 Aug 25 13:05:02.400172 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1942/3846] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:00 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:02.400172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:02.410908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:02.436169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:02.437410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:02.438213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:02.439173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:02.440046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:02.440697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:02.453881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:02.897667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:02.931179 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97755dd0-15dd-4661-b2e9-6f4358f54fa3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1292 microversion: 2.1 time: 0.538943 Aug 25 13:05:02.936719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1943/3847] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:02 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1292 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:03.001279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6834ff-a57c-420a-beb1-c7449dba692d", "name": "network-vif-unplugged", "status": "completed", "tag": "9e23353d-91fa-4826-88cf-6e50db8f54e3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:03.040688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.044652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.049153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.106461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] Creating event network-vif-unplugged:9e23353d-91fa-4826-88cf-6e50db8f54e3 for instance fb6834ff-a57c-420a-beb1-c7449dba692d on n-h1-850468-18 Aug 25 13:05:03.128093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ce83b9b4-2d8e-407a-a536-0425fdaadff7 req-2e747bcd-e67b-44d1-8924-eba075a7b52e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177055 Aug 25 13:05:03.139861 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1944/3848] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:03.155688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:03.162541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:03.189219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.191608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.196526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.198537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.205505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.213594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.255526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:03.302666 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e9c972b-405a-4399-b856-9c723c71efbb tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1522 microversion: 2.1 time: 1.621021 Aug 25 13:05:03.304039 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1905/3849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:01 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1522 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:03.429408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:03.436158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:03.449371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:03.486120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.487060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.487842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.489247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:03.490141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:03.490966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:03.819698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:04.709804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:04.743847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-775ec44d-6bd8-413e-bc73-92c511fb8291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 1.601118 Aug 25 13:05:04.751266 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1945/3850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:03 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:04.768559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:04.777378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:04.805541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:04.810995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:04.824223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:04.826226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:04.832470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:04.833642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:04.909934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:04.976801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:05.010976 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d89f9255-e4dc-4a23-827c-e00240caafe6 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.584673 Aug 25 13:05:05.018733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1906/3851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:03 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:05.038234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:05.045557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:05.075951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:05.078042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:05.082800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:05.087036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:05.088622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:05.090337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:05.752013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:05.819727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:05.845136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e67462e7-3233-4f50-858e-55c2bc80cef9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1300 microversion: 2.1 time: 1.089990 Aug 25 13:05:05.846756 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1946/3852] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:04 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1300 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:05.901162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:05.903062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:05.936361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:05.937715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:05.938916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:05.940564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:05.941705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:05.942822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.094241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:08.102375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:08.136479 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93a71838-2373-492d-82ff-2638a6f29848 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1522 microversion: 2.1 time: 3.115112 Aug 25 13:05:08.153191 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1907/3853] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:05 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1522 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:08.153489 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e38e0d9-0712-4be7-be80-12738abc640c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 2.263617 Aug 25 13:05:08.165161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1947/3854] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:05 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:08.184674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd19d46e-efc9-47c0-8c8b-528390e5e113", "name": "network-vif-unplugged", "status": "completed", "tag": "07e4a235-684e-4cd1-93fb-8680d18bdbd5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:08.238583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:08.239705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:08.240838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:08.241938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.243483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:08.305001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:08.306879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:08.313873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.315485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:08.322480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] Creating event network-vif-unplugged:07e4a235-684e-4cd1-93fb-8680d18bdbd5 for instance cd19d46e-efc9-47c0-8c8b-528390e5e113 on n-h1-850468-18 Aug 25 13:05:08.323844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:08.329314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.357288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e51cfa49-f263-402c-89ee-273be50e089b req-c4a0fa56-88db-4361-8594-5e8130ebd742 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190765 Aug 25 13:05:08.358794 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1948/3855] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:08.390689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:08.392092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:08.419519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:08.425237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:08.429658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.432046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:08.435345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:08.437082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:08.894856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:08.943373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c07f4450-4e15-4b01-b189-2ea53dd97e08 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1298 microversion: 2.1 time: 0.579036 Aug 25 13:05:08.966165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1949/3856] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:08 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1298 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:09.339126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6834ff-a57c-420a-beb1-c7449dba692d", "name": "network-vif-deleted", "tag": "9e23353d-91fa-4826-88cf-6e50db8f54e3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:09.404103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.405693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.406820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.452140 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] Creating event network-vif-deleted:9e23353d-91fa-4826-88cf-6e50db8f54e3 for instance fb6834ff-a57c-420a-beb1-c7449dba692d on n-h1-850468-18 Aug 25 13:05:09.471198 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5bdc27b9-45f5-42df-b186-52dd3bcd1267 req-1bd576e1-0ce8-4836-8529-0c7724b0426f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.502708 Aug 25 13:05:09.473571 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1950/3857] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:09.491910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:09.505099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd19d46e-efc9-47c0-8c8b-528390e5e113", "name": "network-vif-deleted", "tag": "07e4a235-684e-4cd1-93fb-8680d18bdbd5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:09.545731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.549186 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aaed38cd-37b4-44d6-adf6-61cfa5b5597e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.367799 Aug 25 13:05:09.551439 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1908/3858] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:08 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:09.562485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.567678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.590492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:09.594548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:09.622543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] Creating event network-vif-deleted:07e4a235-684e-4cd1-93fb-8680d18bdbd5 for instance cd19d46e-efc9-47c0-8c8b-528390e5e113 on n-h1-850468-18 Aug 25 13:05:09.630565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.634447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.644783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.647537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.660487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.662537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.715715 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b4645948-055d-42ce-bd4d-9eedfcdd3816 req-95744e8e-313d-4816-9029-b68cdfa7276f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239126 Aug 25 13:05:09.718919 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1951/3859] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:09.739566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:09.743953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:09.768845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.770548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.772162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.774653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.790837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.792581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.825812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:09.892631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:09.893462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:09.894563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:09.912728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lazy-loading 'fault' on Instance uuid fb6834ff-a57c-420a-beb1-c7449dba692d {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:05:10.395711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eed20a471794e8488f9b3f999ab7e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cb404a4b5f4180b56439f0b9db2c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:10.435372 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25d7405c-8079-44f4-9fea-85691044bfd3 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 200 len: 1313 microversion: 2.1 time: 0.879842 Aug 25 13:05:10.487194 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1909/3860] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:09 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 1313 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:10.505908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:10.515712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:10.546715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.548232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.552410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.556992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.558368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.559498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.801286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:10.853014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50c53094-5aed-423e-907e-8857bfea179e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 1.127814 Aug 25 13:05:10.857501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1952/3861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:09 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:10.882108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:10.885359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:10.929091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.929091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.929091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.930772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:10.933017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:10.935247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:10.967768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:11.004258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6997d5c-af80-4289-90ac-08562b7d2232 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1298 microversion: 2.1 time: 0.513910 Aug 25 13:05:11.010246 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1910/3862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:10 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1298 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:11.507081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:11.520787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: fb6834ff-a57c-420a-beb1-c7449dba692d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:11.578289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.580086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.581978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.584876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.601441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.605288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.643210 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] HTTP exception thrown: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d HTTP/1.1 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'fb6834ff-a57c-420a-beb1-c7449dba692d'} Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.648694 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.657195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 404 to user: Instance fb6834ff-a57c-420a-beb1-c7449dba692d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:11.660820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-649ad53f-3127-4dce-99e0-028d0bbb72f8 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d" status: 404 len: 111 microversion: 2.1 time: 0.175165 Aug 25 13:05:11.663757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1911/3863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:11 2022] GET /compute/v2.1/servers/fb6834ff-a57c-420a-beb1-c7449dba692d => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:11.674620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3b86e5-ad90-40e7-a6a0-1e53360efd37", "tag": "10c3fd70-e741-4be8-9fd9-1d46c0f10f80"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:11.699503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.704218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.707767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.736445 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] Creating event network-changed:10c3fd70-e741-4be8-9fd9-1d46c0f10f80 for instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 on n-h1-850468-18 Aug 25 13:05:11.751791 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-cee4216b-71c0-4de2-8b46-22f2077f1b62 req-90c2874b-58a1-4cae-b58f-aca391d01153 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084349 Aug 25 13:05:11.753579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1912/3864] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:11.766127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:11.768289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] [instance: cd19d46e-efc9-47c0-8c8b-528390e5e113] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:11.785067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.786729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.788040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.792712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.795202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.796652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.838929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] HTTP exception thrown: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Request method failure captured: Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 HTTP/1.1 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MRh0ELtUAIuLZi1vDug67V9_qvY-4cAigOpj16NIw5nEgN4HONhBX8w4YJ1q9-1ILwPEePrR-04s71BQI13vQ2OUJm48McGuHfYOYQmD1uFGYbpXHubtmNj3ld1PTsEFixtz2tIl05H182WbpKjaJo12GSLOFSUiC0gKEl7vFhGkU Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/33cb404a4b5f4180b56439f0b9db2c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 33cb404a4b5f4180b56439f0b9db2c87 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1221314059 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4eed20a471794e8488f9b3f999ab7e28 Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ListServersNegativeTestJSON-1221314059-project Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'cd19d46e-efc9-47c0-8c8b-528390e5e113'} Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.843183 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. Aug 25 13:05:11.850004 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:11.859024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] Returning 404 to user: Instance cd19d46e-efc9-47c0-8c8b-528390e5e113 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:11.861443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b69b46e8-c13f-4aea-8b37-b5b44f9699c0 tempest-ListServersNegativeTestJSON-1221314059 tempest-ListServersNegativeTestJSON-1221314059-project] 10.222.0.60 "GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113" status: 404 len: 111 microversion: 2.1 time: 0.104814 Aug 25 13:05:11.863486 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1913/3865] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:11 2022] GET /compute/v2.1/servers/cd19d46e-efc9-47c0-8c8b-528390e5e113 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:11.896361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:11.901574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:11.937277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.944455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.945529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:11.947021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:11.947971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:11.951270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:12.971402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:12.997469 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-799b9d8a-ccc4-401c-ad62-88c90443eb8b tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 2.137630 Aug 25 13:05:12.998613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1953/3866] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:10 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:13.059880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:13.061466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:13.066415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.074758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:13.075576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:13.076717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:13.078381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:13.079476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:13.080486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:13.091396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ddfc238-e1dd-4159-bf84-e34105e594ab tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 1.202849 Aug 25 13:05:13.092973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1914/3867] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:11 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:13.233324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:13.252447 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb40ecba-381f-4934-9b00-fbda59e4ffc3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1298 microversion: 2.1 time: 0.206876 Aug 25 13:05:13.262806 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1954/3868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:12 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1298 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:14.045514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:14.046716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:14.060975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.062006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.063293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.064207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.064738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.065431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.140003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:14.142049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:14.155003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.156954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.158215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.159767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.160712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.161527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.853805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:14.877670 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1573c622-d790-4531-bb55-6e881e95d6b7 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.840003 Aug 25 13:05:14.893161 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1915/3869] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:14 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:14.903368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:14.913180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:14.942305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.943853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.949013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:14.955481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:14.960243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:14.965425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:15.059566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:15.083038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29e5eae4-657f-4004-9e2f-75d0bc9cde38 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 0.951387 Aug 25 13:05:15.108173 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1955/3870] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:14 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:15.358155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:15.377976 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df8b7246-c5ac-4d65-8a53-8578980fef63 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 0.482670 Aug 25 13:05:15.379446 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1916/3871] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:14 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:15.926024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:15.927333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:15.942757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:15.943704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:15.944625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:15.946548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:15.947436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:15.948274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.130548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:16.133318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:16.146843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:16.148108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:16.149397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.151736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:16.152968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:16.153992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.265068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.298472 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d094378-4843-43d6-81a2-039769dd0820 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.380233 Aug 25 13:05:16.300534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1956/3872] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:15 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:16.417763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:16.419429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:16.433902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:16.435297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:16.436505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.439496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:16.440919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:16.442075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:16.501263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.527669 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a399e18-51f0-4254-873e-851b5f2a7d94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 0.403802 Aug 25 13:05:16.531097 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1917/3873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:16 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:16.794796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:16.819890 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39bf3631-0af3-4d35-be82-d70e27483281 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 0.409879 Aug 25 13:05:16.821595 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1957/3874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:16 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:17.337891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:17.339057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:17.353735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.355148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.355966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.356949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.357578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.358158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.569534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:17.578735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:17.605222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.606207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.607052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.613397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.614302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.615149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.730638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:17.762690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1be55ea1-410c-4b87-ae7a-667ba797d33c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.430727 Aug 25 13:05:17.776570 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1918/3875] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:17 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:17.861325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:17.868278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:17.906672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.909994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.912794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:17.919608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:17.921068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:17.928323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:18.238539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.280837 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-16ed93cd-9ef7-4c15-8212-4db09117de88 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 0.719656 Aug 25 13:05:18.300597 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1958/3876] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:17 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:18.735752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:18.755737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8406c56-ebf4-471d-a5d9-fcaba18d4be6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 0.902033 Aug 25 13:05:18.774408 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1919/3877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:17 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:18.830993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:18.834428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:18.849972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:18.851326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:18.853754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:18.856686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:18.857998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:18.858961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.340091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:19.341595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:19.363113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.366922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.368900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.370549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.371277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.371939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.634379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:19.666026 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5b5970b-3ff8-4743-8114-65d615be3d2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.848091 Aug 25 13:05:19.667930 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1959/3878] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:18 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:19.822683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:19.825526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:19.855190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.859308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.861071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:19.865753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:19.867150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:19.868517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:20.078224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:20.116548 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-311ad3bc-497b-4ecc-9fea-9341909993a3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 0.796715 Aug 25 13:05:20.123092 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1920/3879] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:19 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:20.712103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:20.718066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:20.756368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:20.758254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:20.759728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:20.761814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:20.769342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:20.770996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:20.895630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:20.937887 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-370f52c4-6950-46e0-b374-9c97df2bf755 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.139633 Aug 25 13:05:20.941829 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1960/3880] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:19 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:21.162746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:21.168227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:21.205108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:21.206783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:21.209123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:21.216989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:21.218494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:21.219337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:22.014019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:22.050751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-688f9985-8832-404c-a4ea-6fae04280d05 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.346662 Aug 25 13:05:22.057384 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1921/3881] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:20 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:22.085356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a916a149-bce9-4430-984d-765d5fee3298", "tag": "7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:22.128430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:22.129335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:22.130143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:22.177995 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] Creating event network-changed:7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e for instance a916a149-bce9-4430-984d-765d5fee3298 on n-h1-850468-18 Aug 25 13:05:22.194459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b2a7fbd4-1dbd-462f-9ffa-7a7717574a32 req-0b76a404-8b49-46bf-adf9-aaf4f2509e81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134070 Aug 25 13:05:22.198213 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1922/3882] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:22.249789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:22.251815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:22.269960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:22.271510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:22.272791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:22.276246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:22.277666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:22.278810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.068680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:24.108404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d50ac169-dd30-4caa-af3c-871e783c7dbf tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 2.946854 Aug 25 13:05:24.117036 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1961/3883] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:21 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 2965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:24.137400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "name": "network-vif-plugged", "status": "completed", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:24.193618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:24.193618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:24.194451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.230674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] Creating event network-vif-plugged:6b7cb724-42ee-45e9-9503-617f9e0edc50 for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 on n-h1-850468-18 Aug 25 13:05:24.267192 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d1a7a49c-792d-41f1-9173-732e46c2edfb req-9d1f0e63-2964-4bee-b29e-a34a8e49a83d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146654 Aug 25 13:05:24.273389 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1962/3884] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:24.285132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:24.287164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:24.304694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:24.307353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:24.308931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.311042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:24.312939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:24.314581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:24.331103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:24.966585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:24.994311 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7fed7f7c-6c9e-4cf1-b72f-d7c4ab7be529 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 2.792905 Aug 25 13:05:25.005331 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1923/3885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:22 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 2806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:25.151784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:25.153710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:25.173119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=58 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:25.176623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.178537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.179616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:25.182040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:25.183429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:25.184672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:25.658205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:25.703561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9fe2db99-d306-4e58-8e17-b7c5a302c528 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.427374 Aug 25 13:05:25.707572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1963/3886] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:24 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:26.050046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:26.051526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:26.067528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:26.068912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:26.070786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:26.072309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:26.073242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:26.074075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:26.329000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:26.353416 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5314ae84-b8e8-4ac0-b951-60beb5417bf5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 1.209018 Aug 25 13:05:26.356484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1924/3887] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:25 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:26.754973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:26.756990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:26.782610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:26.784525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:26.786681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:26.791619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:26.794427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:26.796277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:27.403950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.423946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d5c275c-50dd-478b-bf87-34d92e673421 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.383860 Aug 25 13:05:27.453907 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1964/3888] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:26 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:27.489648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:27.490630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:27.495073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.498942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=54 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:27.516879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:27.517484 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41a928a5-6a05-4669-8e9b-f17a264ca51a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 0.770596 Aug 25 13:05:27.529323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1925/3889] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:26 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:27.545717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:27.548639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:27.551946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:27.556604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:27.558821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:27.885508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:27.895455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-51f6ff86-9adb-426d-a273-6ff4d79dfecd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 0.436660 Aug 25 13:05:27.896305 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1965/3890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:27 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:28.475263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:28.478565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:28.504182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.513239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.515497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.520969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.527439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.528404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.588499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:28.593479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:28.624843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.626679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.628341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:28.630507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:28.632406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:28.634509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.556820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.608656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50b7f07c-2b2b-4a03-95ff-94403b829748 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1517 microversion: 2.1 time: 1.047767 Aug 25 13:05:29.611932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1966/3891] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:28 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1517 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:29.625863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:29.627692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:29.643190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:29.644665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:29.645944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.647096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:29.651371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:29.653503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:29.654947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.677788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42c8e3ff-ade1-4bda-a1fd-2317c0a11d29 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.210690 Aug 25 13:05:29.680667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1926/3892] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:28 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:29.691495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3b86e5-ad90-40e7-a6a0-1e53360efd37", "name": "network-vif-plugged", "status": "completed", "tag": "10c3fd70-e741-4be8-9fd9-1d46c0f10f80"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:29.715651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:29.718634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:29.719998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:29.747408 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] Creating event network-vif-plugged:10c3fd70-e741-4be8-9fd9-1d46c0f10f80 for instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 on n-h1-850468-18 Aug 25 13:05:29.765358 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bc330cce-d8f9-4ba4-8b3b-c2b8119fffd4 req-5c624edc-6577-4524-bd39-ee660c56f387 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079069 Aug 25 13:05:29.767567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1927/3893] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:30.684889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:30.686267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:30.715306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.719279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.723453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:30.728739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:30.732867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:30.735623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:31.801976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:31.833171 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d463450c-811f-4d26-8abe-8be36ba2dfbc tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 2.218790 Aug 25 13:05:31.834818 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1967/3894] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:29 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:31.853119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:31.856264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:31.887651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:31.888739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:31.893042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:31.897203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:31.898325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:31.899758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:32.125391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:32.141461 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-121ea1e6-4e97-4bb3-abf0-d1b34b49ae1d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.482252 Aug 25 13:05:32.160174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1928/3895] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:30 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:32.195019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:32.197247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:32.213887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:32.215439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:32.217242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:32.220526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:32.222897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:32.224368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:32.236849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:32.907240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:32.924673 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bb33853-b2b4-4cb5-bbf7-b171a1a18a8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.085655 Aug 25 13:05:32.926286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1968/3896] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:31 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:32.935894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:32.937470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:32.950186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:32.951504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:32.952291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:32.953831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:32.954719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:32.955531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:33.013266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:33.045975 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-977c0ba7-b46b-4858-b75e-e9d3327522e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.858111 Aug 25 13:05:33.047748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1929/3897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:32 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:33.097963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:33.100238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:33.116576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:33.118482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:33.119290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:33.120679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:33.121880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:33.122687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.258440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:34.294902 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e217fae-74e9-4f55-9ebe-16fbb895166d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.204459 Aug 25 13:05:34.313449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1930/3898] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:33 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:34.313944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:34.349431 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7cd758db-1e42-4cee-9fdd-b516dfdae23e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1314 microversion: 2.1 time: 1.420372 Aug 25 13:05:34.359215 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1969/3899] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:32 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1314 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:34.363904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:34.371246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:34.379426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c4de47-d2fe-4e82-a0ac-1cdca8db02b0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:34.398979 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b0c4de47-d2fe-4e82-a0ac-1cdca8db02b0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. Aug 25 13:05:34.410022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.411331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.412449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.415381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.416716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.417764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c4de47-d2fe-4e82-a0ac-1cdca8db02b0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/cf2b26ed-c45e-4270-a1ed-e62c37e8b66a/action HTTP/1.1 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 15 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: {"os-stop": {}} Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'cf2b26ed-c45e-4270-a1ed-e62c37e8b66a', 'body': {'os-stop': {}}} Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:34.419616 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c4de47-d2fe-4e82-a0ac-1cdca8db02b0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance cf2b26ed-c45e-4270-a1ed-e62c37e8b66a has no mapping to a cell. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:34.433615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0c4de47-d2fe-4e82-a0ac-1cdca8db02b0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/cf2b26ed-c45e-4270-a1ed-e62c37e8b66a/action" status: 404 len: 117 microversion: 2.1 time: 0.062669 Aug 25 13:05:34.440655 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1970/3900] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:34 2022] POST /compute/v2.1/servers/cf2b26ed-c45e-4270-a1ed-e62c37e8b66a/action => generated 117 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:34.453738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:34.455036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:34.490249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.491195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.492701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:34.494245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:34.494878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:34.500720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.611669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:35.629618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:35.644069 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9aab73e-2813-45ea-884c-a8054938b334 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.201732 Aug 25 13:05:35.646001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1971/3901] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:34 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:35.665347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a916a149-bce9-4430-984d-765d5fee3298", "name": "network-vif-plugged", "status": "completed", "tag": "7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:35.697639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:35.701133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:35.703016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.717265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fbaa71d-16f7-42d5-9c35-cacb1408ec95 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.401272 Aug 25 13:05:35.732244 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] Creating event network-vif-plugged:7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e for instance a916a149-bce9-4430-984d-765d5fee3298 on n-h1-850468-18 Aug 25 13:05:35.744721 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3612a03e-ab93-49e8-9815-7ecd40f93667 req-a3bbe925-100a-4f54-a894-4a205cc7907d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095828 Aug 25 13:05:35.746203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1972/3902] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:35.764535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1931/3903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:34 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:35.765564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:35.767116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:35.782085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:35.783004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:35.784140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.785401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:35.786702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:35.787895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.806816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:35.807444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:35.843327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:36.531485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.559883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9efc8a8-b79b-4efc-b65c-2df92222b35f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1464 microversion: 2.1 time: 0.810757 Aug 25 13:05:36.562241 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1973/3904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:35 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1464 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:36.645873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:36.678395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-26142567-f135-4d28-9cb9-28186203a1c5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.909561 Aug 25 13:05:36.702323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1932/3905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:35 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:36.726694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:36.729580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 28058522-0716-49a1-927e-e4b52c64a7e3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:36.744643 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/28058522-0716-49a1-927e-e4b52c64a7e3/action HTTP/1.1 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: {"suspend": {}} Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '28058522-0716-49a1-927e-e4b52c64a7e3', 'body': {'suspend': {}}} Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:36.750585 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:36.760749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:36.760749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:36.760749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. Aug 25 13:05:36.760749 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:36.760749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 28058522-0716-49a1-927e-e4b52c64a7e3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:36.764535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2207c527-b2c7-4ac7-bd54-e73d47fdf64e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/28058522-0716-49a1-927e-e4b52c64a7e3/action" status: 404 len: 111 microversion: 2.1 time: 0.042207 Aug 25 13:05:36.764535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1933/3906] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:36 2022] POST /compute/v2.1/servers/28058522-0716-49a1-927e-e4b52c64a7e3/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:36.780371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:36.781675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:36.796434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:36.797776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:36.798818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:36.800279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:36.801490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:36.802313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.113282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:37.121130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'deleted': False, 'project_id': 'f93264768da7453bb38182f5e8c77e2d'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:37.130294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.131116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.131880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.133162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.133793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.134603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.184402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af1614e8-63ed-469d-85ae-9c836f8e5c7b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.567457 Aug 25 13:05:37.197305 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1974/3907] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:05:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:05:37.206493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:37.208341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:37.225132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.226316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.227964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.229799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:37.230644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:37.231565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:37.996460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:37.998153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:38.029060 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4432dba1-0b9e-4f5b-b9e3-4f10fd116a0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1365 microversion: 2.1 time: 1.257717 Aug 25 13:05:38.035033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1934/3908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:36 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1365 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:38.036208 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68a6fd12-1b00-44f2-9a5e-1d83b8c4f2f2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.839197 Aug 25 13:05:38.040922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1975/3909] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:37 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:38.065678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:38.077736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:38.079319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:38.092841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:38.094137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:38.095242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:38.096933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:38.098064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:38.098255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'deleted': False} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:38.099275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:38.116706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:38.118514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:38.125531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:38.127333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:38.128520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:38.129504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:38.531818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:05:38.747877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:38.749430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:38.750270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:39.038034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:39.057868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-66bffe52-2078-4505-9527-9af7404c575e tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.987503 Aug 25 13:05:39.059025 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1976/3910] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:38 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:39.083311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:39.084503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:39.104614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:39.105431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:39.106280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:39.107664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:39.108628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:39.109699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.065985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:40.083264 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-895019bb-2e2d-44ed-8e74-9ed7e777491a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1555 microversion: 2.1 time: 1.006998 Aug 25 13:05:40.084323 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1977/3911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:39 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1555 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:40.112611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:40.114259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:40.124533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.125315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.125973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.127286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.128160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.129301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.184571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lazy-loading 'flavor' on Instance uuid 485bbda2-f007-480b-9cc0-1ab14dbc4a58 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:05:40.336998 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d0bfbcd0-ada5-4483-834f-72ac470659eb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 0.233086 Aug 25 13:05:40.343593 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1978/3912] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:40 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:05:40.350658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:40.352687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:40.377782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.378816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.379754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.381214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.382586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.385978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.888519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eba3bcc1-327c-49d8-a572-0a18d205e229 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.547737 Aug 25 13:05:40.903232 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1979/3913] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:05:40 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/os-interface => generated 284 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:40.904185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:40.932510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:40.961316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.963247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.964891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:40.966354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:40.967260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:40.968155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.339394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da4de3ff-cb56-40eb-8a36-bc6c88dc5e1b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14653 microversion: 2.1 time: 3.298316 Aug 25 13:05:41.341337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1935/3914] 10.222.0.60 () {58 vars in 1171 bytes} [Thu Aug 25 13:05:38 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14653 bytes in 3304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:05:41.417969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:41.432090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'deleted': False, 'project_id': 'f93264768da7453bb38182f5e8c77e2d'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:41.442525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:41.443364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:41.444447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.447390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:41.449595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:41.451206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.506169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3fb948c-9cf3-4ded-8f10-0459c58b7cd2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?tenant_id=10a6e77cb29d430eb88d06ef30013a59" status: 200 len: 15 microversion: 2.1 time: 0.098377 Aug 25 13:05:41.507033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1936/3915] 10.222.0.60 () {58 vars in 1231 bytes} [Thu Aug 25 13:05:41 2022] GET /compute/v2.1/servers/detail?tenant_id=10a6e77cb29d430eb88d06ef30013a59 => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:05:41.544212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:41.559220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'tenant_id': '10a6e77cb29d430eb88d06ef30013a59', 'deleted': False} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:41.569003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:41.570856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:41.571917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.573620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:41.574818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:41.575885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:41.644696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:05:41.734852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:41.735653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:41.736513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.033742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:42.041446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:42.057747 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3e1cc32-f413-4bd7-ba9c-ee79b61d1d1f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1512 microversion: 2.1 time: 1.162647 Aug 25 13:05:42.059390 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1980/3916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:40 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1512 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:42.121021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:42.122512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:42.136585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.138264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.139557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.141366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.143419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.144804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.219940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:05:42.447852 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce72400d-8e0e-407c-8b58-500e2bae6f57 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 204 len: 0 microversion: 2.42 time: 0.335117 Aug 25 13:05:42.451182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1981/3917] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:05:42 2022] DELETE /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:05:42.473692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:42.476079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:42.495634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.496708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.497576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:42.499009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:42.501781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:42.503074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:43.269051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb0f7c5f-9b56-4013-99cc-4259c0088509 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=10a6e77cb29d430eb88d06ef30013a59" status: 200 len: 4834 microversion: 2.1 time: 1.730898 Aug 25 13:05:43.271799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1937/3918] 10.222.0.60 () {58 vars in 1257 bytes} [Thu Aug 25 13:05:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=10a6e77cb29d430eb88d06ef30013a59 => generated 4834 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:43.297371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:43.300225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:43.318861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:43.319833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:43.321052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:43.322634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:43.323751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:43.324612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.030383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.035909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.081730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.089308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.093939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f22e1e4d-3ab7-44f2-8cd3-a799de428d3c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2955 microversion: 2.42 time: 1.633495 Aug 25 13:05:44.094740 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6c550f5-f1b7-4295-8882-2e3f271c7ec0 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1495 microversion: 2.1 time: 0.820424 Aug 25 13:05:44.095917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1938/3919] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:43 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1495 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:44.103589 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1982/3920] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:42 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2955 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:44.110496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a916a149-bce9-4430-984d-765d5fee3298", "tag": "7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:44.124063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:44.146253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'tenant_id': 'f93264768da7453bb38182f5e8c77e2d', 'deleted': False} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:44.150965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.151840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.152682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.200460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] Creating event network-changed:7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e for instance a916a149-bce9-4430-984d-765d5fee3298 on n-h1-850468-18 Aug 25 13:05:44.204780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.218314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.218314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.219807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5cce1e8a-4ffb-4a00-86ca-dbc6e5990d1a req-6d24ebe5-08af-47f0-8ce9-b645accab2c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112842 Aug 25 13:05:44.221310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1939/3921] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:44.228526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.229866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:44.230547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.231761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:44.233000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.245377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.246743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.247831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.249549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.251088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.252263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.359228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lazy-loading 'flavor' on Instance uuid 485bbda2-f007-480b-9cc0-1ab14dbc4a58 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:05:44.392865 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-888dd077-70fe-4545-aba9-a375df30870e tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f93264768da7453bb38182f5e8c77e2d" status: 200 len: 15 microversion: 2.1 time: 0.286544 Aug 25 13:05:44.396101 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1983/3922] 10.222.0.60 () {58 vars in 1257 bytes} [Thu Aug 25 13:05:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f93264768da7453bb38182f5e8c77e2d => generated 15 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:05:44.408069 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'suspend' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state suspended Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 15 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: {"suspend": {}} Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: exception: Cannot 'suspend' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state suspended Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'suspend': {}}} Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 25 13:05:44.427465 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state suspended Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state suspended Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:05:44.437609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'suspend' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state suspended {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:44.439462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5618dd7d-6c08-4635-9046-75875ebe5eb5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 148 microversion: 2.1 time: 0.215164 Aug 25 13:05:44.445759 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1940/3923] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:44 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 148 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:05:44.456991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cd65fb9-4832-4e0d-af03-a7289f28602b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:44.461542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:44.462585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:44.472411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cd65fb9-4832-4e0d-af03-a7289f28602b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.033799 Aug 25 13:05:44.475337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1984/3924] 10.222.0.60 () {58 vars in 1189 bytes} [Thu Aug 25 13:05:44 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:05:44.500969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.502312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.502886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.505391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.506431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.507626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.520567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:44.533035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:44.553353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.555660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.556937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.559248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.560469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.563061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.783347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c846078-d872-41e3-85e0-de5e60f153d9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 202 len: 0 microversion: 2.1 time: 0.335339 Aug 25 13:05:44.790935 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1941/3925] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:44 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:05:44.823099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:44.825123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:44.843292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.846038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.847663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.850921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.853227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.855380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.878955 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a9c8112-9826-4e3d-8179-d29f16636fe1 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.366896 Aug 25 13:05:44.885032 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1985/3926] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:44 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:05:44.897898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:44.909473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:44.911474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '10a6e77cb29d430eb88d06ef30013a59'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:44.926310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.931254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.932661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:44.934423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:44.935553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:44.936671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.027840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:05:45.111577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de531590-2225-436e-8ba2-d7e3eac64d62 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.221895 Aug 25 13:05:45.114528 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1986/3927] 10.222.0.60 () {58 vars in 1150 bytes} [Thu Aug 25 13:05:44 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:45.135560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:45.150026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:45.164171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.165236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.166354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.167790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.168832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.169738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.390569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1055e43-b9d2-4cd2-9bdc-d1d980d397f9 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.260623 Aug 25 13:05:45.394561 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1987/3928] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:45 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:05:45.411050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:45.412327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:45.426623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.427460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.428321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:45.431643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:45.432709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:45.433446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:46.641094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:46.676609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-991fe10d-b15b-4b23-b169-2a239f5516e3 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1501 microversion: 2.1 time: 1.879776 Aug 25 13:05:46.693033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1942/3929] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:44 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1501 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:46.719291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:46.720600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:46.732714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:46.734644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:46.736020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:46.738553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:46.739751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:46.740884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:47.118181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:47.151623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:47.166665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:47.170866 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1466877-0f5d-4e9f-a0a0-d772e5b6954f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2955 microversion: 2.42 time: 1.773230 Aug 25 13:05:47.173193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1988/3930] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:45 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2955 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:47.728239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:47.729365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:47.778853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:47.780411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:47.782556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:47.784515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:47.785914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:47.787217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:48.651792 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3ddec64f-6426-424e-bf80-02b816657837 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1617 microversion: 2.1 time: 1.956501 Aug 25 13:05:48.654585 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1943/3931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:46 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1617 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:48.688527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:48.691907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:48.750809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:48.751923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:48.753190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:48.754983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:48.756314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:48.759317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:49.064859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:49.097869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1158a110-f9b7-446f-9630-7adf6194f619 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1501 microversion: 2.1 time: 1.376787 Aug 25 13:05:49.099614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1989/3932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1501 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:49.114523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:49.116025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:49.138001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:49.139691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:49.149819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:49.152369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:49.153825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:49.155348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:50.897656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ba5f36e-872e-44cc-91ef-464f5d6bff1d tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1617 microversion: 2.1 time: 1.794183 Aug 25 13:05:50.900964 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1990/3933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:49 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1617 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:50.911790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:50.913690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:50.938170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:50.939117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:50.939979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:50.941487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:50.942038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:50.942755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:50.943229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:50.994769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:51.001612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:51.006566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b0d3230e-9bf3-4df8-9e71-b3043fb894c9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2955 microversion: 2.42 time: 2.335707 Aug 25 13:05:51.009510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1944/3934] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:48 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2955 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:51.059026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-unplugged", "status": "completed", "tag": "c655a718-4191-4271-8b72-da916b120196"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:51.142284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:51.143193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:51.144358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:51.174646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] Creating event network-vif-unplugged:c655a718-4191-4271-8b72-da916b120196 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:51.190480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-16f2072b-c935-475d-84c5-18585327f554 req-4435e4e2-18b1-4382-be3e-892765164842 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175870 Aug 25 13:05:51.192419 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1945/3935] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:51.204961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:51.219402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'host': 'n-h1-850468-18', 'deleted': False} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:51.238917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:51.239950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:51.240995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:51.243461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:51.245447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:51.245885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:51.460315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:51.479178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:05:51.613871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:51.655508 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff09f349-b319-4cdd-af43-e4e5eb327741 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1501 microversion: 2.1 time: 0.752187 Aug 25 13:05:51.675543 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1991/3936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:50 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1501 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:51.758536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:51.775268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d7fb2574-3219-4ee2-b578-61bcb0cc77bb tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=n-h1-850468-18&all_tenants=1" status: 200 len: 2623 microversion: 2.1 time: 0.578850 Aug 25 13:05:51.797707 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1946/3937] 10.222.0.60 () {58 vars in 1192 bytes} [Thu Aug 25 13:05:51 2022] GET /compute/v2.1/servers?host=n-h1-850468-18&all_tenants=1 => generated 2623 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:51.807419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:51.837875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:05:51.879582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:51.880542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:51.881379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:51.883436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:51.884217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:51.896415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.077885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:52.079893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:52.106087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.107496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.109082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.110949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.112148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.113224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.232038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74cb68bf-44d1-4193-b4b2-73cb190b24a2 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.432509 Aug 25 13:05:52.234759 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1992/3938] 10.222.0.60 () {58 vars in 1196 bytes} [Thu Aug 25 13:05:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:05:52.268340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:52.274307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:52.292034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.295046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.298807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.303012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.304933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.306751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.515390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:52.611398 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-603e4b0b-3a70-426d-873a-abe79d6a70b8 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.354512 Aug 25 13:05:52.612617 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1993/3939] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:52 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:05:52.632959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:52.641945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:52.655589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.657211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.658792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:52.660478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:52.661687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:52.663060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.184654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:53.263143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:53.285596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:53.291697 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-579aa45b-9c02-4b9a-ad8f-5624d8d4df71 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2934 microversion: 2.42 time: 1.224064 Aug 25 13:05:53.293809 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1947/3940] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:52 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2934 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:05:53.307670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:53.309904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:53.329977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.331412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.334527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.336349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.339228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.340461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.354004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:05:53.354799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:05:53.355641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:05:53.368867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:05:53.369816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:05:53.600217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:53.615570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.623595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.625180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.630483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.632834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.634470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.797022 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c4e4c29-c92e-4d7c-b3ae-e613b1ecfd3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 1068 microversion: 2.1 time: 1.171186 Aug 25 13:05:53.801773 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1994/3941] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:52 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 1068 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 25 13:05:53.830889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-unplugged", "status": "completed", "tag": "ed72a143-bd9e-4526-ac8f-126ba31d5063"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-unplugged", "status": "completed", "tag": "f834b6d9-f32a-4d42-9471-72f10e77b454"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:53.885985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:53.889816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:53.893138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:53.959351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Creating event network-vif-unplugged:ed72a143-bd9e-4526-ac8f-126ba31d5063 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:53.962817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] Creating event network-vif-unplugged:f834b6d9-f32a-4d42-9471-72f10e77b454 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:53.992044 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1a3d6bc7-3bd7-4900-9d5d-fb6ba251bb18 req-b2770775-52db-472a-8469-7d058296eab4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.183780 Aug 25 13:05:53.998657 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1995/3942] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:54.019413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:54.026346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:54.061754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:54.063405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:54.064601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:54.066377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:54.067507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:54.071280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:54.164400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:54.193630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34c2a007-764a-45d5-a9c6-dbe06f73c787 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.897430 Aug 25 13:05:54.199356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1948/3943] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:53 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:54.253464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:54.259280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:54.283570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:54.289757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:54.291080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:54.293073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:54.297616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:54.298892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:55.356950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:55.403452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8d664d90-fde0-406e-af87-fa7fe46d4d83 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.159063 Aug 25 13:05:55.405463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1949/3944] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:54 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:05:55.418004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:55.419251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:55.432281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:55.438388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=58 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:55.451274 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27102de3-060b-4dd5-b95d-2eb9f9f0bd4e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 1.449655 Aug 25 13:05:55.455031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1996/3945] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:53 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:55.477834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:55.481218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:55.482930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:55.485273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:55.487435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:55.489156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:55.490104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: ea5ed585-d089-4617-9b72-b1d7eeca2d6e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:55.491119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:55.514427 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/ea5ed585-d089-4617-9b72-b1d7eeca2d6e/action HTTP/1.1 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 15 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: {"unpause": {}} Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ea5ed585-d089-4617-9b72-b1d7eeca2d6e', 'body': {'unpause': {}}} Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:55.519584 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance ea5ed585-d089-4617-9b72-b1d7eeca2d6e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcf45e03-1a05-43c7-8a1c-a558dfff205f tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/ea5ed585-d089-4617-9b72-b1d7eeca2d6e/action" status: 404 len: 111 microversion: 2.1 time: 0.065662 Aug 25 13:05:55.538994 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1997/3946] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:55 2022] POST /compute/v2.1/servers/ea5ed585-d089-4617-9b72-b1d7eeca2d6e/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:05:55.548000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:55.551107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:55.580670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:55.580670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:55.580985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:55.587329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:55.588376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:55.589109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.077330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:57.092051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:57.104082 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b240fcf-95b7-4602-b91b-54d0e12da34a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.571950 Aug 25 13:05:57.124152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1998/3947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:55 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:57.126403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-unplugged", "status": "completed", "tag": "85bc99ed-6e9f-4d33-afb7-bdf6f332bf93"}, {"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-unplugged", "status": "completed", "tag": "87500e7b-53b3-44a8-a014-2dcec34ef03e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:57.149297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:57.152498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:57.154985 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-104ace42-a0ad-4965-9285-ce31ec30f4cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2913 microversion: 2.42 time: 1.747442 Aug 25 13:05:57.165979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1950/3948] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:55 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2913 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:57.177939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:57.178517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.179056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:57.191953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.193725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.194656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.195686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.196787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.198434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.199621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.200938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.236287 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Creating event network-vif-unplugged:85bc99ed-6e9f-4d33-afb7-bdf6f332bf93 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:57.237570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] Creating event network-vif-unplugged:87500e7b-53b3-44a8-a014-2dcec34ef03e for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:57.263647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d5584cde-9ec4-4d05-8dc0-4f653c88cd59 req-d8d1769a-b8dc-4389-9da6-ea4cbc1dce2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.141201 Aug 25 13:05:57.265776 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 1999/3949] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:57.294645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:57.295866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:57.325111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.325980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.326789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.328100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:57.328971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:57.329969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:57.973382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:58.009473 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ab3042d-e621-4128-be1e-8e7a19a24eaa tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 0.841347 Aug 25 13:05:58.012965 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1951/3950] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:57 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:58.066258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-deleted", "tag": "f834b6d9-f32a-4d42-9471-72f10e77b454"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:58.078928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:58.108710 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df8fa9b0-2153-4f55-84dd-2dd534fd6a16 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.829136 Aug 25 13:05:58.112968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.117947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.118818 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2000/3951] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:57 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:58.119198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.174479 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] Creating event network-vif-deleted:f834b6d9-f32a-4d42-9471-72f10e77b454 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:05:58.190633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:05:58.196026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:58.202627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:05:58.222086 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-cd07ec8e-8a63-41b3-81e7-bf3b6bbfca27 req-3a6fe7b5-de28-4d33-926f-b6a38148d275 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172395 Aug 25 13:05:58.225749 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1952/3952] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:05:58.231504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.237016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.255910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.275646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.287529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:58.287951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.290178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.293620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:58.338654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.341160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.343388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.346409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.347812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.349184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.384016 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'unpause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 15 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: {"unpause": {}} Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: exception: Cannot 'unpause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'unpause': {}}} Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state active. Cannot unpause while the instance is in this state. Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:05:58.393543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'unpause' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fd23861a-e686-4adf-86dd-b8c54c395c2a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 145 microversion: 2.1 time: 0.244447 Aug 25 13:05:58.414354 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2001/3953] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:05:58 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 145 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:05:58.426150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:58.427310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:58.459097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.459952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.460826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:58.462101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:58.467013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:58.467814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.012690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:59.039975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dac6e7c3-a030-4fae-8cd6-b31c8f1d8a21 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.623244 Aug 25 13:05:59.045079 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2002/3954] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:58 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:05:59.078909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:59.083913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:59.098740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.100376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.103187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.107266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.109305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.110700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.647129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:59.714078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:59.720478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:05:59.728779 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9c99d11-c714-4570-a8a2-8ef0bf77c35e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2753 microversion: 2.42 time: 1.497310 Aug 25 13:05:59.756485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1953/3955] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:05:58 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2753 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:05:59.792202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:05:59.798650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:05:59.832140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.833540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.834836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:05:59.837150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:05:59.838308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:05:59.839403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:00.009717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:00.075461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae381982-dcd3-4065-9297-a071323a091c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 1.006205 Aug 25 13:06:00.078369 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2003/3956] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:59 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:00.302459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-deleted", "tag": "85bc99ed-6e9f-4d33-afb7-bdf6f332bf93"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:00.362244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:00.363254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:00.364289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:00.427376 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] Creating event network-vif-deleted:85bc99ed-6e9f-4d33-afb7-bdf6f332bf93 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:06:00.453954 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f58cadfb-4778-4a5c-a410-9d2021b672bc req-52c4642b-dc39-4c9e-8d5c-3d55dd3ca9b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171901 Aug 25 13:06:00.456290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2004/3957] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:06:00.567523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:00.602234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab9bb5e3-779b-4429-876c-0d5329cbd5ee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.821724 Aug 25 13:06:00.606052 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1954/3958] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:05:59 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:00.647346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:00.648927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 040c60c9-56ef-412c-8f85-ddcfa6e54d33] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:00.661150 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/040c60c9-56ef-412c-8f85-ddcfa6e54d33/action HTTP/1.1 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 18 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: {"unshelve": null} Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '040c60c9-56ef-412c-8f85-ddcfa6e54d33', 'body': {'unshelve': None}} Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:00.665669 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. Aug 25 13:06:00.675135 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:00.680657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 040c60c9-56ef-412c-8f85-ddcfa6e54d33 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:00.681822 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4d57574-a963-4e59-8756-d5aa2cee707a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/040c60c9-56ef-412c-8f85-ddcfa6e54d33/action" status: 404 len: 111 microversion: 2.1 time: 0.040860 Aug 25 13:06:00.689011 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2005/3959] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:06:00 2022] POST /compute/v2.1/servers/040c60c9-56ef-412c-8f85-ddcfa6e54d33/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:00.700983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:00.704388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:00.724388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:00.725574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:00.728003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:00.729628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:00.730757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:00.732052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:00.785647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:00.792087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:00.818716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:00.820168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:00.821610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:00.826638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:00.829699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:00.830902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:01.309283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:01.714900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:01.734740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:01.743256 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b4da8ed4-dee5-40e5-b489-24c1d26186ba tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.052294 Aug 25 13:06:01.757829 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1955/3960] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:00 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:01.776701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:01.780668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:01.783394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5c9b0a2-5c86-4139-9eb9-c7954350c0c5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2594 microversion: 2.42 time: 1.006571 Aug 25 13:06:01.785191 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2006/3961] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:00 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2594 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:01.805684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:01.806470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:01.807762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:01.811667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:01.840812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:01.841584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:01.842461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:01.844300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:01.846677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:01.848209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:01.849547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:01.851226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:01.852476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:01.853608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:01.853809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:01.854646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:02.004059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:02.917494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:02.938918 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-507ee9c6-6e41-4a9e-940b-fd157f906d04 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 1.178422 Aug 25 13:06:02.941007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1956/3962] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:01 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:02.952481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:02.966686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:02.972714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:02.979981 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a1f7c81-ff66-4f73-86a9-f33dea510fcb tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 1.188096 Aug 25 13:06:02.987314 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2007/3963] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:01 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:02.998868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-deleted", "tag": "87500e7b-53b3-44a8-a014-2dcec34ef03e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:03.009055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.011005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.011910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.013736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.014615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.015583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.040043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.045648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.047429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.090689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] Creating event network-vif-deleted:87500e7b-53b3-44a8-a014-2dcec34ef03e for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:06:03.115279 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ef4c3107-0845-42b0-9187-a786df6bdddd req-23694e48-f118-4707-8fd7-1913fad22d07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124291 Aug 25 13:06:03.117787 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2008/3964] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:03.134000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:03.136645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:03.162570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.164419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.165720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.167463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.168824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.170091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.323875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Cannot 'unshelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action HTTP/1.1 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 18 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: {"unshelve": null} Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: exception: Cannot 'unshelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'unshelve': None}} Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 in vm_state active. Cannot unshelve while the instance is in this state. Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 13:06:03.327249 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 409 to user: Cannot 'unshelve' instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 while it is in vm_state active {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-78d81280-6e1b-4072-bb9e-f5fc8f1a9484 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action" status: 409 len: 146 microversion: 2.1 time: 0.209495 Aug 25 13:06:03.340586 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2009/3965] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:06:03 2022] POST /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58/action => generated 146 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:06:03.346427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:03.348091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:03.361329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.362091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.362752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.363748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.365014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.365901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.672982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:03.709684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:03.713415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:03.719946 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0a379f3-4862-442a-9eb9-d9b93d206dd5 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2548 microversion: 2.42 time: 0.775940 Aug 25 13:06:03.730640 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1957/3966] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:02 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2548 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:03.807972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:03.836151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d058816-8e78-4211-ae46-a0f61300b610 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.495745 Aug 25 13:06:03.838275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2010/3967] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:03 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:03.891312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:03.892847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:03.938356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.950163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.953397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:03.958620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:03.965149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:03.966344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:04.500502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:04.543467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12ee4b33-720d-4250-af5e-520758068bff tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.666342 Aug 25 13:06:04.556162 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2011/3968] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:03 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:04.568186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:04.574253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:04.600146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:04.606228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:04.607859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:04.610121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:04.615683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:04.618597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:04.715291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: .version_select at 0x7fc6c13a0af0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-458811585", "policies": ["affinity"]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:04.777399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:04.802768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:04.939028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:04.952182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:04.990051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29a4505c-827a-451c-b6fa-3214fea2b94d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.189273 Aug 25 13:06:04.997201 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1958/3969] 10.222.0.60 () {60 vars in 1174 bytes} [Thu Aug 25 13:06:03 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:06:05.007808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-642410557_updated"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:05.014354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 0514da7e-61da-456c-a84e-1f6611ead5f6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:05.027354 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/servers/0514da7e-61da-456c-a84e-1f6611ead5f6 HTTP/1.1 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 80 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-642410557_updated"}} Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0514da7e-61da-456c-a84e-1f6611ead5f6', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-642410557_updated'}}} Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 25 13:06:05.031566 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. Aug 25 13:06:05.036837 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:05.042595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 0514da7e-61da-456c-a84e-1f6611ead5f6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:05.045028 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66a540bf-b161-4944-b06e-8f42f0c7721c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "PUT /compute/v2.1/servers/0514da7e-61da-456c-a84e-1f6611ead5f6" status: 404 len: 111 microversion: 2.1 time: 0.045394 Aug 25 13:06:05.046912 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1959/3970] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:06:04 2022] PUT /compute/v2.1/servers/0514da7e-61da-456c-a84e-1f6611ead5f6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:05.058367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:05.060807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:05.076642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.077825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.079069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.080605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.081965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.083053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.136542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:05.185796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d4345db-657c-4652-a73e-161bcb3bc1df tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 0.637567 Aug 25 13:06:05.188376 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2012/3971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:04 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:05.236372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: .version_select at 0x7fc6c2a438b0>, body: {"server_group": {"name": "tempest-server-group-1443941202", "policies": ["affinity"]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:05.340026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:05.368607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:05.600579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:05.631481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:05.657195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:05.684767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:05.687743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:05.690687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6ad58a2-ecc5-4e85-acee-f9cee4e73045 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2390 microversion: 2.42 time: 0.641522 Aug 25 13:06:05.692028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1960/3972] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:05 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2390 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:05.701961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:05.703582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:05.704862 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-004efe47-3c87-4917-b2b0-86ccb052756b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.513839 Aug 25 13:06:05.706079 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2013/3973] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 13:06:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:05.720630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.724989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.725935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.727329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:05.728270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:05.729101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:05.734831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: .version_select at 0x7fc6c6ce6ca0>, body: {"server_group": {"name": "tempest-server-group-1443941202", "policies": ["affinity"]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:05.857187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:05.872567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:06.036041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:06.068681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:06.146052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf214632-93a7-4b84-ab90-009ecb42d233 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.426131 Aug 25 13:06:06.154677 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2014/3974] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 13:06:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:06.179271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8a86ecf-5c1e-446b-8426-f51d6491f9af tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:06.292913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:06.319016 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-62d6d507-44c9-4def-b3d0-4e5d602781d8 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.624624 Aug 25 13:06:06.320996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1961/3975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:05 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:06.331030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:06.332988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:06.345148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8a86ecf-5c1e-446b-8426-f51d6491f9af tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/9337762b-5c20-4853-97a9-5a77d91ba770" status: 204 len: 0 microversion: 2.1 time: 0.174076 Aug 25 13:06:06.347911 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2015/3976] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:06 2022] DELETE /compute/v2.1/os-server-groups/9337762b-5c20-4853-97a9-5a77d91ba770 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:06:06.363861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13fe4e83-0633-4d98-9c11-5f4205557287 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:06.364181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:06.364819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:06.368159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:06.374173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:06.375377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:06.378545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:06.401863 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13fe4e83-0633-4d98-9c11-5f4205557287 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.044611 Aug 25 13:06:06.409326 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2016/3977] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:06:06 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:06.419012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:06.437818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:06.460731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:06.473147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:06.474338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:06.477775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:06.479033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:06.485492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:06.503351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:07.051519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.087904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ab4306a-b5cf-4dba-b462-2f7ff1360dd3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 0.764539 Aug 25 13:06:07.090926 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1962/3978] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:06 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:07.094856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.109461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35b568e0-e5a3-4cad-91ef-b64277e09c55 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:07.126664 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9610459c-a500-44e1-91e9-2ec0fbb0dcee tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.715067 Aug 25 13:06:07.129460 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2017/3979] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:06 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:07.149718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:07.161648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:07.190067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.191033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.191849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.193327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.194407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.195993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.243608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35b568e0-e5a3-4cad-91ef-b64277e09c55 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/8624905f-60a1-4e70-85c6-36ca5ed9aa23" status: 204 len: 0 microversion: 2.1 time: 0.147917 Aug 25 13:06:07.245387 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1963/3980] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:07 2022] DELETE /compute/v2.1/os-server-groups/8624905f-60a1-4e70-85c6-36ca5ed9aa23 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:07.258693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56f89f9b-0816-4590-accc-2269b6c56795 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56f89f9b-0816-4590-accc-2269b6c56795 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: request: PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 HTTP/1.1 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 280 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.267479 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 25 13:06:07.276383 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:07.286236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56f89f9b-0816-4590-accc-2269b6c56795 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:07.288024 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56f89f9b-0816-4590-accc-2269b6c56795 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 400 len: 619 microversion: 2.1 time: 0.036078 Aug 25 13:06:07.299337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1964/3981] 10.222.0.60 () {60 vars in 1257 bytes} [Thu Aug 25 13:06:07 2022] PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:07.315341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-deleted", "tag": "c655a718-4191-4271-8b72-da916b120196"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:07.349847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.354957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.357355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.401258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] Creating event network-vif-deleted:c655a718-4191-4271-8b72-da916b120196 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:06:07.414455 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-15bd6a76-f40e-4555-abfe-9aecb88cafab req-60becf99-6a6d-4bbd-a6e3-c9eb6d0f81d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110971 Aug 25 13:06:07.416653 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1965/3982] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:07.434421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fab92fb-1449-440f-b05b-5167661ce324 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:07.474352 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6fab92fb-1449-440f-b05b-5167661ce324 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.054782 Aug 25 13:06:07.482417 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1966/3983] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:06:07 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:07.503738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:07.505124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:07.531300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.532349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.533165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.534509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:07.535373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:07.536229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:07.935870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.958671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.964330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:07.967615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b750531-7519-415b-885f-e5f04e6a171c tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2344 microversion: 2.42 time: 0.832844 Aug 25 13:06:07.983638 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2018/3984] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:07 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2344 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:08.017944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: .version_select at 0x7fc6c2993670>, body: {"server_group": {"name": "tempest-server-group-1481931148", "policies": ["affinity"]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:08.083504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:08.126883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:08.127173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:08.158677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:08.204748 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63b636cb-ac39-4bda-ad45-54b7a6991e4d tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.715290 Aug 25 13:06:08.210540 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1967/3985] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:07 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:08.242085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:08.246980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:08.273961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:08.277005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:08.285521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:08.296740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:08.297801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:08.299230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:08.417152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:08.442416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:08.514165 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52040961-e483-4c45-ba13-4a952def770f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.529541 Aug 25 13:06:08.528512 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2019/3986] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 13:06:07 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:08.547909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:08.549217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:08.564891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:08.565819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:08.566636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:08.568002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:08.568895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:08.570695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.028343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.058228 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-067603c5-171c-4e04-a666-39fb974398b2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 0.844104 Aug 25 13:06:09.071212 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1968/3987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:08 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:09.103756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5447d784-1b01-4ae9-b3d5-2080022ee03e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:09.188310 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5447d784-1b01-4ae9-b3d5-2080022ee03e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/fd560294-61ea-43c2-89de-d10afe8958f7" status: 204 len: 0 microversion: 2.1 time: 0.114938 Aug 25 13:06:09.191267 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1969/3988] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:09 2022] DELETE /compute/v2.1/os-server-groups/fd560294-61ea-43c2-89de-d10afe8958f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:09.203414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:09.204473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:09.226995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.231330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.232624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.233678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.235442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.236662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.237744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.249714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:09.260045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e422c75a-05bd-4ea9-adaf-7a04b9a9751a tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.729331 Aug 25 13:06:09.282706 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2020/3989] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:08 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:09.317900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f0d252a-6536-478a-a0e1-553d731dc518 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:09.357872 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f0d252a-6536-478a-a0e1-553d731dc518 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.071116 Aug 25 13:06:09.359283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2021/3990] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:06:09 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:09.379843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4ca55c4-d11a-431c-ac00-2c47a0fd164c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4ca55c4-d11a-431c-ac00-2c47a0fd164c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: request: PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 HTTP/1.1 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 24 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: {"server": {"name": ""}} Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58', 'body': {'server': {'name': ''}}} Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '' Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:06:09.388450 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 25 13:06:09.397556 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:09.400455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4ca55c4-d11a-431c-ac00-2c47a0fd164c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:09.402589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4ca55c4-d11a-431c-ac00-2c47a0fd164c tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 400 len: 108 microversion: 2.1 time: 0.041708 Aug 25 13:06:09.410259 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2022/3991] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:06:09 2022] PUT /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 108 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:09.425823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: .version_select at 0x7fc6c6bf9ca0>, body: {"server_group": {"name": "tempest-server-group-1972006942", "policies": ["anti-affinity"]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:09.491941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:09.506967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:09.652101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.670123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:09.677727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.683647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_groups'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:09.685632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:09.695799 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0edbe48c-a697-4b46-a16b-61e02b0c294b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 2052 microversion: 2.42 time: 0.499771 Aug 25 13:06:09.698122 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1970/3992] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:09 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 2052 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:09.708729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:09.710680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:09.742184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.744584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.745552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:09.748987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:09.750040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:09.750273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6f644d63-197f-421b-a1bb-3b9d25dab298 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.337489 Aug 25 13:06:09.759970 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2023/3993] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 13:06:09 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:09.760284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.242660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:10.279341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22d7466a-5137-44c3-ab72-845b09573088 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1504 microversion: 2.1 time: 0.579207 Aug 25 13:06:10.294386 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1971/3994] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:09 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:10.308177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69e48dba-1642-4f41-a0a9-3eb7232d5c82 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:10.374216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:10.377704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:10.390198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69e48dba-1642-4f41-a0a9-3eb7232d5c82 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/32722af3-0974-4ca0-8e0a-7e2246a19de6" status: 204 len: 0 microversion: 2.1 time: 0.100539 Aug 25 13:06:10.392543 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1972/3995] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:10 2022] DELETE /compute/v2.1/os-server-groups/32722af3-0974-4ca0-8e0a-7e2246a19de6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:10.415308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.416997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.422273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:10.423815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.429381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.431273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:10.432607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.439469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.463886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.465117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.468926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.470616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:10.474367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:10.484482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:10.848265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lazy-loading 'services' on Instance uuid d9bbc8eb-7caf-489c-b055-34c0c33302de {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:06:11.207519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.259806 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6eca106d-0f09-425c-a3d1-2d1e91c59b5d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments/661d9c61-2d03-4adb-a89c-aeb965ac8ed6" status: 202 len: 0 microversion: 2.1 time: 1.503739 Aug 25 13:06:11.261357 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2024/3996] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:06:09 2022] DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments/661d9c61-2d03-4adb-a89c-aeb965ac8ed6 => generated 0 bytes in 1509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:06:11.264895 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a7d400d8-f20e-4bd4-b6fd-e24ff70c0958 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1472 microversion: 2.1 time: 0.869277 Aug 25 13:06:11.266033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1973/3997] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:10 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:11.286436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ef40e8e-d8af-480e-92cf-1630c1aa307c tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:11.305501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0e4c82-2872-4bb1-9d0b-98153e80e80e", "name": "network-vif-deleted", "tag": "ed72a143-bd9e-4526-ac8f-126ba31d5063"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:11.392256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:11.394198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:11.396862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:11.403753 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ef40e8e-d8af-480e-92cf-1630c1aa307c tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.140372 Aug 25 13:06:11.444791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2025/3998] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:06:11 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:11.459626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:11.461346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:11.474917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] Creating event network-vif-deleted:ed72a143-bd9e-4526-ac8f-126ba31d5063 for instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e on n-h1-850468-18 Aug 25 13:06:11.486961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:11.492329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:11.497343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:11.501079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:11.504161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:11.508747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:11.512055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a6ac0ec4-5303-454d-ac82-b04f2578a2de req-a9b8b391-8a52-4e13-a92d-dd1bdd3e4185 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228067 Aug 25 13:06:11.519967 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1974/3999] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:11.896791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.902009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1807706466", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "319bd96a-af6a-4004-b98b-15d30f4df9cd"}]}, "os:scheduler_hints": {"group": "43024049-1d03-49d5-9cdd-dbc931483c37"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:11.953962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.959710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:11.963508 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ce9398a-4d58-4f77-86f6-8b7dd5678188 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1605 microversion: 2.42 time: 0.516737 Aug 25 13:06:11.965508 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2026/4000] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:11 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1605 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:12.150270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] validate_networks() for [('319bd96a-af6a-4004-b98b-15d30f4df9cd', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:06:12.304423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:12.305923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:12.353124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.355134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.358608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:12.362530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:12.365939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:12.368211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:13.025980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.063211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5eb4eb4-13d7-44c7-ba32-aae5f3ba2d05 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 0.763830 Aug 25 13:06:13.072330 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2027/4001] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:12 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:13.095524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:13.104690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:13.172689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:13.174122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:13.175316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:13.177846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:13.180187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:13.182032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:13.748537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.806669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.812637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:13.824404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d829f1f-ed27-4cd1-aa1a-16f2abe095ee tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.745099 Aug 25 13:06:13.834380 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2028/4002] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:13 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:13.980883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:06:13.982988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:06:13.984664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:06:13.985803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:06:13.986867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:06:14.049349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.051429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.055070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.058188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.061271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.063313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.122241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:14.125528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:14.128888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:14.130178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=9 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:14.141425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:14.158997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.171067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.173500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.189226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:14.191789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:14.193329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:14.198059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:06:14.206140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:06:14.320292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122700) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 25 13:06:14.380851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_group_members'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:14.400378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_group_members'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:14.546471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_group_members'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:06:14.567266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Getting quotas for user 6ec4c0db2c604b03a681d6b0bd111330 and project 43ebbaa35f314009a595137d1a5a8419. Resources: {'server_group_members'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:06:14.662652 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a701888e-dbcd-41c8-bfce-af609b0824b3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.774675 Aug 25 13:06:14.679284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1975/4003] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:06:14.701274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bb8ef89-dd66-4a7f-b135-a5c8b271cab3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:14.702624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bb8ef89-dd66-4a7f-b135-a5c8b271cab3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:15.943877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bb8ef89-dd66-4a7f-b135-a5c8b271cab3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.013267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bb8ef89-dd66-4a7f-b135-a5c8b271cab3 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1213 microversion: 2.1 time: 1.315994 Aug 25 13:06:16.015128 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1976/4004] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:14 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1213 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:16.051972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:16.072499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:16.149576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:16.153770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:16.159015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:16.169002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:16.173686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:16.189798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:16.613821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.652191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.663132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.670978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d9df971-dea9-4852-8813-91d7062755b8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.646749 Aug 25 13:06:16.723718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1977/4005] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:16 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:16.882700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-unplugged", "status": "completed", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:16.926076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:16.928317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:16.931648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:16.933920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:16.988546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] Creating event network-vif-unplugged:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:06:16.994606 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-49676ca3-f7b8-4c12-90ab-65e570b3eb78 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 2.871860 Aug 25 13:06:17.000022 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2029/4006] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:14 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 2885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:17.039856 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d0541157-8a7e-4520-a7da-bc19356e2561 req-1c2e2c4c-400e-4b99-bbc6-ddc820ef5477 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182467 Aug 25 13:06:17.042779 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1978/4007] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:17.065011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:17.070320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:17.090556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.092033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.093819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.099115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.101674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.103259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.514899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:17.547445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79e3dcfc-1cea-4610-97a5-f802c5b59831 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1209 microversion: 2.1 time: 0.485242 Aug 25 13:06:17.553402 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2030/4008] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:17 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1209 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:17.747840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:17.754517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:17.795073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.796337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.797508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:17.800339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:17.802691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:17.805917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.049758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:18.056568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:18.082536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.086583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.087978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.094786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.096204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.099954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.212981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:18.288211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:18.293600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:18.298649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-620fe7fd-22bc-42d9-becf-eebe3d00b30e tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.566970 Aug 25 13:06:18.303200 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1979/4009] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:17 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:18.619976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:18.621881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:18.655416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.657069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.668008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:18.671817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:18.677370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:18.683224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:19.160838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.198271 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0fb431dc-b6ef-4e7a-a61b-ade483b666f7 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1283 microversion: 2.1 time: 0.598009 Aug 25 13:06:19.199391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1980/4010] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:18 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1283 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:19.351078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:19.353819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:19.376405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:19.377768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:19.380238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:19.382065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:19.384182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:19.385332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:19.597283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.642558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.649064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.653157 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a7c5fff0-726f-435f-8404-e8fedb8857a3 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.308747 Aug 25 13:06:19.657334 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1981/4011] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:19 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:06:19.713312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:19.748428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:19.770556 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b27201e-eac3-420d-9e67-b839c6f8f432 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 1.733812 Aug 25 13:06:19.797277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2031/4012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:18 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:20.247992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:20.254948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:20.289220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.290832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.292198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.295506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.296734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.298212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.711287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:20.719121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:20.753796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.756386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.758110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:20.763930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:20.765087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:20.765861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.142749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:21.210866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:21.220927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:21.237356 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f387be6-874a-47f3-ac1b-dd1e60cb302d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.535016 Aug 25 13:06:21.238843 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2032/4013] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:20 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:21.256861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:21.277194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:21.309178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.310781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.312313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:21.317891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:21.319527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:21.323569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:22.088887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.108798 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15b53b5b-371f-4008-9add-a75fda7c7b6e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 0.865584 Aug 25 13:06:22.124188 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2033/4014] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:21 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:22.247757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.293199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:22.299046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:22.317146 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-715fb842-58c7-4fb8-9aae-e0e320cd7aef tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 2.070636 Aug 25 13:06:22.322968 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1982/4015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:20 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:22.343723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:22.348359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:22.350161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:22.358006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:22.359634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:22.361803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:22.743989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.796666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:22.828780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.832493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:22.835523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddb3b2dd-bf51-4c00-a7df-f15db1269387 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.552732 Aug 25 13:06:22.853636 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2034/4016] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:22 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:06:22.868977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:22.870261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:22.871304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:22.917284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] Creating event network-vif-plugged:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:06:22.943777 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b3761e10-b30b-4f49-9901-791c2bee0b8e req-6f5cef28-70a2-48ec-8797-e05d3b5bd6e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155888 Aug 25 13:06:22.954092 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1983/4017] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:06:23.151784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:23.157731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:23.186878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.188461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.189669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:23.192496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.193765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.205512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:23.377236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:23.380571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:23.402381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.403161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.404285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:23.405919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:23.408155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:23.409528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.116194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:24.190077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:24.240576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14f9db56-5f16-4c67-85b6-0dfbc7f3ee6c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 1.096513 Aug 25 13:06:24.249084 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2035/4018] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:23 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:24.264873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:24.266342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:24.293078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.294171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.294959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.296300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.297127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.297892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.490250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:24.520585 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1c880c4f-6209-4b8e-8b22-89b6a3a97bae tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 1.152456 Aug 25 13:06:24.544281 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1984/4019] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:23 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:24.579754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61123533-9add-4e78-8497-64a397639722", "tag": "15dabc27-5f7f-4d38-adb3-b5073975e821"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:24.615928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:24.620231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:24.630641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:24.631956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:24.703306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] Creating event network-changed:15dabc27-5f7f-4d38-adb3-b5073975e821 for instance 61123533-9add-4e78-8497-64a397639722 on n-h1-850468-18 Aug 25 13:06:24.715761 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-79387029-5924-4146-abbd-30085e5895ac req-cb961d36-a318-4b91-a7bd-7a92f9a025c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167744 Aug 25 13:06:24.719333 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1985/4020] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:24.720769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:24.739205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:24.746502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-274b14b8-7c46-4c0f-a44e-27ca69ca30ad tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.490875 Aug 25 13:06:24.752094 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2036/4021] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:24 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:25.293328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:25.294744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:25.310834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.312203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.313205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.314521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.315360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.316984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.566973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:25.570118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:25.587661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.589784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.591235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.593300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.595052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.596430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.640782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:25.661027 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ba64722-91c1-4ed9-b332-c9bebca9c14e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1478 microversion: 2.1 time: 0.380549 Aug 25 13:06:25.665223 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1986/4022] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:25 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1478 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:25.807823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:25.809702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:25.841388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.842992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.844273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.846010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:25.847291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:25.848361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:25.946991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:25.975621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-484f1cd3-f457-4ee4-8b4d-d2bc09717a71 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.414933 Aug 25 13:06:25.981253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2037/4023] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:25 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:25.997399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=24 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:26.057836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:26.077041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:26.080374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:26.082843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f7ed87a-7d57-4102-8bf7-a61c41aabe47 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.290566 Aug 25 13:06:26.084287 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1987/4024] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:25 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:26.707845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:26.714256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:26.748012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:26.749594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:26.751306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:26.753703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:26.756458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:26.760040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:26.812539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:27.028533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:27.031133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:27.057044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.059171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.060608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.062287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.064003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.066770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.130037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.174010 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23b5b13a-43bd-4cde-9b0e-ea583941b423 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1464 microversion: 2.1 time: 0.474643 Aug 25 13:06:27.175573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2038/4025] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:26 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1464 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:27.184757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:27.185891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:27.222440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.223617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.224766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.229705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.231615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.233538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.524260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.557838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.564409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.568085 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0aa2f249-9a8b-4e60-b59c-86682b2be7cf tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.390166 Aug 25 13:06:27.596045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2039/4026] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:27 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:27.629307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:27.630877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:27.645628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.646600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.648435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.650274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.652023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:27.653159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:27.654300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:27.666021 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8b05616-ec44-46cc-92b3-f396f397c59e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.648361 Aug 25 13:06:27.677072 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1988/4027] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:27 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:27.946733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:27.965145 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d68aca39-7f93-4ad1-9cd6-70b1fdc97314 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1464 microversion: 2.1 time: 0.365663 Aug 25 13:06:27.966481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2040/4028] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:27 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:28.007373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:28.013493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:28.025755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.027070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.028098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.029923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.032036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.033254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.222960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:06:28.224358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:06:28.225860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:06:28.226864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:06:28.227664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:06:28.395387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:28.408848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.409915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.413284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.414978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.415987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.416750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.485908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91203403-225e-4716-99c8-5e6d38fde20b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 1068 microversion: 2.1 time: 0.485587 Aug 25 13:06:28.488220 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1989/4029] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:06:27 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 1068 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 13:06:28.542329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:28.548977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:28.576774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.579704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.581143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.584404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.586370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.587395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.641503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:28.642762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:28.665253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.672675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.673591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.675465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:28.679997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:28.681386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:28.744542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:29.535547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:29.582795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:29.587455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:29.590203 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ba815a01-9193-464d-82d8-91d6a29aa41f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.960871 Aug 25 13:06:29.590950 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1990/4030] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:28 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:29.630108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:29.632670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:29.659084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:29.661665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:29.664463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:29.669466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:29.670733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:29.671435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:29.738799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:29.776676 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44df830f-367b-486c-a776-19b0b501628e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 1.260111 Aug 25 13:06:29.777876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2041/4031] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:28 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:30.090058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:30.111354 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3ae2175-cdac-4aa8-b5be-9e18e796ee8f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.503497 Aug 25 13:06:30.113850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1991/4032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:29 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:30.655152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.660680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.676249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.677233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.678267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.681377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.684028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.685204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.858768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:30.871003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:30.874999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:30.899808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:30.903893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:30.907198 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc3f4411-74ca-4d25-bde4-a4dd68247793 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.269105 Aug 25 13:06:30.909257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.910670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.912852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2042/4033] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:30 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:30.915750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:30.917943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:30.919378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:30.920641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.154911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:31.164010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:31.204280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.205877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.207138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.208611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.209428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.212182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.349559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:31.378762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1aef812-ebd7-4008-9602-136adbc79c1e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.559211 Aug 25 13:06:31.386405 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1992/4034] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:30 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:31.594225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:31.619938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb6b311a-0359-473d-ad6c-be5bc18a179b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.473182 Aug 25 13:06:31.622253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2043/4035] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:31 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:31.959531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:31.962423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:31.974885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.976464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.977621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:31.979348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:31.980319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:31.981374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.154284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:32.203809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:32.207272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:32.211695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e5a0218-764b-47c7-b04a-b82c1a5d055d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.258224 Aug 25 13:06:32.212993 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1993/4036] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:31 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:32.433005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:32.435413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:32.450509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:32.452216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:32.454776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.456807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:32.458172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:32.459595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.660079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:32.661281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:32.680858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:32.682119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:32.683426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.684999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:32.686089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:32.687590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:32.905516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:32.926397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a0e0d4c8-2e16-4db6-8f31-eba2a72234d3 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.507250 Aug 25 13:06:32.941134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2044/4037] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:32 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:33.127979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:33.153974 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81f284c3-d326-494d-aa1c-f0ec69786e2e tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.501309 Aug 25 13:06:33.160854 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1994/4038] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:32 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:33.291065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:33.293045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:33.316730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.321137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.322527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:33.324323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.326420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.327735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:33.574719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:33.588397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.589838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.590961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:33.628249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:33.653669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Going to try to stop instance {{(pid=122700) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:06:33.704912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:33.714597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:33.722895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4bad155-51f0-4046-90ba-7e4f947cafae tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.470141 Aug 25 13:06:33.737768 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2045/4039] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:33 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:33.817574 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fe58657-d507-4581-85e0-4021a8f82998 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action" status: 202 len: 0 microversion: 2.1 time: 0.250281 Aug 25 13:06:33.829033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1995/4040] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:06:33 2022] POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:06:33.838238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:33.845088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:33.887966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.892183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.896836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:33.901197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:33.902189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:33.907741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:34.006622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:34.008906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:34.047875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:34.060453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:34.063390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:34.071287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:34.072602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:34.073766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:34.875068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:34.912018 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb56eb8f-71ef-4f13-b45f-9df88e3d8e24 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.947164 Aug 25 13:06:34.917234 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1996/4041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:33 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:34.926785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:34.928042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:34.957762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:34.963319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:34.966335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:34.967834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:34.972582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:34.975240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.000400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.075859 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-432a774f-9282-44ed-8f24-ad73f7b0a4e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 1.248799 Aug 25 13:06:35.092541 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2046/4042] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:33 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:35.122502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:35.124707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:35.142474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:35.144299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:35.145616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.148523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:35.150049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:35.151333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.551563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.631142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.640505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.643608 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-87df67db-5ee6-4b8b-95f1-27260dd7ba9f tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.549106 Aug 25 13:06:35.645668 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2047/4043] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:35 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:35.657290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61123533-9add-4e78-8497-64a397639722", "name": "network-vif-plugged", "status": "completed", "tag": "15dabc27-5f7f-4d38-adb3-b5073975e821"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:35.685287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:35.696922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:35.698658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:35.700269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:35.721476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-50ca4fce-bcff-4d29-b0f3-bbcf31f35803 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.802176 Aug 25 13:06:35.723169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1997/4044] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:34 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:35.749660 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] Creating event network-vif-plugged:15dabc27-5f7f-4d38-adb3-b5073975e821 for instance 61123533-9add-4e78-8497-64a397639722 on n-h1-850468-18 Aug 25 13:06:35.768953 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-836b91b5-9653-4bd5-9ca0-e58d34b97366 req-f5e1c44b-89da-45e8-8867-3af3b5a541b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119342 Aug 25 13:06:35.770330 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2048/4045] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:35.977144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:35.980970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:36.008243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.009686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.010836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.012578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.013831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.014946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.130118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:36.138397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:36.159772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:36.166783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.175432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.178404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.181180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.182565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.194099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.534458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:36.569483 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28d1ba9c-7a6b-4ce9-8198-8ef839a2d758 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.599574 Aug 25 13:06:36.585811 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1998/4046] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:35 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:36.707140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:36.715937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:36.744326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.751032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.752401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.754439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.758288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.762686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.769103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:36.794634 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e45ba796-cca5-4b10-a6ab-278d760a13a0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 0.672995 Aug 25 13:06:36.806989 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2049/4047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:36 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:36.822580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:36.835466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:36.860823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.865947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.872259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:36.874146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:36.879181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:36.881272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:37.087725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:37.126849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:37.134285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:37.138813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f8d6f65-e3a0-4629-b82d-6c712bc551df tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.439633 Aug 25 13:06:37.140351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 1999/4048] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:36 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:37.375115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:37.396335 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2fde11bb-0101-4f13-9f6f-02cc03195454 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1313 microversion: 2.1 time: 0.586065 Aug 25 13:06:37.399048 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2050/4049] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:36 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:37.629187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:37.630996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:37.651136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:37.652688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:37.654777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:37.657336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:37.658546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:37.659567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:37.861634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:37.863658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:37.878929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:37.880436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:37.882895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:37.884904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:37.886277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:37.887464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.499826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.525591 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-803188ca-cb70-4122-885a-333d216c1ff4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.916768 Aug 25 13:06:38.537330 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2000/4050] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:37 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:38.557435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:38.559111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:38.574257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.575986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.577481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.579166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.581332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.582610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.646526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.680585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca387e5d-a737-4630-be9a-401a887620b9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 0.825373 Aug 25 13:06:38.682521 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2051/4051] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:37 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:38.692282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:38.694073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:38.735835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.737156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.738730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.740855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:38.743032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:38.744801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:38.862317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.901295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.916944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:38.919747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3744c3b3-b903-4e5a-a002-44126c04d638 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.379621 Aug 25 13:06:38.921114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2001/4052] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:38 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:39.396762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:39.399354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:39.433725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.434312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.434695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.436535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.437432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.438561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.482368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 HTTP/1.1 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6a277d44-5bfe-4641-a508-01856d871560'} Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:39.486394 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.495563 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.498501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:39.501012 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-076d0362-af53-4dd1-9707-56e266f3f8f9 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 404 len: 111 microversion: 2.1 time: 0.113657 Aug 25 13:06:39.510098 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2002/4053] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:39 2022] DELETE /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:39.529157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:39.531620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 6a277d44-5bfe-4641-a508-01856d871560] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:39.546332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.547780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.549201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.550752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.552139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.553114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.606198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 HTTP/1.1 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6a277d44-5bfe-4641-a508-01856d871560'} Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:39.611041 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. Aug 25 13:06:39.619512 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:39.637340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 6a277d44-5bfe-4641-a508-01856d871560 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:39.639676 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53c02971-469f-4aa6-bfa4-c5f7bd7f3333 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560" status: 404 len: 111 microversion: 2.1 time: 0.127340 Aug 25 13:06:39.660181 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2003/4054] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:39 2022] GET /compute/v2.1/servers/6a277d44-5bfe-4641-a508-01856d871560 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:39.672218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:39.673757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:39.689659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.691057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.691955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.693364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.694631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.695639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.844733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:39.891699 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a099276-a895-494e-ac2c-2ab2f9311f6d tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1497 microversion: 2.1 time: 1.206545 Aug 25 13:06:39.907674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2052/4055] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:38 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1497 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:39.922748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:39.924095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:39.941941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.943930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.946077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:39.948880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:39.950221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:39.952241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:40.033085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:40.191627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:40.268337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:40.301787 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f4f8f0d-c672-4d1e-af1d-b5b0c540a77f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.640244 Aug 25 13:06:40.303327 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2004/4056] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:39 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:40.323823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:40.329291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:40.333987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a968b72-637b-4851-9039-13afd57dfb32 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "DELETE /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 204 len: 0 microversion: 2.1 time: 0.421878 Aug 25 13:06:40.335246 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2053/4057] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:39 2022] DELETE /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:40.351876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:40.355141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:40.359312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:40.362125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:40.362966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:40.368582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:40.369598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:40.370370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:40.398172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.server_groups [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Querying cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) for 1 instances {{(pid=122701) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 13:06:40.400420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:40.401919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:40.402995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:40.447980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db9512d8-dbc8-4fd9-8e5d-9c25c5f4c3fd tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37" status: 200 len: 221 microversion: 2.1 time: 0.101317 Aug 25 13:06:40.481156 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2054/4058] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 13:06:40 2022] GET /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37 => generated 221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:40.501063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:40.502604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:40.516939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:40.518552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:40.520301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:40.522128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:40.523155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:40.524034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.312465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:41.342919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:41.352653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:41.355047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae3a1eb5-bd55-429e-b42a-d12cf0bf54db tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.871942 Aug 25 13:06:41.358530 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2055/4059] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:40 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:41.368677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:41.375285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:41.376492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:41.416723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.417654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.418411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.419710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.420514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.421085 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e07ad2e7-11a4-4124-8e16-123128e2bbe5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 1.095868 Aug 25 13:06:41.421258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.437624 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2005/4060] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:40 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:41.480148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:41.482595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:41.515707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.517131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.520435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.525685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.530555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.532064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.635326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:06:41.712382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:41.889586 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e828982-33cd-4d4a-b34f-0154dd302d67 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 204 len: 0 microversion: 2.1 time: 0.444233 Aug 25 13:06:41.892064 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2006/4061] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:41 2022] DELETE /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:41.907322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:41.909696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:41.927659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.930272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.931897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:41.933580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:41.934928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:41.939820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.161352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.201985 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b86c894-6313-4edc-b5af-2523d90a3da2 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 0.840237 Aug 25 13:06:42.204793 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2056/4062] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:41 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:42.215075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:42.229748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:42.262440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.265258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.266368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.268996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.269263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.270174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.526416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.550457 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc8cf252-abdb-42ba-92a0-705fd12fa5da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.651795 Aug 25 13:06:42.552039 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2007/4063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:41 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:42.563233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:42.564576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:42.578934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.580799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.581973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.583495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.584771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.586167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.837961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.884232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.886338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.893120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:42.896968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47e96468-02a2-408f-83f5-402a514bb08d tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.342858 Aug 25 13:06:42.898839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2008/4064] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:42 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:42.910937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:42.914111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:42.918075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc157e4a-bbdc-44bd-94cd-f2e812e7598b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1503 microversion: 2.1 time: 0.710577 Aug 25 13:06:42.919166 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2057/4065] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:42 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1503 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:42.929900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.932370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.934081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:42.936086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:42.936953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:42.937717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:43.258569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:43.259813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:43.274993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:43.275704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:43.276636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:43.277759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:43.278433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:43.279049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:43.352040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:43.403184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-baa65abe-544c-4641-8409-dd66aa59d7cc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 0.502386 Aug 25 13:06:43.404373 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2009/4066] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:42 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:43.608239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:43.614964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:43.648473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:43.649434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:43.650258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:43.652457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:43.653416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:43.654199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:44.669162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:44.705994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2819d73b-3598-4952-b928-a3accac144d2 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 1.107673 Aug 25 13:06:44.709739 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2010/4067] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:43 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:44.736724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:44.738447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:44.766611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:44.767554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:44.768436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:44.769826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:44.770722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:44.771497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.104615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1af7df8d3a416e967cb6fe15210f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db87ddade283469a8137dc3905493e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:45.160599 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b79c0049-e0b4-4ed2-b801-fc472c776ab5 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 200 len: 1510 microversion: 2.1 time: 1.893124 Aug 25 13:06:45.162275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2058/4068] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:43 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 1510 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:45.186429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:45.192477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:45.224399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:45.261785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.277203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:45.280686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.284683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.285385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:45.294719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.295015 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f2953f55-9530-489e-a12b-731fb14b1740 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.576200 Aug 25 13:06:45.295774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.296651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.312194 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2011/4069] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:44 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:45.354288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:45.367394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:45.406524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.410621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.411998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:45.415465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:45.422352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:45.430735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:46.743517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec4c0db2c604b03a681d6b0bd111330', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ebbaa35f314009a595137d1a5a8419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:46.775958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:46.797977 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-899ffecf-cbad-49c3-9602-f1577ecb1d14 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 200 len: 1503 microversion: 2.1 time: 1.633193 Aug 25 13:06:46.799062 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2059/4070] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:45 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 1503 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:46.816325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cbb777d0-5fcb-4e85-bf2e-b4899618bca5 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 1.501947 Aug 25 13:06:46.833799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2012/4071] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:45 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:46.864659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:46.866711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:46.880410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485bbda2-f007-480b-9cc0-1ab14dbc4a58", "name": "network-vif-deleted", "tag": "6b7cb724-42ee-45e9-9503-617f9e0edc50"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:46.914742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.917148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.920818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:46.928374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.929240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:46.931661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.935979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:46.937471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:46.942136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.009293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] Creating event network-vif-deleted:6b7cb724-42ee-45e9-9503-617f9e0edc50 for instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 on n-h1-850468-18 Aug 25 13:06:47.026269 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f3d16faa-f78b-4302-b40b-5cf374f44ca5 req-04851a06-db6c-4411-bc82-bf59d6fb5562 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208477 Aug 25 13:06:47.030404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2060/4072] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:47.048175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:47.049967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] [instance: 485bbda2-f007-480b-9cc0-1ab14dbc4a58] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:47.089201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.093994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.097561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.104148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.105574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.111854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.205499 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] HTTP exception thrown: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Request method failure captured: Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 HTTP/1.1 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3HapRZ-IJRXPH0WL7JTbGEpzhUkAX8Rl5CNQICwmpK_8ciRehHQIHTsf0bsvNOt8LFpNPb9fR9PBY95BqqmZrY3yk58s5gL5ZkIWuKvafBJA5Sg3RmNM-Jb5_BDokhVh6a5kmtAd7Btf7joDo03TeGB_YW3SIL05pjuGDlybtTwcQE Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db87ddade283469a8137dc3905493e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db87ddade283469a8137dc3905493e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db87ddade283469a8137dc3905493e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: db87ddade283469a8137dc3905493e94 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-924252532 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ed1af7df8d3a416e967cb6fe15210f62 Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-924252532-project Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '485bbda2-f007-480b-9cc0-1ab14dbc4a58'} Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:47.209567 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] Returning 404 to user: Instance 485bbda2-f007-480b-9cc0-1ab14dbc4a58 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6672f9a-1f60-4335-a579-9deda5c6b970 tempest-ServersNegativeTestJSON-924252532 tempest-ServersNegativeTestJSON-924252532-project] 10.222.0.60 "GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58" status: 404 len: 111 microversion: 2.1 time: 0.179073 Aug 25 13:06:47.221637 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2061/4073] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:47 2022] GET /compute/v2.1/servers/485bbda2-f007-480b-9cc0-1ab14dbc4a58 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:47.230309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:47.231852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:47.245488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.246439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.247250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.248712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.249615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.250697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.561343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:47.574433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:47.589343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:47.600287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:47.602750 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad4e834a-4d6b-455a-baec-dfe2a621f767 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.758840 Aug 25 13:06:47.604911 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2013/4074] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:46 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:47.614695 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c88ce6b3-f0ab-4af8-a6af-e566ef68c231 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.382834 Aug 25 13:06:47.614695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2062/4075] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:47 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:47.629272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61123533-9add-4e78-8497-64a397639722", "name": "network-vif-deleted", "tag": "15dabc27-5f7f-4d38-adb3-b5073975e821"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:47.689874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.691251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.692170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.717675 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] Creating event network-vif-deleted:15dabc27-5f7f-4d38-adb3-b5073975e821 for instance 61123533-9add-4e78-8497-64a397639722 on n-h1-850468-18 Aug 25 13:06:47.730539 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cc77fefc-a7b0-40b7-b303-68596fcce020 req-b10bfb1a-7126-4055-bd1c-5599fd10389a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116163 Aug 25 13:06:47.732647 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2063/4076] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:47.861812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:47.865090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:47.905954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:47.913304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:47.921566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.923260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.933252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.935457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.939837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.945547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.947092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.948280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.949922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:47.970863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:47.973893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:47.975602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.036482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 HTTP/1.1 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '61123533-9add-4e78-8497-64a397639722'} Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:48.043043 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:48.062982 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-868a7106-ab78-4953-97e6-200fe3cc2f49 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 404 len: 111 microversion: 2.1 time: 0.223300 Aug 25 13:06:48.076178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2014/4077] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:47 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:48.102162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.204283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.server_groups [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Querying cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) for 1 instances {{(pid=122700) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 13:06:48.215295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.216747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.218078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.385675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db6df5e9-44de-4255-9828-6e8e00919433 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.308021 Aug 25 13:06:48.386787 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2015/4078] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:06:48 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:48.409192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.471077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.server_groups [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Querying cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) for 1 instances {{(pid=122700) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 25 13:06:48.472535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.473473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.474279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.529596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79c0b51a-ecd7-4888-b6e3-17bdbd424115 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37" status: 200 len: 183 microversion: 2.1 time: 0.123428 Aug 25 13:06:48.530883 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2016/4079] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 13:06:48 2022] GET /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37 => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:06:48.555288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.556487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:48.599948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.601810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.602583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.620620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.622029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.623481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.681825 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 HTTP/1.1 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '61123533-9add-4e78-8497-64a397639722'} Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:48.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-94bc5870-c5bf-4364-9bfb-c5706371190f tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 404 len: 111 microversion: 2.1 time: 0.141421 Aug 25 13:06:48.704007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2017/4080] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:06:48 2022] DELETE /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:48.728832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.730025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:48.762290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.763330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.769885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.771533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.772525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.773363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.815040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:48.852493 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52061f23-8dac-4da3-a61a-970a0df25962 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1673 microversion: 2.1 time: 0.965398 Aug 25 13:06:48.870678 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2064/4081] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:47 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1673 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:48.902825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:48.904768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:48.918797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.945519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.947636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:48.949666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:48.951146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:48.952537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.185927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.216825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.251217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.259545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b4d95c1f-317d-4f5f-b11d-798bcdd98626 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.363663 Aug 25 13:06:49.264065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2065/4082] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:48 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:49.289406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.291916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] [instance: 61123533-9add-4e78-8497-64a397639722] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:49.316348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.317314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.318158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.320131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.321059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.321890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.397738 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 HTTP/1.1 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '61123533-9add-4e78-8497-64a397639722'} Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.405724 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.415395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance 61123533-9add-4e78-8497-64a397639722 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:49.417707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4aaf329-cd4a-4933-9752-f57ac2fb8776 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722" status: 404 len: 111 microversion: 2.1 time: 0.149557 Aug 25 13:06:49.426897 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2066/4083] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:49 2022] GET /compute/v2.1/servers/61123533-9add-4e78-8497-64a397639722 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:49.452699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8504dff5-aadf-46f1-b132-e0a1ec6c1b84 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.471471 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-8504dff5-aadf-46f1-b132-e0a1ec6c1b84 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8504dff5-aadf-46f1-b132-e0a1ec6c1b84 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-server-groups/32722af3-0974-4ca0-8e0a-7e2246a19de6 HTTP/1.1 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '32722af3-0974-4ca0-8e0a-7e2246a19de6'} Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.476287 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8504dff5-aadf-46f1-b132-e0a1ec6c1b84 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance group 32722af3-0974-4ca0-8e0a-7e2246a19de6 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:49.486286 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8504dff5-aadf-46f1-b132-e0a1ec6c1b84 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/32722af3-0974-4ca0-8e0a-7e2246a19de6" status: 404 len: 117 microversion: 2.1 time: 0.049535 Aug 25 13:06:49.490655 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2067/4084] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:49 2022] DELETE /compute/v2.1/os-server-groups/32722af3-0974-4ca0-8e0a-7e2246a19de6 => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:49.497614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-55e7bce4-c2ec-4320-b975-7c73b730f1f5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.523706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-55e7bce4-c2ec-4320-b975-7c73b730f1f5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. Aug 25 13:06:49.524227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-55e7bce4-c2ec-4320-b975-7c73b730f1f5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-server-groups/fd560294-61ea-43c2-89de-d10afe8958f7 HTTP/1.1 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'fd560294-61ea-43c2-89de-d10afe8958f7'} Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.534643 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-55e7bce4-c2ec-4320-b975-7c73b730f1f5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance group fd560294-61ea-43c2-89de-d10afe8958f7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:49.542721 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-55e7bce4-c2ec-4320-b975-7c73b730f1f5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/fd560294-61ea-43c2-89de-d10afe8958f7" status: 404 len: 117 microversion: 2.1 time: 0.053175 Aug 25 13:06:49.547377 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2068/4085] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:49 2022] DELETE /compute/v2.1/os-server-groups/fd560294-61ea-43c2-89de-d10afe8958f7 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:49.566106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef314626-ea95-4943-912e-71cf7fa519b5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.570552 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8aaaf0f0-0ca7-40a0-a0b9-223fd643a808 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.870832 Aug 25 13:06:49.581829 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ef314626-ea95-4943-912e-71cf7fa519b5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. Aug 25 13:06:49.582608 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2018/4086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:48 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef314626-ea95-4943-912e-71cf7fa519b5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-server-groups/8624905f-60a1-4e70-85c6-36ca5ed9aa23 HTTP/1.1 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '8624905f-60a1-4e70-85c6-36ca5ed9aa23'} Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.586112 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef314626-ea95-4943-912e-71cf7fa519b5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance group 8624905f-60a1-4e70-85c6-36ca5ed9aa23 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef314626-ea95-4943-912e-71cf7fa519b5 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/8624905f-60a1-4e70-85c6-36ca5ed9aa23" status: 404 len: 117 microversion: 2.1 time: 0.033575 Aug 25 13:06:49.597689 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2069/4087] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:49 2022] DELETE /compute/v2.1/os-server-groups/8624905f-60a1-4e70-85c6-36ca5ed9aa23 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:49.610645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8de152d-39d4-4e4d-99f6-e36e5e231cf1 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.634113 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a8de152d-39d4-4e4d-99f6-e36e5e231cf1 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] HTTP exception thrown: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8de152d-39d4-4e4d-99f6-e36e5e231cf1 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Request method failure captured: Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-server-groups/9337762b-5c20-4853-97a9-5a77d91ba770 HTTP/1.1 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3O7fdajUvQYGcBpABxEIhnVPkfv4FCS4LUzjBPi9U4839h0vxfAKg-XRZdty_UM1l2Xe0hR9Be_Upr5AGvGP3yTBYJAdQE3g8RhzEtGs_moNF2e2WJolB9Zkg-3_7BiZ7Fjn9A2dn7PWn3BdmNX-lnmOgCe-UePpoXVT8eECvQovhs Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/43ebbaa35f314009a595137d1a5a8419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 43ebbaa35f314009a595137d1a5a8419 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerGroupTestJSON-618302326 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 6ec4c0db2c604b03a681d6b0bd111330 Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerGroupTestJSON-618302326-project Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9337762b-5c20-4853-97a9-5a77d91ba770'} Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.639094 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. Aug 25 13:06:49.647006 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:49.652810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8de152d-39d4-4e4d-99f6-e36e5e231cf1 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Returning 404 to user: Instance group 9337762b-5c20-4853-97a9-5a77d91ba770 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:49.654827 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a8de152d-39d4-4e4d-99f6-e36e5e231cf1 tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/9337762b-5c20-4853-97a9-5a77d91ba770" status: 404 len: 117 microversion: 2.1 time: 0.052112 Aug 25 13:06:49.677444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54775e17-3a07-4509-9903-d151f9b39d2b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.678952 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2019/4088] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:49 2022] DELETE /compute/v2.1/os-server-groups/9337762b-5c20-4853-97a9-5a77d91ba770 => generated 117 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:06:49.773916 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54775e17-3a07-4509-9903-d151f9b39d2b tempest-ServerGroupTestJSON-618302326 tempest-ServerGroupTestJSON-618302326-project] 10.222.0.60 "DELETE /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37" status: 204 len: 0 microversion: 2.1 time: 0.109047 Aug 25 13:06:49.775204 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2070/4089] 10.222.0.60 () {58 vars in 1266 bytes} [Thu Aug 25 13:06:49 2022] DELETE /compute/v2.1/os-server-groups/43024049-1d03-49d5-9cdd-dbc931483c37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:06:49.907948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:49.918032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:49.957609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.958795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.960513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:49.965300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:49.967642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:49.976679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.318087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:50.331802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:50.361690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.369373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.371191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.381361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.382733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.383869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.816474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:50.848005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:50.860424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:50.871952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd63db32-05a7-4454-bed4-0ed530c7fad9 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.558975 Aug 25 13:06:50.874078 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2071/4090] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:50 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:50.896151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:50.902791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:50.930404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.931596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.932606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:50.938175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:50.939114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:50.939948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.291714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.313400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93776fed-30e6-4fd9-b0a0-f916bb53d7e2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1650 microversion: 2.1 time: 1.423245 Aug 25 13:06:51.330954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2020/4091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:49 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1650 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:51.371745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:06:51.399400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.400935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.405357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.530039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Going to try to start instance {{(pid=122700) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:06:51.695574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:51.747895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9568e59-3a64-49bd-af1d-329fd2895a08 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.869398 Aug 25 13:06:51.751425 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2072/4092] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:50 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:51.794739 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18983327-a47a-4649-af34-c35e808eb25f tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action" status: 202 len: 0 microversion: 2.1 time: 0.430893 Aug 25 13:06:51.798315 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2021/4093] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:06:51 2022] POST /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:06:51.817963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:51.826063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:51.886149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.887120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.887965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.903553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.904582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.905300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.940521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:51.942816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:51.973901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.985342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.986624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:51.988717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:51.989808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:51.991545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:52.566994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:52.592974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:52.604766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:52.615882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b675f4d-03a1-4f97-8e8b-16be11ce65cb tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.690922 Aug 25 13:06:52.618760 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2022/4094] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:51 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:06:52.800566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:52.802225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:52.860753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:52.866589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:52.868374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:52.870084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:52.871210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:52.872533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:53.649973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:53.695339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48fc50e2-d976-4962-b142-64fa34e43bb3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1659 microversion: 2.1 time: 1.881861 Aug 25 13:06:53.702843 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2073/4095] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:51 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1659 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:53.724840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:53.726508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:53.758572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:53.762495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:53.763458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:53.764825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:53.770216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:53.771191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.446488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:54.483916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:54.491855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:54.494207 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e51951bd-34eb-4dac-b984-e50f1848c63b tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.789774 Aug 25 13:06:54.512290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2074/4096] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:53 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:54.575750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:54.601086 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb836f29-2034-425c-81e3-801124752ce4 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 1.812124 Aug 25 13:06:54.603511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2023/4097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:52 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:54.753423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:54.754720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:54.803096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.808884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.809814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:54.822992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:54.827765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:54.830902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:55.558760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:55.562096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:55.593827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:55.596167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:55.602799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:55.607790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:55.609144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:55.610594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.656204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:56.661656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:56.706533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:56.721913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:56.725195 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe6fbae8-3f03-49b2-a44a-6610c5db0e44 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 1.186850 Aug 25 13:06:56.731094 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2024/4098] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:55 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:56.750350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:56.753296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:56.772565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.774578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.777493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:56.780349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:56.782107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:56.782927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.001881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:57.033496 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-932863ae-b4b7-4339-860a-849df55c84ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1659 microversion: 2.1 time: 2.285293 Aug 25 13:06:57.035366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2075/4099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:54 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1659 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:57.671468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:57.689143 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b19e62c4-d1d6-4a1f-af8f-373c314f51a0 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1473 microversion: 2.1 time: 0.955881 Aug 25 13:06:57.704740 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2025/4100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:56 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1473 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:57.785195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:57.786645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:57.798764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.799721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.800659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:57.802052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:57.803077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:57.804036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.050009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:58.075984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:58.076313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:58.077825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:58.079823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be7e7d4b536247019427bbc244880e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a38a040c18f4ee89d29da12df9e343d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:58.083888 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52134c19-1f06-44ee-aedc-3ae507b009a4 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 200 len: 1872 microversion: 2.42 time: 0.306143 Aug 25 13:06:58.096284 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2076/4101] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:57 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 1872 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:06:58.102412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.103521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.104070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.105430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.106248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.107505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.729926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:58.732046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:58.747457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.749483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.752227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.754229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:58.756235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:58.757919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:58.820060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:06:59.469022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:59.498694 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a2e0620-74a0-4149-9670-d0fae409c03d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1659 microversion: 2.1 time: 1.427600 Aug 25 13:06:59.500821 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2026/4102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:58 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1659 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:06:59.512063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:59.513708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:06:59.530447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:59.535830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:59.537463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:59.540177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:06:59.541564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:06:59.542974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:06:59.583786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] HTTP exception thrown: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Request method failure captured: Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e HTTP/1.1 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3GJechzTDAWQBN_VZ-yaZFBuO5c0Vanzp8FPn0dbOVicTU6vUeOtLMDEo64c6neTF1FllMJmCN4UhqwZDP7JAB-9KdQiVyGJ_aMAr2mEsceMYZN_w8_i69VbMKjN1TVUJm3TOimGrn3HGLDd-gGVpPgaWHChY9dtbrqKfnUQPRin3s Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be7e7d4b536247019427bbc244880e8b Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4e0e4c82-2872-4bb1-9d0b-98153e80e80e'} Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:59.589822 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:06:59.598661 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:06:59.602999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Returning 404 to user: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:06:59.608918 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86b99af1-f1b4-422e-b802-9a2599ef5160 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 404 len: 111 microversion: 2.42 time: 0.101904 Aug 25 13:06:59.612586 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2027/4103] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:06:59 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:06:59.660518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21fd378c-5e86-4282-9730-c42f0e4d24d8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '.version_select at 0x7fc6c6bf21f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:06:59.710807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:06:59.752629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7171da7f-bdde-466c-a1f2-1718d240ff1a tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 1.032026 Aug 25 13:06:59.755271 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2077/4104] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:06:58 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:06:59.797266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21fd378c-5e86-4282-9730-c42f0e4d24d8 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109921807" status: 204 len: 0 microversion: 2.42 time: 0.172569 Aug 25 13:06:59.798838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2028/4105] 10.222.0.60 () {60 vars in 1262 bytes} [Thu Aug 25 13:06:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109921807 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:07:00.551535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:00.558947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:00.613775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.615458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.626130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:00.629715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.634288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.637741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:00.798103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:00.808924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:00.852756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.854237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.862724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:00.865162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:00.872889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:00.874720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:02.401564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:02.429626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d14c5d5a-20b7-4559-8ef3-a3af8df9a567 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1659 microversion: 2.1 time: 1.887612 Aug 25 13:07:02.435138 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2078/4106] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:00 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1659 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:02.451017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-unplugged", "status": "completed", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:02.481267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:02.510866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:02.518357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:02.521681 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51f29136-c787-4c10-b34c-760f728d0d9d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 1.735997 Aug 25 13:07:02.523701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:02.532734 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2029/4107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:00 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:02.594195 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] Creating event network-vif-unplugged:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:07:02.621445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-16e5e83b-8078-4827-98e1-c131f61375f7 req-7d6a5244-f578-43b7-86b3-6b685780abf2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183567 Aug 25 13:07:02.622968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2079/4108] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:03.472675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:03.476293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:03.505883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.513016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.514073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.518697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.519820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.522825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.588846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:03.598894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:03.676455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.677556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.684527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:03.685939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:03.687021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:03.690062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:05.549354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:05.579350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e608e024-8ceb-4027-ae69-0da11268af8d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 1.999087 Aug 25 13:07:05.581308 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2080/4109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:03 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:05.923443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:05.951443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d813cec8-72a6-4d3c-a267-0203a03240ee tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1663 microversion: 2.1 time: 2.476798 Aug 25 13:07:05.953212 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2030/4110] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:03 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1663 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:06.242436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:06.244489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:06.279304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.292546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.295635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.302481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.307374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.308742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.473260 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dcddd6c5-2976-42a9-a654-83f8e06c70cf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/ips" status: 200 len: 150 microversion: 2.1 time: 0.886519 Aug 25 13:07:06.474319 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2081/4111] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:07:05 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/ips => generated 150 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:06.496841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66afa70b-5f1d-49fb-9aaf-640c8d75d37b"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:06.512621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:06.573288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.575078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.579911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.591752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.599787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.603710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.633505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:06.637924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:06.676590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:06.701083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.702221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.703013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.711692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:06.711958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:06.719818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:06.965981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/os-volume_attachments HTTP/1.1 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 74 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: {"volumeAttachment": {"volumeId": "66afa70b-5f1d-49fb-9aaf-640c8d75d37b"}} Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'a916a149-bce9-4430-984d-765d5fee3298', 'body': {'volumeAttachment': {'volumeId': '66afa70b-5f1d-49fb-9aaf-640c8d75d37b'}}} Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:07:06.969899 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 Aug 25 13:07:06.974325 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:06.977566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 400 to user: Invalid volume: volume 66afa70b-5f1d-49fb-9aaf-640c8d75d37b is already attached to instances: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:06.978880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-01197b4f-1041-431f-a407-5a3ea1302a9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.492147 Aug 25 13:07:06.981251 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2031/4112] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:07:06 2022] POST /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298/os-volume_attachments => generated 174 bytes in 495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:07:06.996685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:06.997559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:07.006000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.007643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.008270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.009168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.009765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.010355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.070243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:07:07.515669 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef39f98a-7f4d-4b36-8ff0-3bfc36ad700f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 204 len: 0 microversion: 2.1 time: 0.525018 Aug 25 13:07:07.517480 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2032/4113] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:07:06 2022] DELETE /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:07:07.546231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-plugged", "status": "completed", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:07.594432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.595314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.596184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.622597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] Creating event network-vif-plugged:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:07:07.634253 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-41892eef-8a5c-4207-80a3-14d84c0861a0 req-5be00d32-5126-4dfb-9000-e7ed39f070f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113857 Aug 25 13:07:07.635782 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2033/4114] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:07.650006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:07.650006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:07.663271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.663271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.663770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.665711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:07.665951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:07.666737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:07.827321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:07.857899 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9ffea62-b5fb-498d-bc64-1a6fa1297a94 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 1.234424 Aug 25 13:07:07.859930 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2082/4115] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:06 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:08.379984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:08.406325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c21fdfd-16b5-4879-b5f8-19715aebb7b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1680 microversion: 2.1 time: 0.768268 Aug 25 13:07:08.408204 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2034/4116] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:07 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1680 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:08.913722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:08.915139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:08.924548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:08.925270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:08.925847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:08.926710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:08.927396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:08.927971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:09.470480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:09.471645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:09.513445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:09.517248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:09.534604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:09.546067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:09.559206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:09.560668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:10.111846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:10.143765 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2c8fabd-b870-461b-9cdd-6d619ad14b68 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 1.237778 Aug 25 13:07:10.154783 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2083/4117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:08 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:10.625849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:10.642664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-05f0e059-b4b1-426d-ad26-b787088606ca tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1680 microversion: 2.1 time: 1.182823 Aug 25 13:07:10.657151 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2035/4118] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:09 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1680 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:11.198620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:11.199781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:11.231773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:11.233280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:11.234658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:11.240424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:11.245309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:11.246407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:11.691540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:11.694489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:11.718084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:11.727738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:11.729084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:11.730117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:11.736934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:11.738019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:11.739059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:11.857202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:11.889545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f97c35c-d7ee-4dea-b371-0263f1d04b3d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 0.701833 Aug 25 13:07:11.893688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2084/4119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:11 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:12.155422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:12.177567 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-271efe41-d37b-49e0-95cd-3fde60441e10 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1680 microversion: 2.1 time: 0.499563 Aug 25 13:07:12.178699 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2036/4120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:11 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1680 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:12.955918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:12.966670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:12.989911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.993047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:12.996279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:12.998386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:12.999737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.000874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.226763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:13.231199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:13.260158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:13.261469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.274350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.276083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:13.277308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:13.278362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:13.577016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:13.589505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:13.607495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65544cff-efac-4900-91dc-05c91e93ea3e tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1479 microversion: 2.1 time: 0.667792 Aug 25 13:07:13.609270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2085/4121] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:12 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1479 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:13.630103 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6bfd229-7200-451e-9bcc-60236d94d428 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1613 microversion: 2.1 time: 0.410236 Aug 25 13:07:13.640249 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2037/4122] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:13 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1613 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:14.656200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:14.663337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:14.665140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:14.676983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:14.704532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:14.713325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:14.713650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:14.714253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:14.715081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:14.715594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:14.717715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:14.719148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:14.719374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:14.720589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:14.740312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:14.741850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:16.276091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:16.307873 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38fcf2e0-3313-4ed8-97c2-e2d07ab1e4aa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 200 len: 1613 microversion: 2.1 time: 1.651626 Aug 25 13:07:16.328960 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2038/4123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:14 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 1613 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:16.350925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a916a149-bce9-4430-984d-765d5fee3298", "name": "network-vif-deleted", "tag": "7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:16.432065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:16.433350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:16.437351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:16.514631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] Creating event network-vif-deleted:7f1524bd-c0c3-4336-b6d5-c93bfaf9a19e for instance a916a149-bce9-4430-984d-765d5fee3298 on n-h1-850468-18 Aug 25 13:07:16.541432 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e430dcfb-32f2-46cd-be10-23830387f868 req-3d56bdcd-842d-47e0-8b3d-d254dd62a0f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209638 Aug 25 13:07:16.542567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2039/4124] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:17.191298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:17.249033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e54b02b-8683-40f7-88bd-33ead0415c3b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1464 microversion: 2.1 time: 2.597843 Aug 25 13:07:17.260330 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2086/4125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:14 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1464 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:17.326006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:17.333892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:17.335572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:17.344066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:17.373935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.374285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.374939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.375140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.375760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.375970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.377219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.378654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.379915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.382939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.383842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.386495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.410484 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] HTTP exception thrown: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Request method failure captured: Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e HTTP/1.1 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3GJechzTDAWQBN_VZ-yaZFBuO5c0Vanzp8FPn0dbOVicTU6vUeOtLMDEo64c6neTF1FllMJmCN4UhqwZDP7JAB-9KdQiVyGJ_aMAr2mEsceMYZN_w8_i69VbMKjN1TVUJm3TOimGrn3HGLDd-gGVpPgaWHChY9dtbrqKfnUQPRin3s Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be7e7d4b536247019427bbc244880e8b Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4e0e4c82-2872-4bb1-9d0b-98153e80e80e'} Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:17.415678 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.432768 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.439405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Returning 404 to user: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:17.441794 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-360a104c-9def-4e9b-aab2-c1b9d4c4a003 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 404 len: 111 microversion: 2.42 time: 0.129156 Aug 25 13:07:17.444162 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2040/4126] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:07:17 2022] DELETE /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:07:17.454863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:17.456960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:17.478533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.489574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.497105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.509640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.511597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.527544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.594026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 HTTP/1.1 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a916a149-bce9-4430-984d-765d5fee3298'} Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.605105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.617435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:17.622441 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a1918b8a-7fcd-4e7d-83f6-ed143d4941e4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 404 len: 111 microversion: 2.1 time: 0.176013 Aug 25 13:07:17.628192 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2041/4127] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:17 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:17.659945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:17.667674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9748db47-3044-48e8-924d-e190c10710fc tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.352756 Aug 25 13:07:17.673813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2087/4128] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:07:17 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:07:17.680746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] [instance: 4e0e4c82-2872-4bb1-9d0b-98153e80e80e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:17.688495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e68d06b4-0fd3-480f-af72-69fcf14f0efa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '.version_select at 0x7fc6c6d10700>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:17.702330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.703968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.705890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.711774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.713081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.716534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.763434 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e68d06b4-0fd3-480f-af72-69fcf14f0efa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-216652431" status: 202 len: 0 microversion: 2.1 time: 0.092415 Aug 25 13:07:17.767908 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2088/4129] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-216652431 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:07:17.778161 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] HTTP exception thrown: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.783350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:17.785273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Request method failure captured: Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e HTTP/1.1 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3GJechzTDAWQBN_VZ-yaZFBuO5c0Vanzp8FPn0dbOVicTU6vUeOtLMDEo64c6neTF1FllMJmCN4UhqwZDP7JAB-9KdQiVyGJ_aMAr2mEsceMYZN_w8_i69VbMKjN1TVUJm3TOimGrn3HGLDd-gGVpPgaWHChY9dtbrqKfnUQPRin3s Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.42 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5a38a040c18f4ee89d29da12df9e343d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 5a38a040c18f4ee89d29da12df9e343d Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-511530071 Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be7e7d4b536247019427bbc244880e8b Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TaggedBootDevicesTest_v242-511530071-project Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4e0e4c82-2872-4bb1-9d0b-98153e80e80e'} Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.788855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:17.797407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] Returning 404 to user: Instance 4e0e4c82-2872-4bb1-9d0b-98153e80e80e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:17.799518 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed78834a-20fb-4a4a-8e6c-9ff6283d9cb6 tempest-TaggedBootDevicesTest_v242-511530071 tempest-TaggedBootDevicesTest_v242-511530071-project] 10.222.0.60 "GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e" status: 404 len: 111 microversion: 2.42 time: 0.170108 Aug 25 13:07:17.807822 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2042/4130] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:07:17 2022] GET /compute/v2.1/servers/4e0e4c82-2872-4bb1-9d0b-98153e80e80e => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:07:17.837777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.839821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.843512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.846137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.856982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:17.858626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:17.998160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:17.999379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:18.000596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:18.001797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lazy-loading 'fault' on Instance uuid cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:07:19.127536 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-faf6ed4b-8503-4fd0-a7af-89635f5f31d3 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1600 microversion: 2.1 time: 1.357108 Aug 25 13:07:19.135315 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2089/4131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:17 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1600 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:19.191663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:19.205232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:19.230094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.235303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.243367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.244904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.250466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.252017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.572981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:19.748312 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b22866bd-bb28-4450-92ca-3dfcb654477b tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action" status: 202 len: 0 microversion: 2.1 time: 0.570430 Aug 25 13:07:19.749958 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2043/4132] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:07:19 2022] POST /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:07:19.765183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:19.770952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:19.848649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.851869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.853825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:19.865021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:19.874794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:19.876415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:20.840620 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcea36d5-d53d-4cb1-8184-3fac3eeb8b67 tempest-ServersAdminTestJSON-1946458534 tempest-ServersAdminTestJSON-1946458534-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1617 microversion: 2.1 time: 1.075993 Aug 25 13:07:20.844380 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2090/4133] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:19 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1617 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:20.901305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:20.902178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:20.938487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:20.945530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:20.950346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:20.956217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:20.957642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:20.958917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.107383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:07:21.357673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:21.362947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:21.400797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:21.407491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:21.409828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.414196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:21.421293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:21.422292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.530279 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e97fd592-57bb-433b-8249-f271f229fae5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 204 len: 0 microversion: 2.1 time: 0.638939 Aug 25 13:07:21.531976 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2044/4134] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:07:20 2022] DELETE /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:07:21.553477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:21.557635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:21.579366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:21.581103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:21.583711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.587246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:21.588950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:21.590739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:21.857447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lazy-loading 'services' on Instance uuid 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:07:22.159796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ecdb73d-07bc-4288-b3f2-0b3d8396b2b5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments/66afa70b-5f1d-49fb-9aaf-640c8d75d37b" status: 202 len: 0 microversion: 2.1 time: 0.810356 Aug 25 13:07:22.161469 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2091/4135] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:07:21 2022] DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments/66afa70b-5f1d-49fb-9aaf-640c8d75d37b => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:07:22.198500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:22.226830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:22.260184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:22.264749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:22.268092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:22.273418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:22.275786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:22.277814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:22.279863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:22.295714 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d0ac590-c834-45b7-b43e-eaeb01215c1d tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1470 microversion: 2.1 time: 0.753612 Aug 25 13:07:22.311522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2045/4136] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:21 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1470 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:22.356365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8abec3b3-129a-48fa-ac8f-5a4a3eacf5ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178874 Aug 25 13:07:22.364857 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2092/4137] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:22 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:23.348143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:23.358495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:23.380900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:23.389866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:23.406746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:23.411047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:23.414674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:23.418863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:23.422223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:23.423396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:23.425913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:23.426815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:23.427739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:23.430752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:23.435753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:23.439515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:23.586327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:23.591936 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5efe7688-2775-4295-90d0-7c35fd77ca53 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220379 Aug 25 13:07:23.594472 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2093/4138] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:23 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:24.384196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:24.427751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5074d1d8-211e-40fe-a630-8cc3d370909f tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1470 microversion: 2.1 time: 1.094280 Aug 25 13:07:24.447427 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2046/4139] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:23 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1470 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:24.613187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:24.619203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:24.676491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:24.680339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:24.681759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:24.683321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:24.686068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:24.687948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:24.824791 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ff1160b-8a7d-493f-b849-44106f983ff5 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216928 Aug 25 13:07:24.826888 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2094/4140] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:24 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:25.478268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:25.482808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:25.541358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:25.548865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:25.552765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:25.560304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:25.570288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:25.571834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:25.847054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:25.856169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:25.889337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:25.889889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:25.891089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:25.892554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:25.893462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:25.894509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:26.129506 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2a70b59-c06f-4dcf-8da0-1c22cdff165c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.287533 Aug 25 13:07:26.135498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2095/4141] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:25 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:26.563477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:26.590711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0ef8309-c6bd-4404-83e5-e780d752e046 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1470 microversion: 2.1 time: 1.122399 Aug 25 13:07:26.604869 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2047/4142] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:25 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1470 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:27.159084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:27.172345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:27.227081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:27.231336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:27.236576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:27.245193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:27.245724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:27.261221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:27.417511 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da85e2b3-7ad7-4dc5-ba81-242a8b15ac65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.268713 Aug 25 13:07:27.425885 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2096/4143] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:27 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:27.637746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:27.640995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:27.641293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3b86e5-ad90-40e7-a6a0-1e53360efd37", "name": "network-vif-unplugged", "status": "completed", "tag": "10c3fd70-e741-4be8-9fd9-1d46c0f10f80"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:27.673839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:27.677314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:27.681997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:27.684920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:27.685825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:27.686635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:27.691559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:27.697465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:27.698697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:27.746273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] Creating event network-vif-unplugged:10c3fd70-e741-4be8-9fd9-1d46c0f10f80 for instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 on n-h1-850468-18 Aug 25 13:07:27.777308 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-19f59691-c080-45d7-8aa6-10d9d059b874 req-657a43a4-a95b-43d9-a0ad-818ed5329d6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146856 Aug 25 13:07:27.779924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2048/4144] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:28.360818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:28.410247 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-011e145c-eb25-44c3-ad2d-5aa071a11fbe tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1470 microversion: 2.1 time: 0.781407 Aug 25 13:07:28.428579 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2097/4145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:27 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1470 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:28.458890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:28.465926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:28.516445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:28.517843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:28.519017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:28.520774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:28.525441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:28.526709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:28.686646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2088b89d-1298-475e-8583-258d4d4bbbe4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246571 Aug 25 13:07:28.688960 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2049/4146] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:28 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:29.452043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:29.462305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:29.501013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:29.503585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:29.504764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:29.510844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:29.513718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:29.514593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:29.606427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3b86e5-ad90-40e7-a6a0-1e53360efd37", "name": "network-vif-deleted", "tag": "10c3fd70-e741-4be8-9fd9-1d46c0f10f80"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:29.657560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:29.668561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:29.675895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:29.780222 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] Creating event network-vif-deleted:10c3fd70-e741-4be8-9fd9-1d46c0f10f80 for instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 on n-h1-850468-18 Aug 25 13:07:29.805488 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ab1c5768-fff7-4d5c-800b-5bbc028c60b6 req-7028c5b4-b857-47c6-a3cd-9885075795a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217113 Aug 25 13:07:29.807519 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2050/4147] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:07:29.826209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:29.841947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:29.859639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:29.862119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:29.863559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:29.866186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:29.867681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:29.869043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:30.040255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:30.095289 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dbdd564f-49dd-404d-8faa-9947ff5a06bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 200 len: 1428 microversion: 2.1 time: 0.651700 Aug 25 13:07:30.111709 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7eb8157f-4930-479d-b5c4-758d4a8f114f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.295734 Aug 25 13:07:30.111902 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2098/4148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:29 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 1428 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:30.116763 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2051/4149] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:29 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:31.138018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:31.138989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d3b86e5-ad90-40e7-a6a0-1e53360efd37] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:31.142032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:31.152262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:31.187875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.195851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.198591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.205679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.208963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.211063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.213058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.216087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.221963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.226892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.231907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.237542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.332058 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] HTTP exception thrown: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Request method failure captured: Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 HTTP/1.1 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MxhL5sgA8MbYW4tf5qbad5HJ-fzy0Ud2eN-L7Y1XtduGQrLZoPLtAiLg_QsUZ6w-Z2YHL-AAIuEm8wS8Qr5X9oRBZJw61gDyMRuE99Wk1EoF7UmsLu8XREJEVXK4YQi4jTQAn5LVgaxM85jpQtc6mPCGVF4c5tSO20HhXC9vbh2eA Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2678c6b68a0c4ad8b9b72dea2ec21741 Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1d3b86e5-ad90-40e7-a6a0-1e53360efd37'} Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:31.346058 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. Aug 25 13:07:31.355212 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:31.360266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Returning 404 to user: Instance 1d3b86e5-ad90-40e7-a6a0-1e53360efd37 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:31.376491 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81ada81a-6c02-4307-9fdb-c4558a7de6ee tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37" status: 404 len: 111 microversion: 2.1 time: 0.236494 Aug 25 13:07:31.384668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2052/4150] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:31 2022] GET /compute/v2.1/servers/1d3b86e5-ad90-40e7-a6a0-1e53360efd37 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:31.414275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:31.419604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:31.452608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.454062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.457875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.461883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:31.465942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:31.471939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:31.490008 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-06f3fe57-4991-487d-9ba1-447c694b4e6f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.366790 Aug 25 13:07:31.499384 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2099/4151] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:31 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:31.630485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:07:31.997407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a51b0c21-9027-48a3-acc9-b6fd6221ae64 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 204 len: 0 microversion: 2.1 time: 0.607888 Aug 25 13:07:31.999362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2053/4152] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:07:31 2022] DELETE /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:07:32.013974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:32.014831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:32.041369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.042159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.043243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.045653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.054797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.056561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.524947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:32.538626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:32.598890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.600769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.601836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.603467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:32.604711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:32.605769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:32.744792 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-232fba3a-841e-4fd3-a948-33cb43a94075 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233717 Aug 25 13:07:32.754476 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2054/4153] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:32 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:33.229431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:33.265666 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea7a5152-5947-472f-a2d4-67f4a87d73da tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1470 microversion: 2.1 time: 1.257734 Aug 25 13:07:33.284905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2100/4154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:32 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1470 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:33.768785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:33.777160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:33.829758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:33.833308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:33.836391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:33.844247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:33.845408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:33.846497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:33.988940 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-695d2873-5957-4981-8039-2a92a75d73d8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228826 Aug 25 13:07:33.994688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2055/4155] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:33 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:34.321347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:34.322597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:34.346450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:34.347370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:34.348366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:34.350283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:34.351402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:34.351970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:35.010832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:35.014880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:35.046054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:35.052192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:35.053057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:35.054434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:35.055652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:35.056720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:35.188412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ebda568-210c-4601-98c4-2dee02a08e1d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185354 Aug 25 13:07:35.197992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2056/4156] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:35 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:35.954661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:35.993964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79764ef2-9160-4a7e-8add-b39768535b2c tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1470 microversion: 2.1 time: 1.693175 Aug 25 13:07:36.000717 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2101/4157] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:34 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1470 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:36.214700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:36.223090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:36.239428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:36.241341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:36.249132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:36.251119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:36.257206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:36.273228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:36.425935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e676bb5d-328f-46c8-886f-ae7d7bd2819d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222621 Aug 25 13:07:36.437185 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2057/4158] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:36 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:37.035631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:37.041686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:37.070657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:37.074577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:37.075211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:37.075706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.076862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:37.077772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:37.080175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.447536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:37.463641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:37.496272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:37.497455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:37.498566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.500828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:37.502193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:37.504040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.570863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:37.607046 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad2c1307-a8b8-4630-ab54-b4b04132ef4a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166308 Aug 25 13:07:37.609193 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2058/4159] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:37 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:37.838137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1ffb5c-998a-42af-91c0-a175d309a3b4", "name": "network-vif-deleted", "tag": "e6019d06-c951-4639-9b3e-0410e45fd4c6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:37.922583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:37.924939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:37.929980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:37.979881 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] Creating event network-vif-deleted:e6019d06-c951-4639-9b3e-0410e45fd4c6 for instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 on n-h1-850468-18 Aug 25 13:07:38.006794 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-95fc1cf3-d485-44da-8283-8d10728012b3 req-f4c9516d-ef45-402c-8541-7644d36ee262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182751 Aug 25 13:07:38.012942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2059/4160] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:38.355180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:38.389958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dda10d6b-1324-432b-a71f-bfbe7ae6d5d5 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 200 len: 1470 microversion: 2.1 time: 1.363071 Aug 25 13:07:38.416963 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2102/4161] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:37 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 1470 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:38.646964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:38.652984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:38.680829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:38.689783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:38.691059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:38.692545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:38.693604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:38.695055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:38.833353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1a2b257-9555-4ba1-90f6-9fa86df56f9c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.212415 Aug 25 13:07:38.844523 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2060/4162] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:07:38 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7/os-volume_attachments => generated 25 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:07:39.064100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:39.067962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:39.090992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.092520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.093736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.095325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.096509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.097797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.265369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:07:39.469823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:39.471352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: 1d1ffb5c-998a-42af-91c0-a175d309a3b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:39.511966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.514073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.517966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.528421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.536478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.538225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.592524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] HTTP exception thrown: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Request method failure captured: Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 HTTP/1.1 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3MxhL5sgA8MbYW4tf5qbad5HJ-fzy0Ud2eN-L7Y1XtduGQrLZoPLtAiLg_QsUZ6w-Z2YHL-AAIuEm8wS8Qr5X9oRBZJw61gDyMRuE99Wk1EoF7UmsLu8XREJEVXK4YQi4jTQAn5LVgaxM85jpQtc6mPCGVF4c5tSO20HhXC9vbh2eA Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2678c6b68a0c4ad8b9b72dea2ec21741 Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1d1ffb5c-998a-42af-91c0-a175d309a3b4'} Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:39.596646 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. Aug 25 13:07:39.607427 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:07:39.610065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Returning 404 to user: Instance 1d1ffb5c-998a-42af-91c0-a175d309a3b4 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:39.612265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-57557c51-da24-4674-b9b4-3c7888429e58 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4" status: 404 len: 111 microversion: 2.1 time: 0.157605 Aug 25 13:07:39.619703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2061/4163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:39 2022] GET /compute/v2.1/servers/1d1ffb5c-998a-42af-91c0-a175d309a3b4 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:39.640444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:39.643238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:39.668642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.671006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.679524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.681924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.683267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.691741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.744160 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fd42a659-cf47-4b7a-bf61-260edc7f52c6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 204 len: 0 microversion: 2.1 time: 0.689813 Aug 25 13:07:39.754659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2103/4164] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:07:39 2022] DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:07:39.788411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:39.789851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:39.792008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:07:39.838756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.844856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.845888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:39.847390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:39.850580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:39.857394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:40.175764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0569ff0e-762f-45e0-82f5-0bbd76c50291 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 204 len: 0 microversion: 2.1 time: 0.548581 Aug 25 13:07:40.180649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2062/4165] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:07:39 2022] DELETE /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:07:40.208041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:40.208786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:40.234554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:40.235318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:40.236158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:40.249884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:40.250439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:40.252995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:41.391243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:41.429055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13524b7c-a28e-4ec4-8063-32c592f6f6dc tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1683 microversion: 2.1 time: 1.664953 Aug 25 13:07:41.434856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2104/4166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:39 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1683 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:41.527383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:41.588975 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84116ab9-660e-4b43-9e80-db77f4a41a0b tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1470 microversion: 2.1 time: 1.388707 Aug 25 13:07:41.625648 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2063/4167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:40 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1470 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:42.489307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:42.497695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:42.533882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.535158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.538551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:42.542774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.549715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.551086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:42.651837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:42.654237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:42.694002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.694905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.700106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:42.704156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:42.708089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:42.711991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:44.331546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:44.382879 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e1bc3e2-0ace-4643-9a0e-25d1b6e80c28 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1470 microversion: 2.1 time: 1.735518 Aug 25 13:07:44.384606 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2064/4168] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:42 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1470 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:44.518822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:44.575874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7617734f-3802-4c49-9efc-bd08af8467ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1683 microversion: 2.1 time: 2.075109 Aug 25 13:07:44.577102 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2105/4169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:42 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1683 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:45.434369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:45.435412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:45.472674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:07:45.506629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.508015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.514248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:45.517980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.523875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.532628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:45.638241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:45.642590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:45.723429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.738779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.750717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:45.758483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:45.761146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:45.762623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:46.577253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:46.623899 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d51268f-d1df-4e60-894a-b5014aaa2172 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1615 microversion: 2.1 time: 0.987543 Aug 25 13:07:46.656977 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2106/4170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:45 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1615 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:48.164977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2678c6b68a0c4ad8b9b72dea2ec21741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a6e77cb29d430eb88d06ef30013a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:48.231329 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e28f7119-57fd-422f-8bb3-b98e1a1e95bd tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 200 len: 1470 microversion: 2.1 time: 2.807876 Aug 25 13:07:48.233718 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2065/4171] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:45 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 1470 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:48.259276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:48.261215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:48.347751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:48.350227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:48.351491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:48.358779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:48.360177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:48.361497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:48.506775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9", "name": "network-vif-deleted", "tag": "f232cc11-d4d5-4f64-b435-90326195f0ff"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:48.606503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:48.611033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:48.612464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:48.664877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] Creating event network-vif-deleted:f232cc11-d4d5-4f64-b435-90326195f0ff for instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 on n-h1-850468-18 Aug 25 13:07:48.694307 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-147ad92e-ae1b-4466-91b1-22c73199f258 req-d1c977d2-0fff-40f5-a5b0-631fd3553351 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.230969 Aug 25 13:07:48.713230 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2107/4172] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:07:48.826064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:48.857079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-09a5e879-a49f-4406-9a90-c1c972ee543f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1615 microversion: 2.1 time: 0.618116 Aug 25 13:07:48.859057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2066/4173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:48 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1615 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:49.307993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:49.309587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] [instance: cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:49.361975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:49.362908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:49.363830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:49.379045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:49.380418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:49.381653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:49.472361 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] HTTP exception thrown: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Request method failure captured: Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 HTTP/1.1 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3MxhL5sgA8MbYW4tf5qbad5HJ-fzy0Ud2eN-L7Y1XtduGQrLZoPLtAiLg_QsUZ6w-Z2YHL-AAIuEm8wS8Qr5X9oRBZJw61gDyMRuE99Wk1EoF7UmsLu8XREJEVXK4YQi4jTQAn5LVgaxM85jpQtc6mPCGVF4c5tSO20HhXC9vbh2eA Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/10a6e77cb29d430eb88d06ef30013a59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 10a6e77cb29d430eb88d06ef30013a59 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersAdminTestJSON-619722716 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 2678c6b68a0c4ad8b9b72dea2ec21741 Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersAdminTestJSON-619722716-project Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9'} Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:49.507377 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. Aug 25 13:07:49.522990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:49.530387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] Returning 404 to user: Instance cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:49.553326 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f395680-090b-4286-baa8-18509841b803 tempest-ServersAdminTestJSON-619722716 tempest-ServersAdminTestJSON-619722716-project] 10.222.0.60 "GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9" status: 404 len: 111 microversion: 2.1 time: 0.280875 Aug 25 13:07:49.554635 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2108/4174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:49 2022] GET /compute/v2.1/servers/cc1c2c35-2f37-4e20-97c1-cc4c3529b0e9 => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:49.910654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:49.915414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:49.940763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:49.942211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:49.946248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:49.951331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:49.954541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:49.956946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:50.692318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:50.713091 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95355061-c459-4f35-8b14-f3704faf030a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1615 microversion: 2.1 time: 0.819538 Aug 25 13:07:50.714839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2067/4175] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:49 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1615 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:51.762263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:51.771824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:51.823670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:51.835740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:51.835740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:51.843413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:51.848314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:51.857416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:51.964345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d72e2010-7876-482b-af0d-a4347684e7d1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: .version_select at 0x7fc6c1b05c10>, body: {"keypair": {"name": "tempest-keypair-593200906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnF9NTwYB7OjzyH9qIaakV8xdgUbtBOYeMolJrcN//TDg/zMZHLoMDBr8Pquw32UsxD8AuO7KDQPAcZSeUTklNdo8bkSpMZ7Ue5lozqVAZNqOlWxocoDqB10hpLCO4UvQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:52.110358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d72e2010-7876-482b-af0d-a4347684e7d1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for project 022896ed488444869702ebfc14d206ba. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:07:52.133793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d72e2010-7876-482b-af0d-a4347684e7d1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for user b10100bafac8484095f6348ca67abc7c and project 022896ed488444869702ebfc14d206ba. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:07:52.247435 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d72e2010-7876-482b-af0d-a4347684e7d1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.058605 Aug 25 13:07:52.248504 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2109/4176] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 13:07:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1061 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:07:52.703982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:52.743044 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-729e21e2-fdde-4362-b5fe-8a1cc03530b0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1615 microversion: 2.1 time: 0.990049 Aug 25 13:07:52.756461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb7ef98-982d-48b7-8a79-dde08ea77ee7", "name": "network-vif-deleted", "tag": "63eb7e29-17aa-452b-a2d9-bd7d61d02d32"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:07:52.770746 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2068/4177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:51 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1615 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:07:52.848991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:52.849952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:52.850789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:52.941492 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] Creating event network-vif-deleted:63eb7e29-17aa-452b-a2d9-bd7d61d02d32 for instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 on n-h1-850468-18 Aug 25 13:07:52.962948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7ad91941-d0a8-4aaa-8f4d-7852140956a3 req-8be5f74b-4459-4b67-8223-112345db009e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213485 Aug 25 13:07:52.968510 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2110/4178] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:07:53.813403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:53.830473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:53.888922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:53.889841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:53.890649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:53.908543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:53.909485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:53.910312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:54.095830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:54.101366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:54.110306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:54.111497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lazy-loading 'fault' on Instance uuid 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:07:54.326410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:07:54.368908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-39d527e1-e10f-40db-b344-5247de69db74 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 200 len: 1332 microversion: 2.1 time: 0.565219 Aug 25 13:07:54.408637 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2069/4179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:53 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 1332 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:07:55.437899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:55.441680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:07:55.477980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:55.489364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:55.492243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:55.493778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:07:55.494715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:07:55.495545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:07:55.574221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 HTTP/1.1 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5cb7ef98-982d-48b7-8a79-dde08ea77ee7'} Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:07:55.583145 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:07:55.593252 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d700845-bdb6-443c-beec-e14153dd020f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 404 len: 111 microversion: 2.1 time: 0.175065 Aug 25 13:07:55.613174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c0ffe51e-889a-4185-867d-ae0ddf337b39 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '.version_select at 0x7fc6c6bf2160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:07:55.620791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2111/4180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:07:55 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:07:55.733462 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c0ffe51e-889a-4185-867d-ae0ddf337b39 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644697267" status: 202 len: 0 microversion: 2.1 time: 0.122840 Aug 25 13:07:55.744863 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2070/4181] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 13:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644697267 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:08:00.517659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc5951a5-e5fe-4478-b8db-6a729c8aeee0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: .version_select at 0x7fc6c1eb4e50>, body: {"keypair": {"name": "tempest-keypair-617163862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHlg1am99Y3SRyRKq9aBle6rId8Mb3Yo4qxGZhrVizolVTjDc6EYF8jyM/dbvtt75x5mlTE62Y7h5HoRWiCd40k2zAOx+6h8w3hgzVaA8Q5l5Ldue15d4EHZp13V4bXog=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:00.647481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cc5951a5-e5fe-4478-b8db-6a729c8aeee0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:00.687479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cc5951a5-e5fe-4478-b8db-6a729c8aeee0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:00.846974 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc5951a5-e5fe-4478-b8db-6a729c8aeee0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.334846 Aug 25 13:08:00.848749 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2112/4182] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:08:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:01.839816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:01.864780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:01.905465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:01.906764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:01.913326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:01.917210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:01.920300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:01.921970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:02.211628 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-437cd3c2-90e9-4caa-813a-237aa1a486df tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.393017 Aug 25 13:08:02.220845 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2071/4183] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:08:01 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de/os-volume_attachments => generated 25 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:08:02.690705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:02.700366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:02.742630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:02.749859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:02.751359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:02.758360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:02.760473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:02.761759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:02.907222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:08:03.302004 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d3cad69-3e03-41ce-b36b-0bf46b07dc8e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 204 len: 0 microversion: 2.1 time: 0.632607 Aug 25 13:08:03.310464 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2072/4184] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:08:02 2022] DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:08:03.330738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:03.336902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:03.404571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:03.406824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:03.409971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:03.411695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:03.412942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-586497428", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:03.415542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:03.416736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:03.692344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] validate_networks() for [('76b627f4-8f62-442b-9068-cabc00464e78', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:08:05.042748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:05.069623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:05.082633 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4499b04-0d4c-4b5b-bdaa-07cf970652ed tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 1.763460 Aug 25 13:08:05.113046 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2073/4185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:03 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:05.573900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:06.139501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:06.143805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:06.208743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:06.209586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:06.213424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:06.222219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:06.224014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:06.244993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:07.274891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:07.308663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2930509e-4b46-4ad7-b7c3-a9c19a0bb089 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 1.181107 Aug 25 13:08:07.312946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2074/4186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:06 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:07.737838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:08:07.758327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:08:07.759154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:08:07.760348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:08:07.761103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:08:07.783161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:07.822237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:07.848868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:07.850872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:07.853047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:07.861060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:07.868491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:07.998406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Getting quotas for project 96559c8b454640b78ab5d4f849eda356. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:08.026495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Getting quotas for user 2c746c6cfcfd4c539b42b138f5d79c6a and project 96559c8b454640b78ab5d4f849eda356. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:08.103182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:08:08.112973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:08:08.359597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:08.366290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:08.375187 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:08:08.397615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:08.400074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:08.405525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:08.409593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:08.416393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:08.419498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:09.059156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:09.098448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3ff678a-e133-4665-9877-6941226714dc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 0.749762 Aug 25 13:08:09.108361 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2075/4187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:08 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:09.121720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-470409157", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab57234e-c504-4e90-9f0d-8a5ae81fc5d3"}], "security_groups": [{"name": "tempest-securitygroup--747851518"}], "key_name": "tempest-keypair-593200906", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:09.395226 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39408. Aug 25 13:08:09.433168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b82fbfd-086a-4e93-802e-9a4fa74369a0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.936372 Aug 25 13:08:09.435075 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2113/4188] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:08:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 6946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:08:09.473656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0cc08442-904c-4705-9f82-98d9ea325144 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:09.475499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0cc08442-904c-4705-9f82-98d9ea325144 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:09.582980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] validate_networks() for [('ab57234e-c504-4e90-9f0d-8a5ae81fc5d3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:08:09.660871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0cc08442-904c-4705-9f82-98d9ea325144 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:09.692043 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0cc08442-904c-4705-9f82-98d9ea325144 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1213 microversion: 2.1 time: 0.242663 Aug 25 13:08:09.713026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2114/4189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:09 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1213 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:10.484481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9bbc8eb-7caf-489c-b055-34c0c33302de", "name": "network-vif-unplugged", "status": "completed", "tag": "a1b01388-306b-4ae8-aed8-9c1a5bb435ee"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:10.577892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:10.580459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:10.582661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:10.636674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] Creating event network-vif-unplugged:a1b01388-306b-4ae8-aed8-9c1a5bb435ee for instance d9bbc8eb-7caf-489c-b055-34c0c33302de on n-h1-850468-18 Aug 25 13:08:10.672102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-31189e86-560d-4518-9676-fb6a3b91ce8c req-bd9c87ef-64aa-4a27-9d04-96d72e43a8c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.712069 Aug 25 13:08:10.675292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2115/4190] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:10.703309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:10.709267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:10.734562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:10.742187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:10.743604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:10.748540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:10.750877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:10.754035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.108867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:08:11.110768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:08:11.112205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:08:11.113423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:08:11.114498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:08:11.164891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:11.167768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:11.171952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.174953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:11.176527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:11.178633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.285278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for project 022896ed488444869702ebfc14d206ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:11.301240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for user b10100bafac8484095f6348ca67abc7c and project 022896ed488444869702ebfc14d206ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:11.335750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.355226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:08:11.359363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65f7d296-1e3d-47b3-a997-37dbe9f2f4f2 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 0.680256 Aug 25 13:08:11.361304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2116/4191] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:10 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:11.375669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:08:11.389146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:11.397453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:11.420406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:11.421800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:11.423148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.424974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:11.426209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:11.428946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:11.543038 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51a8b529-9718-424d-ae86-ecafdecb8d84 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.429715 Aug 25 13:08:11.547343 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2076/4192] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:08:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:08:11.579693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:11.581821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:11.643374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.697294 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c74a38dd-9132-4a5e-85dd-2dd60988925c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1209 microversion: 2.1 time: 0.327999 Aug 25 13:08:11.698428 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2117/4193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:11 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1209 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:11.746874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.764907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.767888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:11.770550 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e2e30678-2ca3-4891-a609-cffd521b1caa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1280 microversion: 2.20 time: 0.208160 Aug 25 13:08:11.772164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2077/4194] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:11 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:08:12.410118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:12.411347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:12.440400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.441166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.442470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:12.448567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.449944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.451119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:12.749627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:12.750826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:12.808440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.810353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.811545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:12.813212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:12.814627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:12.815210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:13.066832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:13.090770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f53748a-5849-4636-aaf4-246689038fbc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1271 microversion: 2.1 time: 0.350670 Aug 25 13:08:13.093684 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2078/4195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:12 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:13.114695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:13.119520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:13.134684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:13.139352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:13.141254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:13.143008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:13.145086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:13.146889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:13.247524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:13.297303 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24311b3e-4bde-45d7-a55b-4eb90de0d5f3 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 0.894683 Aug 25 13:08:13.322436 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2118/4196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:12 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:13.335401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:13.352166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:13.368925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:13.371620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97913634-53a3-4d76-908e-bb941178a935 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1284 microversion: 2.20 time: 0.275715 Aug 25 13:08:13.373120 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2079/4197] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:13 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:14.141252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:14.149626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:14.175465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:14.180638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:14.192286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:14.194027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:14.195240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:14.196259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:14.348060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:14.357527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:14.430628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:14.448735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:14.454525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:14.459421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:14.466460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:14.469313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:15.501312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:15.536068 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f27ee5ba-860e-49d1-a6a6-97d2b7b9ca07 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 1.402591 Aug 25 13:08:15.541420 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2119/4198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:14 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:15.583163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:15.601620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:15.641635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:15.642396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:15.643239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:15.657250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:15.657250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:15.657250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:15.921321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:15.958362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:15.986288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7b2fbf3-f2bf-491f-8455-56addc4e94cb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1669 microversion: 2.1 time: 1.646095 Aug 25 13:08:16.001857 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2080/4199] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:14 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1669 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:16.019209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:16.030950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:16.041113 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-adfe3fae-a6ad-42fd-8aa0-ce626ff8aebf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1338 microversion: 2.20 time: 0.496182 Aug 25 13:08:16.046879 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2120/4200] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:15 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1338 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:16.606276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:16.607757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:16.613945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:16.650101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:16.651513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:16.652654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:16.654423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:16.655700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:16.656865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.044854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:17.046304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:17.066757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.069116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.070955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.077621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.079422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.080881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.320421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:17.345492 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7efb5281-2a07-4f7f-ac5f-8049bc321cad tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1602 microversion: 2.1 time: 0.312830 Aug 25 13:08:17.349372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2121/4201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:17 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1602 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:17.365489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:17.368397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:17.386084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.387978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.391219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.393201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:17.397942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:17.399114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:17.665367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:17.676557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:17.693736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:17.704653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:17.710134 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2822439-3250-48e6-8030-bbf67b78014a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1338 microversion: 2.20 time: 0.356278 Aug 25 13:08:17.711851 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2122/4202] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:17 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1338 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:17.720573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e0cbd46-d709-4792-b68f-d436eb8cb560 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 1.143081 Aug 25 13:08:17.723237 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2081/4203] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:16 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:18.391378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1373522235", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a60d176-8c8c-4348-8828-aa3cd40d7203"}], "security_groups": [{"name": "tempest-securitygroup--306295977"}], "key_name": "tempest-keypair-617163862", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:18.391769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:18.392746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:18.400688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:18.414160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.416442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.418016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.419787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.421275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.422623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.883900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:18.928483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ced27e7-1dc8-4977-8e82-ab7c97ac8d57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 200 len: 1602 microversion: 2.1 time: 0.544507 Aug 25 13:08:18.931494 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2123/4204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:18 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 1602 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:18.946378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:18.948451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:18.968312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.970654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.973424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:18.976658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:18.978180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:18.979219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.055789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] validate_networks() for [('2a60d176-8c8c-4348-8828-aa3cd40d7203', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:08:19.645476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:19.726254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:19.741924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:19.747090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:19.750782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f844d80-a90a-49bd-b089-ff91329fe0ae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1338 microversion: 2.20 time: 0.814983 Aug 25 13:08:19.752781 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2124/4205] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:18 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1338 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:19.763078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:19.764706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:19.784658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.793202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.794454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:19.795736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:19.800292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:19.801253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:21.209065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:21.756268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:22.143869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:22.161310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd299208-d975-4e6e-a271-0d431692d264 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 2.405952 Aug 25 13:08:22.164448 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2125/4206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:19 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:22.192577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9bbc8eb-7caf-489c-b055-34c0c33302de", "name": "network-vif-deleted", "tag": "a1b01388-306b-4ae8-aed8-9c1a5bb435ee"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:22.257590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.278932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.281877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.339521 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] Creating event network-vif-deleted:a1b01388-306b-4ae8-aed8-9c1a5bb435ee for instance d9bbc8eb-7caf-489c-b055-34c0c33302de on n-h1-850468-18 Aug 25 13:08:22.375125 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ae2d6b7b-15af-4109-8ffe-8a6c3c9a613f req-2757a65b-b675-42f7-818f-5a8ab3b8222d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202913 Aug 25 13:08:22.377452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2126/4207] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:22.400259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:22.406118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:22.439691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.444602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.451359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.453499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.455056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.458329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.535979 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de HTTP/1.1 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd9bbc8eb-7caf-489c-b055-34c0c33302de'} Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:22.548599 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7cceb05b-7f82-453a-92e7-c98dd95fccb6 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 404 len: 111 microversion: 2.1 time: 0.175139 Aug 25 13:08:22.566807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2127/4208] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:22 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:08:22.581471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:22.581912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:22.608911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.609794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.610644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:22.612066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:22.613189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:22.613997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:23.813546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:08:23.814489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:08:23.822620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:08:23.827038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:08:23.828039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:08:23.908918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:23.910379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:23.914104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:23.928764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:23.934778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:23.939215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:23.954546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:23.998560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:24.018028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:24.020423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:24.027424 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d6f9eb6-b47c-4e95-ae7d-55f556ba21ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 1.463303 Aug 25 13:08:24.033445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2128/4209] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:22 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:24.035478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:24.065347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3663a7e8-7c3a-490e-9ad7-35d2fd66039b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '.version_select at 0x7fc6c1aa0160>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:24.090650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:08:24.101990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:08:24.148520 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3663a7e8-7c3a-490e-9ad7-35d2fd66039b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665572577" status: 202 len: 0 microversion: 2.1 time: 0.110721 Aug 25 13:08:24.150211 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2129/4210] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665572577 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:08:24.171217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:24.172566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:24.187170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.188661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.190454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.195102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.197149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.198410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.453399 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1139b85-cd88-4303-ba91-6d995419bd3c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.066675 Aug 25 13:08:24.457598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2082/4211] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:08:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 6077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:08:24.513701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1", "tag": "f2d55742-f49f-4480-af0b-7cf31d7d85c1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:24.589269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:24.591197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:24.593744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:24.634857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] Creating event network-changed:f2d55742-f49f-4480-af0b-7cf31d7d85c1 for instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 on n-h1-850468-18 Aug 25 13:08:24.649776 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0fee010c-e297-45b1-a6c8-181d82989178 req-6e1a52f8-1373-4b2e-8cd4-371ffe7833d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186313 Aug 25 13:08:24.651725 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2083/4212] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:24.669151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc4a9609-54aa-4a9c-8217-cb84a1500520 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:24.672471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc4a9609-54aa-4a9c-8217-cb84a1500520 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:25.799796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc4a9609-54aa-4a9c-8217-cb84a1500520 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:25.831964 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc4a9609-54aa-4a9c-8217-cb84a1500520 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1241 microversion: 2.1 time: 1.177521 Aug 25 13:08:25.837900 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2084/4213] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:24 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1241 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:25.873473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:25.901022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:25.952699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:25.953646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:25.954439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:25.955766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:25.956677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:25.970464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:26.850870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:26.892293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3b84c971-b23a-4dcd-bcc3-43e428add442 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 2.739335 Aug 25 13:08:26.894045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2130/4214] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:24 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 2743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:26.939149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9de35aa-8b6b-44b3-ab58-065460e06c5b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:26.940588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9de35aa-8b6b-44b3-ab58-065460e06c5b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:28.422337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9de35aa-8b6b-44b3-ab58-065460e06c5b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:28.451778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9de35aa-8b6b-44b3-ab58-065460e06c5b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1241 microversion: 2.1 time: 1.548359 Aug 25 13:08:28.454400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2131/4215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:26 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1241 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:28.468245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:28.471868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:28.491280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.497931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.499188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:28.500950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:28.502560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:28.504255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:28.925766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:28.972709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:28.992999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:28.995199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed4cd76a-5518-4806-8e6f-187767d2f836 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 3.154902 Aug 25 13:08:29.004824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2085/4216] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:25 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:29.328172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:29.357365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c18074c-9bd0-4246-ac24-0b35a1132ad7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 0.899703 Aug 25 13:08:29.364337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2132/4217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:28 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:29.522036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:29.523085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:29.524630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:29.559736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:29.564192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:29.566535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:29.568461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:29.571099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:29.576291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:29.577342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:29.583138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:29.584286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:29.622586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] Creating event network-changed:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:08:29.645231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4da078aa-f177-4d8c-9dec-e629d2d256f4 req-dc5b5ab9-1ece-4c8d-9467-9c3d11a1f543 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122210 Aug 25 13:08:29.647745 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2133/4218] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:29.793562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:29.843973 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef573eae-1f78-49c6-8b92-4462be3acde2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1245 microversion: 2.1 time: 0.335396 Aug 25 13:08:29.853427 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2086/4219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:29 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1245 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:30.058133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:30.060809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:30.076872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:30.078232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:30.080797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:30.082415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:30.084325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:30.085478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:30.417910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:30.426286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:30.451489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:30.454842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:30.454842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:30.455767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:30.456932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:30.457957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.251991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.274204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.282063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.284897 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9d94991-6d8d-4aeb-a23f-913590170a1a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 2.239302 Aug 25 13:08:32.287117 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2134/4220] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:30 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:32.302431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:32.304310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:32.322999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:32.324567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:32.325689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.327270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:32.328389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:32.329453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:32.387315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.424426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7546455a-a9a9-48fc-bb81-68c33e29a0a2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 2.018762 Aug 25 13:08:32.431600 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2087/4221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:30 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:32.633721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:32.658311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:32.673226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c775951e-418d-4ea6-8b48-0110a3e381b2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1299 microversion: 2.1 time: 0.383177 Aug 25 13:08:32.682950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2135/4222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:32 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:32.925513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95ea66d0-2711-46ad-ad77-4d50e8c59e15 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: .version_select at 0x7fc6c11cac10>, body: {"keypair": {"name": "tempest-keypair-1905515667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR10IfpN66QDDYA8qQnmXudg9tzlIwscphWo3P4LOnmxeXTDYunklkAPLUXLMD1DSjEcbMT1vUVO+1TSd6IlHV/nAfYEDrsoqRr7gggJNRa7sVxaiWJ6VTIamFRDJRjrA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:32.970120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-95ea66d0-2711-46ad-ad77-4d50e8c59e15 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for project 47d8604d32274a42923d8304d5b191b8. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:32.983411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-95ea66d0-2711-46ad-ad77-4d50e8c59e15 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for user f58d37ebb4c1469fb8bb4973a8bcb602 and project 47d8604d32274a42923d8304d5b191b8. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:33.081237 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95ea66d0-2711-46ad-ad77-4d50e8c59e15 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163982 Aug 25 13:08:33.089137 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2088/4223] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:08:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:33.338759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:33.343350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:33.419421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.421751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.425164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.429118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.430441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.432165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.468730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:33.477708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:33.503007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.503861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.504776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.506485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:33.507438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:33.508330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:33.987960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:34.988580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:34.994485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:35.030214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad30bc9a-6f0a-4044-89ec-b6a6329cdec6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 1.570346 Aug 25 13:08:35.044557 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2089/4224] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:33 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:35.056955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:35.057485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:35.059161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:35.082284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:35.088750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:35.090048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:35.092741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:35.097984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:35.099670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8c511ce-38cb-4c42-bd7f-0c8b8f9ce4f8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 1.760499 Aug 25 13:08:35.103329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2136/4225] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:33 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:35.104456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:35.105694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:35.365645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:35.390663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-749a3ed1-f32d-419b-913a-6f920393421e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1299 microversion: 2.1 time: 0.350189 Aug 25 13:08:35.400665 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2090/4226] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:35 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1299 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:36.088765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:36.095292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:36.124430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:36.126165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:36.128064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:36.131269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:36.133478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:36.135881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:36.164834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:36.167015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:36.183051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:36.184516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:36.191288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:36.193250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:36.193973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:36.194890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:36.903795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:36.926789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=77 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:36.933133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:36.949173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:36.951602 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8c3dcb5-ff19-4627-9acf-0391dba9721c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 0.800107 Aug 25 13:08:36.959579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2091/4227] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:36 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:36.977560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:36.980367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:37.007084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:37.009303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:37.016905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:37.018651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:37.020036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:37.021905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:37.049083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:37.070250 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f6115de-a439-400c-94d6-604e93a8636c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 0.991698 Aug 25 13:08:37.114654 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2137/4228] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:36 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:37.323926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:37.361758 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-107e998e-8016-4198-b1c7-1aa9d098250a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1299 microversion: 2.1 time: 0.400237 Aug 25 13:08:37.363517 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2092/4229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:36 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1299 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:38.008306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:38.010135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:38.014019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:38.036989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:38.048788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:38.049767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:38.051181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:38.052225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:38.053093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:38.120762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:38.129296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:38.170692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:38.172858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:38.174922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:38.183644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:38.185239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:38.194974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:38.450341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:40.195597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:40.240886 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb5bdbad-f3f1-40c3-82bf-9d482a68a75f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 2.134474 Aug 25 13:08:40.242881 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2093/4230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:38 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:40.252748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:40.254461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:40.283410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:40.284387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:40.285430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:40.287643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:40.288947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:40.296343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:40.296908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:40.316284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:40.320785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:40.323531 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-627e1fba-4d67-4a16-a681-d2391ab3d43c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 2.324468 Aug 25 13:08:40.325701 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2138/4231] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:37 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:40.563336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1", "name": "network-vif-plugged", "status": "completed", "tag": "f2d55742-f49f-4480-af0b-7cf31d7d85c1"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:40.615757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:40.623979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:40.625755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:40.675211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] Creating event network-vif-plugged:f2d55742-f49f-4480-af0b-7cf31d7d85c1 for instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 on n-h1-850468-18 Aug 25 13:08:40.714109 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b405f9d5-8e17-453a-9b13-aab2cc32f07f req-0823ca11-69d8-42f8-b079-8164132e1c0c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174251 Aug 25 13:08:40.726275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2139/4232] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:41.293373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:41.311743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:41.318939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:41.347506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.349409 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d41e93c8-6793-4d0e-a58c-ebddec4a03fd tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.101262 Aug 25 13:08:41.354509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.357444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:41.359594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.368988 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2094/4233] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:40 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:41.370542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.371482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:41.384991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:41.402233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:41.436359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.445698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.446920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:41.460834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:41.462334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:41.463761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:42.634918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:42.676513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a439417a-ec53-4576-9b4d-a7a64312ab97 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1313 microversion: 2.1 time: 1.386992 Aug 25 13:08:42.681779 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2140/4234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:41 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1313 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:42.711398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:42.712893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:42.737351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:42.742235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:42.743210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:42.744875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:42.746744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:42.753985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:42.930278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:42.996973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:43.006499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:43.010549 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93a2066b-890c-445e-a006-c883572206de tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 1.637570 Aug 25 13:08:43.013031 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2095/4235] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:41 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:43.507939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:43.544157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6748ce81-b8e3-461b-8677-1a3a1c70b327 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 0.859669 Aug 25 13:08:43.553136 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2141/4236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:42 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:43.722116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:43.727772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:43.750891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:43.772257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:43.778363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:43.779085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:43.780327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:43.785592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:43.789207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:44.218891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:44.246620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebc8f6a6-f315-4428-9b6f-f01678335a39 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1499 microversion: 2.1 time: 0.531759 Aug 25 13:08:44.258722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2096/4237] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:43 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1499 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:44.285726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:44.287465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:44.316812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:44.318601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:44.320044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:44.321894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:44.323011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:44.324108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:44.457063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ce2cc6a-5fec-4dfe-b366-52b45a08b3ff tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1a83310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-190116094", "description": "tempest-description-1444168163"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:44.924463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:44.984073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:44.987986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:44.994219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b069a9b-d14e-4af5-bf8c-807ed306cfd3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 0.732122 Aug 25 13:08:45.016160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2097/4238] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:44 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:45.016160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:45.018624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:45.037901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:45.039157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:45.040428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:45.043710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:45.045284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:45.046621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:45.142351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lazy-loading 'flavor' on Instance uuid 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:08:45.577975 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fd554d7-dd53-4f7a-8d9d-5de106d5ab21 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "POST /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1/action" status: 200 len: 32 microversion: 2.1 time: 0.569115 Aug 25 13:08:45.589323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2098/4239] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:08:44 2022] POST /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1/action => generated 32 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:08:45.613726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:45.623576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:45.636758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:45.637418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:45.640161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:45.640161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:45.640715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:45.642052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:46.285372 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ce2cc6a-5fec-4dfe-b366-52b45a08b3ff tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.423779 Aug 25 13:08:46.306381 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2142/4240] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:08:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:46.347394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:46.349233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:46.388040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:46.388813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:46.389621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:46.391210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:46.392091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:46.392883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:46.967048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:47.001940 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8780b99-e2bb-452a-a2ac-79ac16c52f2b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.413258 Aug 25 13:08:47.007574 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2099/4241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:45 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:47.027870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:47.030139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:47.043303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:47.047536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:47.049120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:47.051579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:47.054212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:47.055731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:47.057057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:47.134018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:47.181125 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8569acb6-fbb6-4368-bc77-af96dc1aabb5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.872999 Aug 25 13:08:47.196636 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2143/4242] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:46 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:47.207086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e62d6a09-38d6-4792-9c01-c2b83f7fbcc2 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1eb4ca0>, body: {"security_group_rule": {"parent_group_id": "179faee0-0dc7-46bb-a2fe-fab06d705230", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:47.769434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:47.791521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:47.797259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:47.800532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-572e6fe1-dc8e-4633-b917-e559b970e30b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 0.788243 Aug 25 13:08:47.803422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2100/4243] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:47 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:47.817724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e11534e-e7d6-4476-97ba-107c7b14e4ce", "tag": "91cec168-3e7d-4bf2-904e-34af7e0941ea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:47.838426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:47.839704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:47.840802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:47.864567 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] Creating event network-changed:91cec168-3e7d-4bf2-904e-34af7e0941ea for instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce on n-h1-850468-18 Aug 25 13:08:47.882382 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-62a1a888-8fb8-4c32-aca5-17715c09d85f req-05b90fb7-75f4-4d9c-bf97-4a934e7ede7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075517 Aug 25 13:08:47.884393 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2101/4244] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:48.071649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:48.073872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:48.093150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:48.096265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:48.098157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:48.102138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:48.107292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:48.108187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:48.562177 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e62d6a09-38d6-4792-9c01-c2b83f7fbcc2 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.359733 Aug 25 13:08:48.564568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2144/4245] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:08:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:48.588029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:48.593749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:48.612411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:48.613657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:48.615521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:48.617504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:48.618972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:48.623011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:48.901393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:48.946183 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa1875bc-fcee-4f81-8f06-e2571495eccf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 0.895463 Aug 25 13:08:48.969098 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2102/4246] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:48 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:08:48.978394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f4211d97-40d5-4e09-b198-66d19571af8e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c6c43940>, body: {"security_group_rule": {"parent_group_id": "179faee0-0dc7-46bb-a2fe-fab06d705230", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:49.054315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:49.077109 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c76e02eb-6a49-4b8a-b4eb-3fe7a26166a4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.510128 Aug 25 13:08:49.078896 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2145/4247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:48 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:49.096720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-plugged", "status": "completed", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:49.127134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f4211d97-40d5-4e09-b198-66d19571af8e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f4211d97-40d5-4e09-b198-66d19571af8e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 138 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: {"security_group_rule": {"parent_group_id": "179faee0-0dc7-46bb-a2fe-fab06d705230", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: exception: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'security_group_rule': {'parent_group_id': '179faee0-0dc7-46bb-a2fe-fab06d705230', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:49.130545 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:49.139682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:49.139682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:49.139682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 Aug 25 13:08:49.139682 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:49.141938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f4211d97-40d5-4e09-b198-66d19571af8e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: This rule already exists in group 179faee0-0dc7-46bb-a2fe-fab06d705230 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:49.144844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.146868 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f4211d97-40d5-4e09-b198-66d19571af8e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.187851 Aug 25 13:08:49.147054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.147556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.148944 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2103/4248] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:08:48 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:08:49.159061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:49.160866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:49.177164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.180006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.181646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.185384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:49.187766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:49.189612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:49.244484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] Creating event network-vif-plugged:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:08:49.276836 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f7e262b4-f589-4634-b6e4-d02293b76033 req-decbdd33-deb9-4cd6-94af-402edc9a2c64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175102 Aug 25 13:08:49.279121 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2146/4249] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:49.293746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-522935eb-3add-4126-a66e-e68568aed14b tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c1885670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:50.106283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:50.133414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:50.138756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:50.170515 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-abe7130c-5156-49f6-a6ba-1974573ec8b8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1405 microversion: 2.20 time: 1.019257 Aug 25 13:08:50.171940 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2104/4250] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:49 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1405 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:50.221285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-750690640", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5afca0aa-c188-40d8-babd-39bb18190633"}], "security_groups": [{"name": "tempest-securitygroup--1972292391"}], "key_name": "tempest-keypair-1905515667", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:50.326167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-522935eb-3add-4126-a66e-e68568aed14b tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/b32a9e3f-2937-4374-b458-6b3ef294fd16" status: 202 len: 0 microversion: 2.1 time: 1.043972 Aug 25 13:08:50.328094 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2147/4251] 10.222.0.60 () {58 vars in 1287 bytes} [Thu Aug 25 13:08:49 2022] DELETE /compute/v2.1/os-security-group-rules/b32a9e3f-2937-4374-b458-6b3ef294fd16 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:08:50.351001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:50.353177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:50.375632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:50.376667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:50.377964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:50.379716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:50.381328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:50.382367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:50.628626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] validate_networks() for [('5afca0aa-c188-40d8-babd-39bb18190633', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:08:51.314945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:51.392270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f67bbc70-dedd-4071-9824-229fcc162a32 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.057403 Aug 25 13:08:51.398481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2148/4252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:50 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:51.477294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:51.485783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:51.575361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:51.579310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:51.586908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:51.591426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:51.599784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:51.605864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:52.695197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:52.722221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e8309e1-3a99-4864-a123-38b03d47a599 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.306399 Aug 25 13:08:52.744803 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2149/4253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:51 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:52.765386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99c8885b-af7c-43c7-ba4f-aa96c99fdaf7 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c188aca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1186637855", "description": "tempest-description-1118318861"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:53.215200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:08:53.215990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:08:53.216907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:08:53.220929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:08:53.223316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:08:53.275913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.283879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.285035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.288726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.290877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.294377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.398240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for project 47d8604d32274a42923d8304d5b191b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:08:53.426893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Getting quotas for user f58d37ebb4c1469fb8bb4973a8bcb602 and project 47d8604d32274a42923d8304d5b191b8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:08:53.493085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:08:53.505369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:08:53.764959 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6f5b010c-43ea-4c47-8a2b-3a483182444e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.589729 Aug 25 13:08:53.771437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2105/4254] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:08:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 3597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:08:53.788633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:53.790584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:53.805396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.806329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.807165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:53.808862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:53.809743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:53.810574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:54.640436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99c8885b-af7c-43c7-ba4f-aa96c99fdaf7 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.889512 Aug 25 13:08:54.641782 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2150/4255] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:08:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:08:54.661835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:54.665373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:54.720542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:54.721366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:54.722885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:54.724565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:54.725248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:54.725926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:55.265033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:55.299030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:55.309438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:55.311889 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7511dbdd-a1ea-40cb-85eb-d06f06e823e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1596 microversion: 2.20 time: 1.538477 Aug 25 13:08:55.313008 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2106/4256] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:08:53 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1596 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:08:55.339127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:55.349029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:55.373244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:55.385636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:55.387171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:55.388951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:55.390178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:55.391219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.061919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:56.103043 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46e992c8-2b58-4c0a-8757-d00ef52e9504 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.455183 Aug 25 13:08:56.117320 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2151/4257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:54 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:56.156819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:56.157993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:56.182738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.184642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.189079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.190987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.195582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.198555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.319642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:56.385958 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-009f9f0d-d68a-4382-aaf7-1224e6e9a567 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.055771 Aug 25 13:08:56.387195 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2107/4258] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:55 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:56.411820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aeca8dd9-5552-4735-8688-f96a12371d13 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c11b6430>, body: {"security_group_rule": {"parent_group_id": "b0d6e6a2-7a41-49a2-a968-a01b7584252e", "ip_protocol": "tcp", "from_port": 740695608, "to_port": 22}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:56.517846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:56.551367 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21642c11-fd34-4c8b-8f6b-226d3a570a22 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1289 microversion: 2.1 time: 0.429582 Aug 25 13:08:56.554292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2152/4259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:56 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1289 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:56.579567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:56.582969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:56.611979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.613050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.613309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.615151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:56.615902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:56.616719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:56.707146 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-aeca8dd9-5552-4735-8688-f96a12371d13 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Invalid port range 740695608:22. Former value cannot be greater than the later Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aeca8dd9-5552-4735-8688-f96a12371d13 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 145 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: {"security_group_rule": {"parent_group_id": "b0d6e6a2-7a41-49a2-a968-a01b7584252e", "ip_protocol": "tcp", "from_port": 740695608, "to_port": 22}} Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid port range 740695608:22. Former value cannot be greater than the later Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b0d6e6a2-7a41-49a2-a968-a01b7584252e', 'ip_protocol': 'tcp', 'from_port': 740695608, 'to_port': 22}}} Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 740695608:22. Former value cannot be greater than the later Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 740695608:22. Former value cannot be greater than the later Aug 25 13:08:56.715485 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 740695608:22. Former value cannot be greater than the later Aug 25 13:08:56.724572 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.731352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aeca8dd9-5552-4735-8688-f96a12371d13 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: Invalid port range 740695608:22. Former value cannot be greater than the later {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:56.736928 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aeca8dd9-5552-4735-8688-f96a12371d13 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.336417 Aug 25 13:08:56.742615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2108/4260] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:08:56 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:08:56.767616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3fd6c14-7450-4b9a-86d0-6e305e06f03e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1183670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1773085245", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:56.774726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c3fd6c14-7450-4b9a-86d0-6e305e06f03e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Security group id should be uuid Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3fd6c14-7450-4b9a-86d0-6e305e06f03e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 131 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1773085245", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: exception: Security group id should be uuid Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1773085245', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:56.778292 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:56.788395 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 25 13:08:56.788395 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:08:56.788395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c3fd6c14-7450-4b9a-86d0-6e305e06f03e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: Security group id should be uuid {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:56.789565 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c3fd6c14-7450-4b9a-86d0-6e305e06f03e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.033357 Aug 25 13:08:56.790737 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2109/4261] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:08:56 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:08:56.815880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-336a96c4-698c-4f08-93c1-40ea95cac3c7 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c12543a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1854092318", "description": "tempest-description-1756859747"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:57.734092 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc96b312-a193-416a-863d-fe04109fbc64 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-interface" status: 200 len: 284 microversion: 2.20 time: 1.176136 Aug 25 13:08:57.736577 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2153/4262] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 13:08:56 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-interface => generated 284 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:08:57.756541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:57.758202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:57.791269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:57.792771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:57.793898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:57.795678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:57.796971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:57.798032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.742159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-336a96c4-698c-4f08-93c1-40ea95cac3c7 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.942316 Aug 25 13:08:58.759901 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2110/4263] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:08:56 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:08:58.776669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:58.778629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:58.780183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:58.797290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.801298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.804812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.807062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.808701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.810845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.818525 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-712740c9-6261-4051-bff5-e875abc692a4 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.080045 Aug 25 13:08:58.825224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2154/4264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:57 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:58.838466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:58.841277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:58.857656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.859181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.861170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:58.863640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:58.865723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:58.867294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:59.158196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:59.175540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aeb8b877-f2df-4373-895e-9d71552e62a7 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1295 microversion: 2.1 time: 0.347442 Aug 25 13:08:59.177733 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2155/4265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:58 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1295 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:59.188306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c8877b1-cef0-48d3-97e5-e0860820941c tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1eb4d30>, body: {"security_group_rule": {"parent_group_id": "dffe083e-a052-4139-b9a7-64d83f6268bd", "ip_protocol": "tempest-999-1193749597", "from_port": 22, "to_port": 22}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:59.560691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7c8877b1-cef0-48d3-97e5-e0860820941c tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Invalid IP protocol tempest-999-1193749597. Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c8877b1-cef0-48d3-97e5-e0860820941c tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 157 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: {"security_group_rule": {"parent_group_id": "dffe083e-a052-4139-b9a7-64d83f6268bd", "ip_protocol": "tempest-999-1193749597", "from_port": 22, "to_port": 22}} Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid IP protocol tempest-999-1193749597. Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dffe083e-a052-4139-b9a7-64d83f6268bd', 'ip_protocol': 'tempest-999-1193749597', 'from_port': 22, 'to_port': 22}}} Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1193749597. Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1193749597. Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:59.570943 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1193749597. Aug 25 13:08:59.582382 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:08:59.587688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c8877b1-cef0-48d3-97e5-e0860820941c tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: Invalid IP protocol tempest-999-1193749597. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:08:59.590238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7c8877b1-cef0-48d3-97e5-e0860820941c tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.410209 Aug 25 13:08:59.594674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2156/4266] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:08:59 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 25 13:08:59.616975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-631be7fb-7747-4c4c-914a-306ee0efc29a tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c188a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-875837216", "description": "tempest-description-880679457"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:08:59.626477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:08:59.649164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:08:59.654663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fc9ae88-ad68-4757-a296-3f662fb73572 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.891759 Aug 25 13:08:59.658350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2111/4267] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:58 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:08:59.890662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:08:59.902910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:08:59.941046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:59.942037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:59.942940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:08:59.944605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:08:59.956189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:08:59.957047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.509133 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-631be7fb-7747-4c4c-914a-306ee0efc29a tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.902427 Aug 25 13:09:01.511966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2157/4268] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:08:59 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:01.533364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:01.535126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:01.574802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.576451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.577594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.584972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.586550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.587663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.678821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:01.724893 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df1fc29b-d74b-44cb-b93d-8f31e3585b5d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.849385 Aug 25 13:09:01.727367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2112/4269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:08:59 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:01.748798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:01.750491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:01.765631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.767029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.768295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:01.771953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:01.773302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:01.774492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:02.643461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:02.670328 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0efd1077-ac74-4631-a55d-eeaee2b45b09 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.155885 Aug 25 13:09:02.674802 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2158/4270] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:01 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:02.702058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e11534e-e7d6-4476-97ba-107c7b14e4ce", "name": "network-vif-plugged", "status": "completed", "tag": "91cec168-3e7d-4bf2-904e-34af7e0941ea"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:02.756486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:02.757319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:02.758050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:02.800812 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] Creating event network-vif-plugged:91cec168-3e7d-4bf2-904e-34af7e0941ea for instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce on n-h1-850468-18 Aug 25 13:09:02.812144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fecd4b67-be1a-4583-be0c-aef693a1c613 req-4de2fa00-c844-4437-9d4a-96798938295f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134563 Aug 25 13:09:02.813763 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2159/4271] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:02.825167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892a4a47-b954-40f1-8bc5-31b9c697c965 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1aa0550>, body: {"security_group_rule": {"parent_group_id": "7a6162b4-c9ef-48e8-a9f6-4d04475070a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:03.343508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:03.462002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:03.472945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:03.510714 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfaa3628-b61e-4fb2-854c-d171716f34b5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.780639 Aug 25 13:09:03.512657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2113/4272] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:01 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:03.524619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:03.545127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.546039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.547322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.572148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-892a4a47-b954-40f1-8bc5-31b9c697c965 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892a4a47-b954-40f1-8bc5-31b9c697c965 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 138 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: {"security_group_rule": {"parent_group_id": "7a6162b4-c9ef-48e8-a9f6-4d04475070a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7a6162b4-c9ef-48e8-a9f6-4d04475070a9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 13:09:03.577776 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 25 13:09:03.585917 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:03.591074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-892a4a47-b954-40f1-8bc5-31b9c697c965 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:09:03.593390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-892a4a47-b954-40f1-8bc5-31b9c697c965 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.777569 Aug 25 13:09:03.595386 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2160/4273] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:09:02 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 781 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:09:03.606710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:03.608804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:03.616324 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] Creating event network-changed:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:09:03.637726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-de46a8fc-5cdf-4228-a234-605711305dc3 req-c8fee527-e500-4b8b-bebb-e71835abc8af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122766 Aug 25 13:09:03.641561 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2114/4274] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:03.649642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.650646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.654232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.663935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:03.665302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:03.666400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:03.667770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33a4f26d-78e2-41bb-82e8-09746ddb4f46 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c12f4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-743920244", "description": "tempest-description-1049683673"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:03.698881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:04.728003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:04.745154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c934d770-9f00-4ca8-b764-ddd4843296fa tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1366 microversion: 2.1 time: 1.147257 Aug 25 13:09:04.747195 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2161/4275] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:03 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1366 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:04.759047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:04.761704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:04.775471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:04.776671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:04.777805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:04.779555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:04.781484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:04.783574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:05.120267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33a4f26d-78e2-41bb-82e8-09746ddb4f46 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.472339 Aug 25 13:09:05.126071 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2115/4276] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:09:03 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:05.152665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:05.158061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:05.180719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:05.182408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:05.184210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:05.187452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:05.192632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:05.194073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:05.828418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:05.857784 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3dff4ebf-9bb7-459a-ab61-f53e7414e84d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.108088 Aug 25 13:09:05.868870 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2162/4277] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:04 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:05.892484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6e5b06d-9233-465f-9f4a-8c3c8ff1298e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c1aa08b0>, body: {"security_group_rule": {"parent_group_id": "d509c578-958a-4763-8d19-bc9b3485e4c2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1383090585}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:06.205062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:06.236732 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4c528c7-aacd-42dd-9f69-22fe50abd9b1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.101269 Aug 25 13:09:06.246691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2116/4278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:05 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:06.268392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:06.273350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:06.277148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e6e5b06d-9233-465f-9f4a-8c3c8ff1298e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6e5b06d-9233-465f-9f4a-8c3c8ff1298e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 146 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: {"security_group_rule": {"parent_group_id": "d509c578-958a-4763-8d19-bc9b3485e4c2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1383090585}} Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd509c578-958a-4763-8d19-bc9b3485e4c2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1383090585}}} Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 Aug 25 13:09:06.282735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6e5b06d-9233-465f-9f4a-8c3c8ff1298e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 400 to user: Invalid port range 22:1383090585. Valid TCP ports should be between 1-65535 {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6e5b06d-9233-465f-9f4a-8c3c8ff1298e tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.409646 Aug 25 13:09:06.297371 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2163/4279] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:09:05 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 421 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:09:06.308674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:06.310180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:06.311473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:06.313015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:06.314067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:06.314740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:06.334168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Action: 'create', calling method: .version_select at 0x7fc6c25d9af0>, body: {"security_group_rule": {"parent_group_id": "f5586c4b-5f0f-4bfe-a935-9223852fbf82", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:06.491203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 13:09:06.493046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Neutron security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 not found {{(pid=122701) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 25 13:09:06.494497 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.494497 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 138 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: {"security_group_rule": {"parent_group_id": "f5586c4b-5f0f-4bfe-a935-9223852fbf82", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f5586c4b-5f0f-4bfe-a935-9223852fbf82', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 13:09:06.508613 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] Aug 25 13:09:06.519047 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.531813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 404 to user: Security group f5586c4b-5f0f-4bfe-a935-9223852fbf82 does not exist Aug 25 13:09:06.531813 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-362db5fd-0a42-4d3f-939d-a42a5e308d0d'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:09:06.540350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-263d1561-1cad-471c-ba2a-6eeb2b63de35 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.221681 Aug 25 13:09:06.554052 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2164/4280] 10.222.0.60 () {60 vars in 1195 bytes} [Thu Aug 25 13:09:06 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:09:06.575523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c2a695e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:06.835503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG neutronclient.v2_0.client [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist", "detail": ""}} {{(pid=122701) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 25 13:09:06.839790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.security_group_api [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Neutron security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 not found {{(pid=122701) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 25 13:09:06.842058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] HTTP exception thrown: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.842058 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Request method failure captured: Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-security-group-rules/edf5e0ae-c4ad-40b4-8762-57859ede4ab0 HTTP/1.1 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3RbQtBh3lvGaXqgitqtwT33ALBsP0sDHFDDcQBWNeTNPXy-YY-He3XC5chXI0-MEEYjB3C_2qSlJdMfnxhVlQlqYset9S3f12fUvgyrI2QV5nGnIaeHGpW8l5xnjPfyPrH04OiCLgZfnauFoj75y49PbZbDTJt5Dazly1iP76a0-Ek Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8378f2e3071847aa884c3734abeffda8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8378f2e3071847aa884c3734abeffda8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8378f2e3071847aa884c3734abeffda8 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 1af72201cefe499f9cec31f0c33d67f6 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-975963920-project Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: exception: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'edf5e0ae-c4ad-40b4-8762-57859ede4ab0'} Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 25 13:09:06.848545 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] Aug 25 13:09:06.857013 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:09:06.868764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Returning 404 to user: Security group rule edf5e0ae-c4ad-40b4-8762-57859ede4ab0 does not exist Aug 25 13:09:06.868764 n-d-850468-18 devstack@n-api.service[122701]: Neutron server returns request_ids: ['req-adf5c834-5873-4bf7-a860-328a4018a18a'] {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:09:06.872106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65b9085c-3b6b-4adc-a8ed-0db59789c071 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-group-rules/edf5e0ae-c4ad-40b4-8762-57859ede4ab0" status: 404 len: 199 microversion: 2.1 time: 0.311953 Aug 25 13:09:06.874859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2165/4281] 10.222.0.60 () {58 vars in 1287 bytes} [Thu Aug 25 13:09:06 2022] DELETE /compute/v2.1/os-security-group-rules/edf5e0ae-c4ad-40b4-8762-57859ede4ab0 => generated 199 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:09:06.903942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d13d72c7-07d8-43bf-81ce-7c6ccbfffdbd tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c1a899d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:07.062423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:07.077968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d86e8cd-5768-443e-a05c-8b9c7aa646ba tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1556 microversion: 2.1 time: 0.828765 Aug 25 13:09:07.079982 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2117/4282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:06 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1556 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:07.104050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:07.105547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:07.135537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:07.138455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:07.139814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:07.141793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:07.146479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:07.149376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.018261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:08.054101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-90197cb1-7b1e-4066-82b3-57095020aa1d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 0.971381 Aug 25 13:09:08.057325 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2118/4283] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:07 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:08.084013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:08.085582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:08.106889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:08.108365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:08.109890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.111815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:08.113206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:08.114351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.376960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d13d72c7-07d8-43bf-81ce-7c6ccbfffdbd tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/d509c578-958a-4763-8d19-bc9b3485e4c2" status: 202 len: 0 microversion: 2.1 time: 1.489542 Aug 25 13:09:08.378402 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2166/4284] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:09:06 2022] DELETE /compute/v2.1/os-security-groups/d509c578-958a-4763-8d19-bc9b3485e4c2 => generated 0 bytes in 1492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:09:08.403191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:08.405038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:08.410457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=36 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:08.417483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:08.419120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:08.420189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.421214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:08.422007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:08.423059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.467911 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30756384-6bb3-49f7-ad0a-8d12a768b455 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.404247 Aug 25 13:09:08.469722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2119/4285] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:09:08 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:08.480166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702767f3-638b-4dcd-8f94-66973db66364", "tag": "2a71de3a-71b7-496a-8946-8d01138e69fd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:08.527811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:08.529263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:08.541608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:08.572505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] Creating event network-changed:2a71de3a-71b7-496a-8946-8d01138e69fd for instance 702767f3-638b-4dcd-8f94-66973db66364 on n-h1-850468-18 Aug 25 13:09:08.592341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c92cb7ef-dcf3-4802-abca-0d68f7fdb779 req-63660083-17e9-41c5-851d-1f970931a90f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118682 Aug 25 13:09:08.594002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2120/4286] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:08.608632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5166ef14-fbc1-4ffa-a76a-fc057c77e9bd tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c11f2b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:10.139319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:10.192404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-526cad7f-10e4-4351-b6a1-07da4d4b21ed tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.811639 Aug 25 13:09:10.199762 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2167/4287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:08 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:10.213477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:10.215123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:10.232840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:10.234562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:10.235722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:10.237912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:10.240973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:10.244595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:11.209877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5166ef14-fbc1-4ffa-a76a-fc057c77e9bd tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/7a6162b4-c9ef-48e8-a9f6-4d04475070a9" status: 202 len: 0 microversion: 2.1 time: 2.612242 Aug 25 13:09:11.211012 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2121/4288] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:09:08 2022] DELETE /compute/v2.1/os-security-groups/7a6162b4-c9ef-48e8-a9f6-4d04475070a9 => generated 0 bytes in 2617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:09:11.233401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b95f7281-ed4e-4a23-9dae-5579ab0a3b4b tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c11f2430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:11.331324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:11.379465 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-558edb43-f301-4702-a0e4-8dc526f941c8 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.176895 Aug 25 13:09:11.386455 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2168/4289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:10 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:11.406518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:11.410086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:11.442998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:11.447513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:11.450830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:11.452881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:11.464240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:11.465198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:12.323267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:12.350787 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7fc2ce3-1d1d-41bf-9600-0a699dc09edc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.961501 Aug 25 13:09:12.363097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2169/4290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:11 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:12.441902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:12.447361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:12.474225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:12.478502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:12.481027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:12.483019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:12.484353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:12.485492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:12.847314 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b95f7281-ed4e-4a23-9dae-5579ab0a3b4b tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/dffe083e-a052-4139-b9a7-64d83f6268bd" status: 202 len: 0 microversion: 2.1 time: 1.628058 Aug 25 13:09:12.851120 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2122/4291] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:09:11 2022] DELETE /compute/v2.1/os-security-groups/dffe083e-a052-4139-b9a7-64d83f6268bd => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:09:12.868929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ad3e1f3-08ba-455e-8c39-95f392c52806 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c11e3dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:13.200067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:13.238067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bec392d-fa09-4573-937d-610136c32191 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 0.806223 Aug 25 13:09:13.239651 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2170/4292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:12 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:13.430743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:13.435010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:13.525457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:13.530045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:13.532736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:13.539560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:13.549310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:13.550031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:14.549899 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ad3e1f3-08ba-455e-8c39-95f392c52806 tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/b0d6e6a2-7a41-49a2-a968-a01b7584252e" status: 202 len: 0 microversion: 2.1 time: 1.691910 Aug 25 13:09:14.552849 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2123/4293] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:09:12 2022] DELETE /compute/v2.1/os-security-groups/b0d6e6a2-7a41-49a2-a968-a01b7584252e => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:09:14.595569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:14.597238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:14.625766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:14.627671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:14.628170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:14.629520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:14.630994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:14.631814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:14.718701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:14.741998 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5139a6f-39df-4f20-9e61-bc9fde1f9706 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.325142 Aug 25 13:09:14.747871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2171/4294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:13 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:14.756449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2f9d2a1-4762-456c-bfa3-aa14c5b75a9a tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] Calling method '.version_select at 0x7fc6c189ac10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:15.455794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:15.483221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f4914b2-785a-427d-9fd2-6e0905f2ac0b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 0.927591 Aug 25 13:09:15.508449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2124/4295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:14 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:15.527955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e11534e-e7d6-4476-97ba-107c7b14e4ce", "tag": "91cec168-3e7d-4bf2-904e-34af7e0941ea"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:15.564261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:15.566661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:15.569696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:15.625813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] Creating event network-changed:91cec168-3e7d-4bf2-904e-34af7e0941ea for instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce on n-h1-850468-18 Aug 25 13:09:15.654682 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f719ece0-d5eb-471b-bb6d-037329680645 req-13994aa6-de1a-4df2-bb5d-75ee2f9bda1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143795 Aug 25 13:09:15.656966 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2125/4296] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:15.794254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:15.800694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:15.824234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:15.828585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:15.830029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:15.831917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:15.834782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:15.836441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:17.009553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:17.035188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-815526f9-833f-41f6-989c-e67975e0983d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.248859 Aug 25 13:09:17.056238 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2126/4297] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:15 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:17.073041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:17.074669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:17.079760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:17.093867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:17.095205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:17.096358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:17.098352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:17.101765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:17.102962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:17.200431 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2f9d2a1-4762-456c-bfa3-aa14c5b75a9a tempest-SecurityGroupRulesNegativeTestJSON-975963920 tempest-SecurityGroupRulesNegativeTestJSON-975963920-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/179faee0-0dc7-46bb-a2fe-fab06d705230" status: 202 len: 0 microversion: 2.1 time: 2.450402 Aug 25 13:09:17.202432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2172/4298] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:09:14 2022] DELETE /compute/v2.1/os-security-groups/179faee0-0dc7-46bb-a2fe-fab06d705230 => generated 0 bytes in 2454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:09:17.930485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:17.959318 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5625a747-4510-4d8f-b412-9dabeb34d7cd tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 0.900625 Aug 25 13:09:17.976652 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2127/4299] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:17 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:18.110706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:18.114531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:18.159535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.161265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.162435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.164549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:18.165839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:18.167002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:18.609155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:18.628206 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-903968b0-e526-4ef4-9d9d-35159b1d6298 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.552179 Aug 25 13:09:18.651032 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2173/4300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:18 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:19.013861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:19.018031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:19.033498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:19.038795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:19.040689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:19.042220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:19.043386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:19.044638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:19.555826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:19.576566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41fa58b1-9c91-43a9-8997-e2eff865a74a tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 0.577012 Aug 25 13:09:19.580174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2128/4301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:18 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:19.673973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:19.676379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:19.702073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:19.703485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:19.704763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:19.706760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:19.710047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:19.711684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:20.250840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:20.288510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bcafb52d-8043-4579-acad-6f39181753de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.622347 Aug 25 13:09:20.290456 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2174/4302] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:19 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:20.618378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:20.619569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:20.663428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:20.664387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:20.666138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:20.666505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:20.681449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:20.682703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:21.337296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:21.338444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:21.394499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:21.396227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:21.399960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:21.401560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:21.402972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:21.403307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:22.007939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:22.070649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc9a052a-6522-4bd9-82b7-d101c511452d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.460090 Aug 25 13:09:22.074322 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2129/4303] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:20 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:22.167221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:22.195193 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4298d038-7033-4d20-a6a2-3f198709fd36 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 0.865274 Aug 25 13:09:22.203588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2175/4304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:21 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:23.127497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:23.129303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:23.165407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:23.166476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:23.170480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:23.174764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:23.176932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:23.181738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:23.279987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:23.283628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:23.312523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:23.314653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:23.315820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:23.317958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:23.319982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:23.323130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:24.301130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:24.340144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5dd2e54e-ecb7-40fd-b880-480465f64035 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.219437 Aug 25 13:09:24.341425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2130/4305] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:23 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:24.376829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:24.406014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4b769aa8-3263-4462-9176-a57bf3139eeb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1505 microversion: 2.1 time: 1.160548 Aug 25 13:09:24.413643 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2176/4306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:23 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1505 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:25.393046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:25.402539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:25.448711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.462176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:25.463359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.466788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:25.467382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.469123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.476008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.477470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.499149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.500621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.503017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:25.505377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:25.515351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:25.517781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:27.862124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:27.904553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b8a3b2eb-5c4b-4dba-bede-fb53ea27d548 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1485 microversion: 2.1 time: 2.442852 Aug 25 13:09:27.906835 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2177/4307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:25 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1485 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:27.934516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702767f3-638b-4dcd-8f94-66973db66364", "name": "network-vif-plugged", "status": "completed", "tag": "2a71de3a-71b7-496a-8946-8d01138e69fd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:27.972883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:28.002830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:28.005286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:28.009118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:28.011527 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e5e4dc0d-257b-4077-98e9-7642421161f0 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 2.626579 Aug 25 13:09:28.013401 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2131/4308] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:25 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:28.066220 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] Creating event network-vif-plugged:2a71de3a-71b7-496a-8946-8d01138e69fd for instance 702767f3-638b-4dcd-8f94-66973db66364 on n-h1-850468-18 Aug 25 13:09:28.110883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7d485621-89fe-4ac1-82d5-ff85f502f30d req-2bd31b03-487e-417f-96be-5fcdc1a7c9b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201048 Aug 25 13:09:28.112009 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2178/4309] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:28.425325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-660546158", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:28.594183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] validate_networks() for [('76b627f4-8f62-442b-9068-cabc00464e78', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:09:29.072462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:29.077456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:29.135930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:29.142385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:29.149148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:29.160070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:29.162204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:29.165194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:30.108062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:30.138862 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f6a8524-fbc3-47d4-a208-b87ac4c93999 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1363 microversion: 2.1 time: 1.092023 Aug 25 13:09:30.156841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2179/4310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:29 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1363 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:31.192742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:31.194051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:31.241099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:31.259608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:31.262536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:31.264458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:31.266079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:31.268241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:31.308856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:09:31.310733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:09:31.312687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:09:31.313773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:09:31.316073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:09:31.356213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:31.365069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:31.366419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:31.369193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:31.370280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:31.373350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:31.413177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=84 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:31.439810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Getting quotas for project 96559c8b454640b78ab5d4f849eda356. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:31.477299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Getting quotas for user 2c746c6cfcfd4c539b42b138f5d79c6a and project 96559c8b454640b78ab5d4f849eda356. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:31.538083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:09:31.545196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:09:31.723534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c223adba-9496-41f3-b335-4ba2f5677e11 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.306954 Aug 25 13:09:31.725247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2132/4311] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:09:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:09:31.755805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47f4e1e7-3215-4072-b170-8e6c1a35a5bb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:31.764085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47f4e1e7-3215-4072-b170-8e6c1a35a5bb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:32.066732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47f4e1e7-3215-4072-b170-8e6c1a35a5bb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:32.118991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47f4e1e7-3215-4072-b170-8e6c1a35a5bb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1213 microversion: 2.1 time: 0.375031 Aug 25 13:09:32.138223 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2133/4312] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:31 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:32.191445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:32.224330 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0e93b08-4993-4ac0-830a-2b628cd4a77e tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1547 microversion: 2.1 time: 1.050469 Aug 25 13:09:32.241169 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2180/4313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:31 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1547 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:32.291375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:32.298195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:32.334346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:32.335355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:32.336156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:32.337475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:32.341182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:32.342044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:32.581660 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5dab2ad8-7340-41b9-b0d5-58b2d741f2fb tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299539 Aug 25 13:09:32.584407 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2134/4314] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:09:32 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-interface => generated 284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:33.181602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:33.183339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:33.207214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:33.223391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:33.225081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:33.228705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:33.230134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:33.232460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:33.687802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:33.713999 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1792da1-030a-40d2-9dd8-0ae4d5ce4030 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1217 microversion: 2.1 time: 0.552504 Aug 25 13:09:33.728698 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2181/4315] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:33 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1217 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:33.938936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1163072536", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "2111435d-63cc-4d9b-bfe6-24da7f7e65cf"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:34.127121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] validate_networks() for [('2111435d-63cc-4d9b-bfe6-24da7f7e65cf', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:09:34.763023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:34.776967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:34.812759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:34.819452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:34.822479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:34.825740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:34.827319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:34.828950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:34.835783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=92 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:35.155399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:35.177518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c68eaea6-1099-4be2-8c28-11969df709de tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1283 microversion: 2.1 time: 0.423738 Aug 25 13:09:35.181438 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2182/4316] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:34 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1283 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:36.219280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:36.232735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:36.248969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:36.250588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:36.251907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:36.253741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:36.256024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:36.257797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:36.664517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:36.723765 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4f19fbc-1d58-4847-8cb5-18a337055d81 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1271 microversion: 2.1 time: 0.510388 Aug 25 13:09:36.762043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2183/4317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:36 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1271 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:37.071012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:09:37.071926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:09:37.073276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:09:37.074419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:09:37.076665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:09:37.119504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:37.122588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:37.125093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:37.132490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:37.135240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:37.136152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:37.200070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Getting quotas for project 77679f946ab94e51aa2eefa59e4092d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:37.228088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Getting quotas for user 9cb8cff24e584f9e8d080ef8ee3590be and project 77679f946ab94e51aa2eefa59e4092d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:37.277298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:09:37.286482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:09:37.532836 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f2445737-94f1-4b91-8fdc-45980071e50d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.296628 Aug 25 13:09:37.542127 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2135/4318] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:09:37.563688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:37.564941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:37.637203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702767f3-638b-4dcd-8f94-66973db66364", "tag": "2a71de3a-71b7-496a-8946-8d01138e69fd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:37.698509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:37.699555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:37.700354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:37.807610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] Creating event network-changed:2a71de3a-71b7-496a-8946-8d01138e69fd for instance 702767f3-638b-4dcd-8f94-66973db66364 on n-h1-850468-18 Aug 25 13:09:37.834393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4c29d50d-8749-43dc-8634-6928d9673d19 req-f2087bb4-993b-4663-9377-ab18caae6df2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218051 Aug 25 13:09:37.839971 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2136/4319] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:09:37.866886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:37.885424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:37.923871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:37.929741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:37.931098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:37.934503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:37.937848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:37.939203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:37.940404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:38.014959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:38.026636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:38.042586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4c1c9ea-e41e-4a46-a775-2ab2a6b22fa6 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1262 microversion: 2.26 time: 0.487384 Aug 25 13:09:38.046073 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2184/4320] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:37 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1262 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:38.259443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:38.343738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37174f7d-517f-458e-8d10-6410e45875b6 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1271 microversion: 2.1 time: 0.500892 Aug 25 13:09:38.362687 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2137/4321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:37 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1271 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:39.096431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:39.097272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:39.139345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=36 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:39.393920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:39.395918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:39.431394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:39.434906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:39.441672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:39.443058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:39.449123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:39.450205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:39.469797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:39.517180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:39.540034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:39.549232 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4fffa4da-a428-4913-a0de-4d721b8f46c2 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1262 microversion: 2.26 time: 0.459950 Aug 25 13:09:39.554583 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2185/4322] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:39 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1262 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:40.451805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:40.474978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-337dd42e-c519-4fc8-880d-f243f6612f06 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 1.087662 Aug 25 13:09:40.480780 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2138/4323] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:39 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:40.612474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:40.617248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:40.651256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:40.658819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:40.661921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:40.664424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:40.665730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:40.673752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:40.885092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:40.917664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:40.921110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:40.923420 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67550943-0a76-4ece-973a-928173447f9d tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1314 microversion: 2.26 time: 0.322648 Aug 25 13:09:40.929183 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2186/4324] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:40 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:41.547488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:41.550002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:41.568909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:41.569933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:41.571048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:41.578669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:41.580894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:41.582345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:41.975957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:41.978511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:41.990459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:41.993546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:41.995020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:41.996530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:41.998761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:42.000095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:42.001357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:42.015074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-878f6bc2-17ca-4346-8986-2dde75157240 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 0.489992 Aug 25 13:09:42.027310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2139/4325] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:41 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:42.213972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:42.247095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:42.258319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:42.261683 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8126e4ee-41dd-46e2-8b4f-41579cad2a91 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1320 microversion: 2.26 time: 0.292605 Aug 25 13:09:42.285784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2187/4326] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:41 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:43.069647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:43.073842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:43.106116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:43.108625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:43.111182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:43.114806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:43.117011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:43.118742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:43.278190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef453fb2-636d-467f-8a8f-1f256419de2e", "tag": "89da8f10-2387-4673-bf1d-1f549647532c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:43.337481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:43.355654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:43.356536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:43.407443 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] Creating event network-changed:89da8f10-2387-4673-bf1d-1f549647532c for instance ef453fb2-636d-467f-8a8f-1f256419de2e on n-h1-850468-18 Aug 25 13:09:43.438582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e60ee00c-d9aa-4b30-b389-c56886409eaf req-843fce24-5cfc-442b-aefa-f8e2a6e7846e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167682 Aug 25 13:09:43.446160 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2188/4327] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:43.475291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:43.485921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:43.500002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:43.501129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:43.507782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:43.509497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:43.511652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:43.512625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:43.907320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:43.931346 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d7dcde6-4e41-483f-9b96-e04eebdb1305 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 0.880618 Aug 25 13:09:43.947987 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2140/4328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:43 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:44.507161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:44.527705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:44.532753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:44.536984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d19ebb8-5e32-48b3-8d36-1e81f9f67797 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 1.087679 Aug 25 13:09:44.539771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2189/4329] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:43 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:44.985893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:44.987211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:45.023925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.025345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.026453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.028093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.029334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.030403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.592853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:45.595276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:45.611280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.615213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.616577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.618819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:45.620141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:45.621345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:45.747273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:45.772139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a258623d-832c-40bb-ac60-66be528c7506 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 0.794123 Aug 25 13:09:45.775165 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2141/4330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:44 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:46.338468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:46.371338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:46.377948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:46.381151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70f2ebd2-c04b-4128-8f06-9f71f0245858 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 0.801687 Aug 25 13:09:46.392730 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2190/4331] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:45 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:09:46.824079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:46.825482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:46.848087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:46.849883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:46.851273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:46.854230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:46.855407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:46.856493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:47.163443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:47.246288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:47.428971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:47.432204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:47.466998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:47.468409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:47.472598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:47.476653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:47.478783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:47.485541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.477288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:48.498035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bdbe1af4-34cc-4c07-914e-4b5454f866be tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 1.686716 Aug 25 13:09:48.501115 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2142/4332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:46 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:48.515040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e585848-f802-47f1-aa11-67161dd10790", "tag": "06ca1e12-c7d4-43aa-a25c-f4c56023fdb1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:48.546596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:48.566556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:48.568386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:48.569204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:48.597639 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] Creating event network-changed:06ca1e12-c7d4-43aa-a25c-f4c56023fdb1 for instance 1e585848-f802-47f1-aa11-67161dd10790 on n-h1-850468-18 Aug 25 13:09:48.610523 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3b74db0e-2b60-4a68-8ca2-1ff076399aa6 req-030e3bf1-b6e6-4a6b-addd-1db5b773733f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105193 Aug 25 13:09:48.614411 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2143/4333] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:48.639953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:48.663503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:48.666915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:48.671855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72700ea3-5649-421e-adc3-7ee2100d7d63 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 1.251855 Aug 25 13:09:48.674325 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2191/4334] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:47 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:49.548000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:49.572971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:49.601434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.603215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.604602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.607136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.610338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.612728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.721217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:49.723843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:49.740681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:09:49.746111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.747559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.748838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:49.750600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:49.752970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:49.755154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:50.755176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:50.769519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:50.794208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:50.806013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:50.810545 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a1511ddd-606a-4491-9bf7-6f425e26b23b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 1.268085 Aug 25 13:09:50.810850 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5690284-c0df-41f2-b8dc-1d1be57c4400 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 1.098442 Aug 25 13:09:50.812573 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2144/4335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:49 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:50.820534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2192/4336] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:49 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:51.867908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:51.869137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:51.873720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:51.875791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:51.910557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.913928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.914861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.917520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.919376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.924045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.925183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.925581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.926059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:51.928377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:51.929320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:51.930099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:52.515931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:52.569071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:52.573218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:52.577140 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-adb261e3-e846-493a-944d-08825c059155 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 0.715297 Aug 25 13:09:52.579488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2193/4337] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:51 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:09:52.679951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:52.711173 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8c6de1e-f515-4fcc-807e-4ab47d9c1ecc tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 0.856665 Aug 25 13:09:52.731135 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2145/4338] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:51 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:53.606287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef453fb2-636d-467f-8a8f-1f256419de2e", "name": "network-vif-plugged", "status": "completed", "tag": "89da8f10-2387-4673-bf1d-1f549647532c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:53.632813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:53.634555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:53.662515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:53.663397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:53.665856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:53.673255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:53.674981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:53.677817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:53.684573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:53.685993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:53.688813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:53.712838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] Creating event network-vif-plugged:89da8f10-2387-4673-bf1d-1f549647532c for instance ef453fb2-636d-467f-8a8f-1f256419de2e on n-h1-850468-18 Aug 25 13:09:53.748494 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b69569c6-5a84-4720-9a19-c9bcf12fc08d req-00861be3-7c06-4df8-b3b0-5f1d599e637f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151550 Aug 25 13:09:53.751430 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2194/4339] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:09:53.767527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:53.788020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:53.833125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:53.834459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:53.835832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:53.838568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:53.839989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:53.845939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:54.832942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.862398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.864501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.865816 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fef89bbf-4e7d-42e3-836b-d15eb445ba5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 1.240872 Aug 25 13:09:54.871439 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2146/4340] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:53 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:54.943132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:54.971611 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-142c8d36-1221-4f25-8e7e-7882ab4c839c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 1.215416 Aug 25 13:09:54.976652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2195/4341] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:53 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:55.924834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:55.930053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:55.947918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.951015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.952557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:55.954322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:55.955192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:55.957034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:56.014387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53a57f09-41c5-448a-9056-9f9030dfe57c tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Action: 'create', calling method: .version_select at 0x7fc6c13354c0>, body: {"keypair": {"name": "tempest-keypair-1648735347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmvNQ6uY9dJ/jqiZpmNvEALKY3BcanMKgpiWlX9viXbIJAmQT/rioJtd2AWS/CmSYaJu00tM9QZe7UdkAYUyr59oXTMlIHFBZI15hYObKd+xfNhB1LQFznwvqYAt/MLtA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:56.075490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53a57f09-41c5-448a-9056-9f9030dfe57c tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for project d6cbe746ff684406b96f4f93b5ff425b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:09:56.088655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53a57f09-41c5-448a-9056-9f9030dfe57c tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for user 2d73b9062c10487abbf224443bb8f8ee and project d6cbe746ff684406b96f4f93b5ff425b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:09:56.202765 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53a57f09-41c5-448a-9056-9f9030dfe57c tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.522801 Aug 25 13:09:56.204983 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2147/4342] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:09:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:09:56.229690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:56.230963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:56.247463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:56.249798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:56.251167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:56.252647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:56.253592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:56.255552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:56.376162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:56.393066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:56.397475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:56.420369 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6770ae49-b3d5-41e1-9b17-5c49d4f8638c tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 0.489046 Aug 25 13:09:56.423153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2196/4343] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:55 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:09:56.686957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:56.714463 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-707283fc-08e6-4640-a95b-2314075b64cb tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1313 microversion: 2.1 time: 0.504130 Aug 25 13:09:56.715568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2148/4344] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:56 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:09:57.487615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:57.489601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:57.524720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.526155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.526715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.528727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.530059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.531170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.750494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:57.752239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:57.774066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.775149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.776165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:57.777110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:57.778205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:57.779142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.215721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.234504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.240103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.243285 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5a1c905-40a6-4574-8f39-9ddd0a290cb7 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 0.775380 Aug 25 13:09:58.245601 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2197/4345] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:57 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:09:58.453517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:09:58.489532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed61271f-f485-4245-b280-eb9f1f1d7ad2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1500 microversion: 2.1 time: 0.741499 Aug 25 13:09:58.495291 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2149/4346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:57 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1500 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:09:58.549398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:09:58.560232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:58.586280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.587901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.589690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.591557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:58.593137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:58.596413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:58.709346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lazy-loading 'flavor' on Instance uuid ef453fb2-636d-467f-8a8f-1f256419de2e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:09:59.023391 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0af7a5c8-f763-49ed-9e9c-8f2140cb7c2c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "POST /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e/action" status: 200 len: 32 microversion: 2.1 time: 0.495082 Aug 25 13:09:59.028447 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2198/4347] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:09:58 2022] POST /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:09:59.047662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:59.048666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:59.091770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.095163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.111299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.115477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.116334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.117075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.298849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:09:59.300956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:09:59.315834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.317357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.318715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.320453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:09:59.321763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:09:59.322772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:09:59.988680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.028310 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-711fb2ef-7e2e-49fe-807e-d7650f54b90a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.989899 Aug 25 13:10:00.029434 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2150/4348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:09:59 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:00.046085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e585848-f802-47f1-aa11-67161dd10790", "name": "network-vif-plugged", "status": "completed", "tag": "06ca1e12-c7d4-43aa-a25c-f4c56023fdb1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:00.084840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:00.101509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:00.102715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:00.146494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] Creating event network-vif-plugged:06ca1e12-c7d4-43aa-a25c-f4c56023fdb1 for instance 1e585848-f802-47f1-aa11-67161dd10790 on n-h1-850468-18 Aug 25 13:10:00.169252 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a0ceda37-c8e4-400e-8748-9f50d0161f6b req-938b8fdd-7218-4bac-afb3-c7c1e61e1715 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137522 Aug 25 13:10:00.174555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2151/4349] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:00.286162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.331322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.344677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:00.351861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-855f9a29-1046-4cfa-aade-b9523f807c17 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 1.063296 Aug 25 13:10:00.354025 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2199/4350] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:09:59 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:01.077995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:01.080376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:01.102318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:01.104597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:01.108339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:01.129035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:01.137220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:01.139252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:01.407631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:01.409117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:01.461442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:01.466334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:01.467309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:01.471795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:01.481197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:01.482562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:01.494848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:01.826635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:01.840062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=90 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:01.859753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b7d6090-a157-43a9-91cc-8472b93706c5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.792621 Aug 25 13:10:01.861958 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2152/4351] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:01 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:01.878540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1810536045", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d3a26605-c65d-4a2c-968f-e70b355f30be"}], "security_groups": [{"name": "tempest-securitygroup--229387261"}], "key_name": "tempest-keypair-1648735347", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:01.995970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:02.022432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:02.025732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:02.028255 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-572867d0-d35c-4e60-9733-2c09d9fc75e1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1362 microversion: 2.26 time: 0.631399 Aug 25 13:10:02.030874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2200/4352] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:01 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:02.402007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] validate_networks() for [('d3a26605-c65d-4a2c-968f-e70b355f30be', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:10:02.906387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:02.907559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:02.921537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:02.933424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:02.934026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:02.935245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:02.935791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:02.936246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:03.992180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:04.028454 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f5996a2-6e1b-4b7c-ba66-d8d8cda2c787 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 1.128732 Aug 25 13:10:04.034764 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2201/4353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:02 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:04.046617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:04.048216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:04.076086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.077171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.078480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.079865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.097809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.099299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.679779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:04.697419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:04.700744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:04.717535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df8291cf-0ae7-475d-a624-127a14c1e9dd tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1547 microversion: 2.26 time: 0.666317 Aug 25 13:10:04.718742 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2202/4354] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:04 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1547 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:04.765955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c188a040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:04.790360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.791738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.792596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.793494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:04.808078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.809188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.811275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.813414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.814781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.815935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.859333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.860254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.860924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.898460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.899315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.900224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.903969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for project d6cbe746ff684406b96f4f93b5ff425b. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:04.921078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for user 2d73b9062c10487abbf224443bb8f8ee and project d6cbe746ff684406b96f4f93b5ff425b. Resources: dict_keys(['metadata_items']) {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:04.957861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:04.959184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:04.960456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:04.961518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:04.962544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:04.965947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:04.983083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.983922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.984571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.985777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:04.986808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:04.987462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:04.997120 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c98e24dd-a6df-4752-9c68-8d98124b5194 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-654910073" status: 201 len: 0 microversion: 2.26 time: 0.238643 Aug 25 13:10:04.999902 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2203/4355] 10.222.0.60 () {62 vars in 1377 bytes} [Thu Aug 25 13:10:04 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-654910073 => generated 0 bytes in 243 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 25 13:10:05.018144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5aa74905-8c6c-4c61-a44d-ef664f274ba1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c188af70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.022672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for project d6cbe746ff684406b96f4f93b5ff425b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:05.033244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Getting quotas for user 2d73b9062c10487abbf224443bb8f8ee and project d6cbe746ff684406b96f4f93b5ff425b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:05.033589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aa74905-8c6c-4c61-a44d-ef664f274ba1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.034453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aa74905-8c6c-4c61-a44d-ef664f274ba1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.036098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aa74905-8c6c-4c61-a44d-ef664f274ba1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.060782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5aa74905-8c6c-4c61-a44d-ef664f274ba1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-654910073" status: 204 len: 0 microversion: 2.26 time: 0.047769 Aug 25 13:10:05.061164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:10:05.061363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2204/4356] 10.222.0.60 () {60 vars in 1358 bytes} [Thu Aug 25 13:10:05 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-654910073 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:05.063911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:10:05.074809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c1a2a8b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.090387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.091277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.092079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.092986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:05.105693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.106541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.107437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.108820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.109559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.110431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.145181 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ebffe4f-a4eb-400a-ba92-d306caeb56f0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.277567 Aug 25 13:10:05.157641 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2153/4357] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:10:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:10:05.162437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.163116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.163887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.173552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.175466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:05.193699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.195210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.196256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.198074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.199922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.201337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.211712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:05.250028 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bea859c-5b6c-4562-ae68-c9b0b83454b5 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 204 len: 0 microversion: 2.26 time: 0.182652 Aug 25 13:10:05.251569 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2205/4358] 10.222.0.60 () {60 vars in 1295 bytes} [Thu Aug 25 13:10:05 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:05.277480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8e7ebbe-a50b-43d0-a362-2dd237128a92 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.279359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8e7ebbe-a50b-43d0-a362-2dd237128a92 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:05.427610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8e7ebbe-a50b-43d0-a362-2dd237128a92 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:05.474540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8e7ebbe-a50b-43d0-a362-2dd237128a92 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1278 microversion: 2.1 time: 0.220004 Aug 25 13:10:05.495859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2206/4359] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:05 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:05.519130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a911aaea-3a51-402b-9a6f-790383da24fe tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c18b7310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.562997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a911aaea-3a51-402b-9a6f-790383da24fe tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.563907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a911aaea-3a51-402b-9a6f-790383da24fe tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.564785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a911aaea-3a51-402b-9a6f-790383da24fe tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.586104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:05.603951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b367aa9-7dca-4b96-992a-e793d46d1893 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.446560 Aug 25 13:10:05.607163 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2154/4360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:05 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:05.607900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a911aaea-3a51-402b-9a6f-790383da24fe tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 12 microversion: 2.26 time: 0.119703 Aug 25 13:10:05.609642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2207/4361] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 13:10:05 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 12 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:05.635488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c188ab80>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.657035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.658423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.659143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.660035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:05.672180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.673069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.673843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.675135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.676569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.677946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.732994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.733876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.734573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.756094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.757015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.757756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.830547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:05.876449 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7eb39ac4-925a-4ba0-a0d9-ccc629c3dc8b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-840404535" status: 201 len: 0 microversion: 2.26 time: 0.251846 Aug 25 13:10:05.886699 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2208/4362] 10.222.0.60 () {62 vars in 1377 bytes} [Thu Aug 25 13:10:05 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-840404535 => generated 0 bytes in 264 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 25 13:10:05.902298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9349da97-d74c-4001-9b66-a943a7c1b737 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c11e3310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:05.925861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9349da97-d74c-4001-9b66-a943a7c1b737 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:05.930632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9349da97-d74c-4001-9b66-a943a7c1b737 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:05.931881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9349da97-d74c-4001-9b66-a943a7c1b737 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:05.966019 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9349da97-d74c-4001-9b66-a943a7c1b737 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 35 microversion: 2.26 time: 0.077492 Aug 25 13:10:05.967167 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2155/4363] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 13:10:05 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 35 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:05.990046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c1895d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.011153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.013639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.014877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.015894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.026866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.027491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.028079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.029275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.030036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.030813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.067480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.068596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.069319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.112059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:06.160848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-797d8ec7-1ea0-4f77-b954-19de57133c14 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-840404535" status: 204 len: 0 microversion: 2.26 time: 0.179925 Aug 25 13:10:06.162144 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2209/4364] 10.222.0.60 () {60 vars in 1361 bytes} [Thu Aug 25 13:10:05 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-840404535 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:06.177836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a216b6b3-7b27-4d39-ba19-ae1dbbb62603 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c27b5310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.201991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a216b6b3-7b27-4d39-ba19-ae1dbbb62603 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.203117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a216b6b3-7b27-4d39-ba19-ae1dbbb62603 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.203764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a216b6b3-7b27-4d39-ba19-ae1dbbb62603 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.220083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a216b6b3-7b27-4d39-ba19-ae1dbbb62603 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 12 microversion: 2.26 time: 0.050742 Aug 25 13:10:06.220880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2156/4365] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 13:10:06 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:06.246237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c18e8dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.271740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.272866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.274006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.275285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.291015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.291933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.294129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.294729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.295605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.296427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.351785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.353246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.354064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.376482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:06.409671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9cbfffbb-7952-4906-81ea-b90a9b079376 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 204 len: 0 microversion: 2.26 time: 0.173265 Aug 25 13:10:06.414188 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2210/4366] 10.222.0.60 () {60 vars in 1295 bytes} [Thu Aug 25 13:10:06 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:06.429150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c11e35e0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.464410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.464410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.464859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.465942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.479839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.480602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.481157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.482408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.483029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.483574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.535527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.537618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.544596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.545500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.554478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.570088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.570773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.571016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.571573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.572030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.572351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.573439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.574258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.574989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.628158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:06.665887 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53931233-3e74-4881-ad21-3cdb979b2cb3 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-181578044" status: 201 len: 0 microversion: 2.26 time: 0.241754 Aug 25 13:10:06.668276 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2157/4367] 10.222.0.60 () {62 vars in 1377 bytes} [Thu Aug 25 13:10:06 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-181578044 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 25 13:10:06.679605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.681264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.706528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.709841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.710980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.712377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.713296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.714073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.724899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:06.743450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f49a49e7-1d82-496c-a54d-2995413daac4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1274 microversion: 2.1 time: 0.217793 Aug 25 13:10:06.744934 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2211/4368] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:06 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:06.755205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c1885ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:06.786925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.787918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.788737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.789579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:06.805271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.806128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.806857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.808080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.808874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.809845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.874759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.875545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.876284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.891282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:06.898401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:06.899221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:06.899972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:06.956869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:06.993343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62ee3dfa-ccd4-458c-bab1-62a6926ddd5a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-2009923061" status: 201 len: 0 microversion: 2.26 time: 0.246183 Aug 25 13:10:07.002084 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2212/4369] 10.222.0.60 () {62 vars in 1380 bytes} [Thu Aug 25 13:10:06 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-2009923061 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:10:07.013126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c1aa0ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.032450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.033396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.034209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.035619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.038327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:07.047376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.048271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.049042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.050565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.052507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.053131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.055494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-107d7707-1714-4ea1-939d-b4007c6c8f0c tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.385027 Aug 25 13:10:07.056664 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2158/4370] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:06 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:07.098915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.099765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.100589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.131933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:07.165364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ead56d21-b3cc-4c2f-a876-032355eacb76 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 204 len: 0 microversion: 2.26 time: 0.160692 Aug 25 13:10:07.167167 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2213/4371] 10.222.0.60 () {60 vars in 1295 bytes} [Thu Aug 25 13:10:07 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:07.182290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c809a480-3e6e-4753-b21d-734ca6fd4e53 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c11ca5e0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.199232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c809a480-3e6e-4753-b21d-734ca6fd4e53 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.200183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c809a480-3e6e-4753-b21d-734ca6fd4e53 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.200999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c809a480-3e6e-4753-b21d-734ca6fd4e53 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.221663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c809a480-3e6e-4753-b21d-734ca6fd4e53 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 12 microversion: 2.26 time: 0.047243 Aug 25 13:10:07.224293 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2159/4372] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 13:10:07 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:07.243948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c1a89d30>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.263503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.264567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.265667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.266654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.280020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.281253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.282376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.283967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.285054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.286830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.331589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.333110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.334382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.370488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:07.403158 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf4db423-d7d4-4bfb-ac0e-71bf58af8513 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 204 len: 0 microversion: 2.26 time: 0.168067 Aug 25 13:10:07.404219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2214/4373] 10.222.0.60 () {60 vars in 1295 bytes} [Thu Aug 25 13:10:07 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:07.422200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c6a9b430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.446629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.447967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.449020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.450025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.464498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.466631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.467868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.470404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.471335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.472158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.534677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.538224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.539952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.571129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.572370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.573359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.628173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:07.659102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c780d4f1-2430-49f9-966f-e787dd50df61 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-888848813" status: 201 len: 0 microversion: 2.26 time: 0.245889 Aug 25 13:10:07.661444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2160/4374] 10.222.0.60 () {62 vars in 1377 bytes} [Thu Aug 25 13:10:07 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-888848813 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 25 13:10:07.675961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c18859d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.698910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.700008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.702115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.704051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.716881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.717788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.718615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.719977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.721842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.721842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.780574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.782478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.782478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.791251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:07.794338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.801966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.802651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.803460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.817488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.818769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.819867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.821301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.822249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.823142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.866851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:07.912263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1a50479-ad24-4962-a0a1-2416b24b5e3a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-1867501009" status: 201 len: 0 microversion: 2.26 time: 0.243275 Aug 25 13:10:07.913497 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2215/4375] 10.222.0.60 () {62 vars in 1380 bytes} [Thu Aug 25 13:10:07 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags/tempest-tag-1867501009 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 25 13:10:07.937056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Action: 'update_all', calling method: .version_select at 0x7fc6c18ae160>, body: {"tags": ["tempest-tag-1487347775", "tempest-tag-1097880521"]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:07.962380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.963312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.964536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.965074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:07.978251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:07.983721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:07.992066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:07.992923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:07.994558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.000729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.001893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.008978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6f9d9e9-ad13-4c98-bb7d-bebd1e55aad8 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1336 microversion: 2.1 time: 0.229229 Aug 25 13:10:08.020738 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2161/4376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:07 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1336 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:08.057610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.058462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.059251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.100767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.106778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.108975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:08.124943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.126111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.128013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.130621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.133004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.134344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.154350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-683125ad-f8f9-4229-b978-3c58486f35cb tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 62 microversion: 2.26 time: 0.231041 Aug 25 13:10:08.155728 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2216/4377] 10.222.0.60 () {62 vars in 1312 bytes} [Thu Aug 25 13:10:07 2022] PUT /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 62 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:08.177575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-88707bc5-4961-4f28-8fda-282bb1c6c187 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c6b4a430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.200689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88707bc5-4961-4f28-8fda-282bb1c6c187 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.201710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88707bc5-4961-4f28-8fda-282bb1c6c187 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.202748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88707bc5-4961-4f28-8fda-282bb1c6c187 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.237772 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-88707bc5-4961-4f28-8fda-282bb1c6c187 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 200 len: 62 microversion: 2.26 time: 0.069131 Aug 25 13:10:08.239622 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2217/4378] 10.222.0.60 () {60 vars in 1292 bytes} [Thu Aug 25 13:10:08 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 62 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:08.259335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '.version_select at 0x7fc6c18c6820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.279914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.281285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.282636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.283857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.303136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.304088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.304993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.306352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.307223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.308031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.360768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.361723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.362726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.398598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'flavor' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:08.437411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd1c29b5-0e60-4cbd-964a-9ba84682690b tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags" status: 204 len: 0 microversion: 2.26 time: 0.186938 Aug 25 13:10:08.438624 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2218/4379] 10.222.0.60 () {60 vars in 1295 bytes} [Thu Aug 25 13:10:08 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:10:08.456589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.459366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.471784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.473720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.474543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.475893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.477461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.477862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.544374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:10:08.689261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:08.715366 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-05a7e889-f7a6-4e92-a7ac-75682a8127ec tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.623011 Aug 25 13:10:08.730202 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2162/4380] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:08 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:08.730578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:08.747219 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b6b7ed15-75f4-4b6e-8197-29118a649289 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 204 len: 0 microversion: 2.26 time: 0.298327 Aug 25 13:10:08.748319 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2219/4381] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:10:08 2022] DELETE /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:10:08.763925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:08.765390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:08.781773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.783397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.784481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:08.787378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:08.788318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:08.789125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.050281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:09.053540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:09.074864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.079158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.081862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.084570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.086283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.087111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.244904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.255998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.262031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.267202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:09.270069 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6cd4d4e-bd88-4ecc-bcf7-01d2522462d9 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1553 microversion: 2.26 time: 0.513790 Aug 25 13:10:09.288201 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2163/4382] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:08 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1553 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:09.288497 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-083aa1b5-57b3-4f57-a042-ea9c642c596a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1336 microversion: 2.1 time: 0.251690 Aug 25 13:10:09.289437 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2220/4383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:09 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1336 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:09.764575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:09.766259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:09.778355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.779757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.780687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:09.782036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:09.782910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:09.783706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.178369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.196726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-05a908c1-0338-4eeb-be76-1a9c3ff4bd85 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.443486 Aug 25 13:10:10.197867 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2164/4384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:09 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:10.319146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.320340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.328575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:10.330003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:10.334134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.334896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.335672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.337033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.337810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.338532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.343252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.344811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.345600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.346975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:10.348341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:10.349662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:10.947459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.966861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.969402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.971975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c52b62c-7b62-43c6-a602-876911cdb72a tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1553 microversion: 2.26 time: 0.662021 Aug 25 13:10:10.972737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:10.975437 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2221/4385] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1553 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:11.015241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f8fa677-7562-4e54-a5b0-e19f0cfa0d67 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.695200 Aug 25 13:10:11.016400 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2165/4386] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:10 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:11.237785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:11.241187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:11.266531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:11.267376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:11.268200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:11.269599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:11.273346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:11.274660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:11.355115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=4,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:11.897651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:11.921597 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3fffcab-f543-41f5-8432-0e7d26f8e799 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.691149 Aug 25 13:10:11.922718 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2222/4387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:11 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:12.041734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:12.052463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:12.062191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:12.067591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:12.099861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.115268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.116860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.118716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.120187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.121430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.129194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.130250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.130930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.138736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.142295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.144551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.602260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:12.618333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:12.621629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:12.623777 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c159f42b-8751-4dbd-99b7-f843f2d04390 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1511 microversion: 2.26 time: 0.592168 Aug 25 13:10:12.624954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2166/4388] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:12 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:12.808753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:12.830114 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef4ff8fa-6034-4ee8-946a-1c23f8400f65 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.779044 Aug 25 13:10:12.831720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2223/4389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:12 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:12.842094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d88aed8-bb9c-45ee-9049-d1f322d5d839", "tag": "a551e200-5a33-4f4d-8c71-ad3cbfefaf20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:12.864476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.866153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.867883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.897183 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] Creating event network-changed:a551e200-5a33-4f4d-8c71-ad3cbfefaf20 for instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 on n-h1-850468-18 Aug 25 13:10:12.914572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-763114bc-dafe-4df5-ba0a-6c8a48e2937d req-051b3d03-e0f1-4ef1-893e-75a97a87ae70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079663 Aug 25 13:10:12.917567 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2224/4390] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:12.966019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:12.968267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:12.989158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.990582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.991522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:12.994156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:12.995098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:12.998179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.021384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e585848-f802-47f1-aa11-67161dd10790", "name": "network-vif-deleted", "tag": "06ca1e12-c7d4-43aa-a25c-f4c56023fdb1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:13.046276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.047368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.048924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.089931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] Creating event network-vif-deleted:06ca1e12-c7d4-43aa-a25c-f4c56023fdb1 for instance 1e585848-f802-47f1-aa11-67161dd10790 on n-h1-850468-18 Aug 25 13:10:13.103866 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-92c3af61-6bc5-4842-92dc-7b6242559a72 req-df44a51f-1d5a-4797-b422-7defcfcf8232 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465846 Aug 25 13:10:13.106114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2167/4391] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:13.426417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:13.454005 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c0ac79cf-7d7e-4285-bf10-6ea39a35c5e9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.501902 Aug 25 13:10:13.455725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2225/4392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:12 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:13.665020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:13.667249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:13.681456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.682603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.683553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.685093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.686232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.687324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.742910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:13.781443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.782492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.783413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.784342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lazy-loading 'fault' on Instance uuid 1e585848-f802-47f1-aa11-67161dd10790 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:13.875338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:13.876604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:13.889249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.890165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.890993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.892401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:13.893269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:13.894090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:13.998707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.014980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.018238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cb8cff24e584f9e8d080ef8ee3590be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77679f946ab94e51aa2eefa59e4092d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.021403 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f9ea8ac-bdab-465d-b904-7f6b5dfe69d1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 200 len: 1352 microversion: 2.26 time: 0.365031 Aug 25 13:10:14.023014 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2168/4393] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:13 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 1352 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:14.393218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.421053 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ae1ac7e-903e-41ea-bc81-a0ca704ab7a4 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.552793 Aug 25 13:10:14.422681 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2226/4394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:13 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:14.494973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:14.496290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:14.511505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:14.511984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:14.512812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:14.513962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:14.514584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:14.515252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:14.884578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:14.903616 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2c44c68-01de-4c03-b449-41dd345c83ca tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.417418 Aug 25 13:10:14.916527 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2169/4395] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:14 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:15.067766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:15.069998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] [instance: 1e585848-f802-47f1-aa11-67161dd10790] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:15.082026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.083440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.084708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.086499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.087431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.088607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.117058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] HTTP exception thrown: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Request method failure captured: Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 HTTP/1.1 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3SMdLXJq09Paohfy2XJoIDp63jBDXLWycpAdsz8yyAXf1oqHRQwI1BlrgdbGIPs-46McpUZnCnBuj7fP8XesQMRy9nrGa8JGX3gJ6HrhfFrCou_aQRrTenarRheG9rsy8VbEDPSjkaMPx5vm0ffYASzKJmBLv9EFUikrP10JzJ-A6o Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.26 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 77679f946ab94e51aa2eefa59e4092d5 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerTagsTestJSON-2039487261 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_77679f946ab94e51aa2eefa59e4092d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/77679f946ab94e51aa2eefa59e4092d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77679f946ab94e51aa2eefa59e4092d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/77679f946ab94e51aa2eefa59e4092d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerTagsTestJSON-2039487261 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 77679f946ab94e51aa2eefa59e4092d5 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerTagsTestJSON-2039487261 Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerTagsTestJSON-2039487261-project Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9cb8cff24e584f9e8d080ef8ee3590be Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerTagsTestJSON-2039487261-project Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '1e585848-f802-47f1-aa11-67161dd10790'} Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:15.120840 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. Aug 25 13:10:15.129789 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:10:15.132863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] Returning 404 to user: Instance 1e585848-f802-47f1-aa11-67161dd10790 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:10:15.134946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5757692d-53c0-443c-a67c-7f2db4207cc1 tempest-ServerTagsTestJSON-2039487261 tempest-ServerTagsTestJSON-2039487261-project] 10.222.0.60 "GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790" status: 404 len: 111 microversion: 2.26 time: 0.075128 Aug 25 13:10:15.136027 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2227/4396] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:15 2022] GET /compute/v2.1/servers/1e585848-f802-47f1-aa11-67161dd10790 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:10:15.478681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:15.480047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:15.484278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:15.485649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:15.499992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.501054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.501993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.503885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:15.506171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:15.507327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:15.954329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:15.960320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:15.972396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:16.018885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.022215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.026619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:16.033575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:16.038616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:16.040226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:16.043439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:16.075140 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8607e90d-386c-4599-a759-305dcf7dd403 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.603961 Aug 25 13:10:16.079383 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2170/4397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:15 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:17.149314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:17.152379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:17.164069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:17.203554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a2ba5c6-707a-4550-95d3-6502fa6bdc5a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 1.259674 Aug 25 13:10:17.207778 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2228/4398] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:15 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:17.214060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.215269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.217808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.220869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:17.222562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:17.224734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:17.927648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:17.980888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f33a5136-f000-4be9-9c64-b63c8a16f74f tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.869069 Aug 25 13:10:17.981966 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2171/4399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:17 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:18.253723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:18.256597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:18.281759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:18.283137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:18.284277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:18.287916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:18.289322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:18.290869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:18.837477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:18.870394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d025619-949b-4c5b-acd2-662795505cc5 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.626482 Aug 25 13:10:18.874360 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2229/4400] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:18 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:19.028787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:19.030722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:19.047726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:19.051995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.054706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.056181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:19.058080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.059380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.061082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:19.931599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:19.938307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:19.970540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.971868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.973474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:19.975602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:19.977602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:19.978993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:20.048805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.094417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6cb2d23-ef79-44bc-9ea1-4d9b24a37549 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 1.073480 Aug 25 13:10:20.099503 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2172/4401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:19 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:20.583025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:20.605072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c47fdda7-6de2-46a2-a6c7-df0af85d30ab tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.696934 Aug 25 13:10:20.607275 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2230/4402] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:19 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:21.135304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:21.137454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:21.152973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.153836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.155274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.157653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.159600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.163252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.648897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:21.651442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:21.665350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.667528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.668996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.670880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:21.672540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:21.673773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:21.675282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:21.707748 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc41bbd0-289f-4a51-8991-8e35fc28098e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.580105 Aug 25 13:10:21.720705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2173/4403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:21 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:22.242921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:22.269386 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ef1d211-e880-4675-8d91-959e2d2f40e1 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.628445 Aug 25 13:10:22.282956 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2231/4404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:21 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:22.759189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:22.762558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:22.779983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:22.782802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:22.784597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:22.787351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:22.788627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:22.791212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.301688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:23.318928 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d122dcd7-854f-40b9-9734-04dcd47bd979 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.571523 Aug 25 13:10:23.320562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2174/4405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:22 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:23.330333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:23.332029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:23.367896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:23.368879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:23.369744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.376448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:23.377363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:23.378199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.560247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d88aed8-bb9c-45ee-9049-d1f322d5d839", "name": "network-vif-plugged", "status": "completed", "tag": "a551e200-5a33-4f4d-8c71-ad3cbfefaf20"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:23.603803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:23.606395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:23.607540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:23.648997 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] Creating event network-vif-plugged:a551e200-5a33-4f4d-8c71-ad3cbfefaf20 for instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 on n-h1-850468-18 Aug 25 13:10:23.674669 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-45913496-034e-4003-9743-5d5ef32c910f req-71b76b18-3160-40eb-a95c-ac3e1e7017d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130099 Aug 25 13:10:23.677834 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2175/4406] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:24.138865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:24.164589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2595a6a1-5252-48f5-9c18-5929b33f078a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.844152 Aug 25 13:10:24.167757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2232/4407] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:23 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:24.368453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:24.369747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:24.383447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:24.384483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:24.385211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:24.386518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:24.387365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:24.388168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:24.663947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:24.680099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a4c2f44-add8-4dc5-904a-898e497333ef tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 0.322957 Aug 25 13:10:24.681205 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2176/4408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:24 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:25.220432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:25.228786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:25.250396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.271024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.293746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:25.295271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.296357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.297443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:25.723387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:25.726304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:25.749095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.750593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.755404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:25.759878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:25.761367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:25.762560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:26.587286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:26.607845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0bd89bec-5fba-4cab-8c56-b1a20af5e55a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 1.404526 Aug 25 13:10:26.625249 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2233/4409] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:25 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:26.728237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:26.745835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9d01293-3916-41ef-b2d7-95d16638a251 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1403 microversion: 2.1 time: 1.031607 Aug 25 13:10:26.760425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2177/4410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:25 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1403 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:27.562506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:27.563395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:27.589207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.590482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.591333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.600068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.601234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.603093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.664917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:27.666670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:27.685886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.690092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.694246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.696538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.698056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.700294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.733344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c6c9da6-099e-4c5a-b6b2-8b6260480019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/ips" status: 200 len: 150 microversion: 2.20 time: 0.192132 Aug 25 13:10:27.735815 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2234/4411] 10.222.0.60 () {60 vars in 1289 bytes} [Thu Aug 25 13:10:27 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/ips => generated 150 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:10:27.787261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:27.789114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:27.814448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.815281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.815942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:27.817896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:27.818792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:27.819566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.465772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.480090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:28.494412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b6da951-9552-4e9e-81ca-02eced618c27 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.842020 Aug 25 13:10:28.496357 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2178/4412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:27 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:28.507927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28bf1243-ea12-4be5-a2fd-bde6c3c6fb4a tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1589 microversion: 2.1 time: 0.728095 Aug 25 13:10:28.510076 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2235/4413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:27 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1589 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:28.556489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:28.557389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:28.570704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:28.571387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:28.572901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.574604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:28.576042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:28.591229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:28.897146 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b73a45b-928e-46df-9d1b-4ef8111cc487 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350363 Aug 25 13:10:28.898403 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2179/4414] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:10:28 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839/os-interface => generated 284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:29.557412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:29.559216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:29.595600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:29.600823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:29.602407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:29.604614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:29.609320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:29.615575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:30.357286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:30.377192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1298067343", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:30.384717 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96ac1bb0-97b3-4c39-a12a-3ea6e8facba0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.851802 Aug 25 13:10:30.385818 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2236/4415] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:29 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:30.556903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:30.557941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:30.558371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:30.563922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:30.573913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:30.611278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:30.612109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:30.615220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:30.617206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:30.618803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:30.619967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:30.698285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Getting quotas for project 343ca8ab890942228adef695450e7f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:30.721854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Getting quotas for user 2e91f51b3e3347d790722fd3d918b3d4 and project 343ca8ab890942228adef695450e7f7a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:30.758196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:10:30.763987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:10:30.897964 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-338e4d8a-9e94-4481-bf58-35c4774822a9 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.027214 Aug 25 13:10:30.900485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2180/4416] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:10:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:10:30.925564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:30.926743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:31.171049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:31.193957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:31.197833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:31.200548 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3bf4657b-bc40-4d24-8676-800e555c4918 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1278 microversion: 2.54 time: 0.283382 Aug 25 13:10:31.202540 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2237/4417] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:30 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:31.444736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:31.445949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:31.461290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:31.463477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:31.464981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:31.466707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:31.468526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:31.469860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:31.792594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:31.794795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:31.824073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:31.825011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:31.825770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:31.827126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:31.827978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:31.828867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:31.912057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lazy-loading 'flavor' on Instance uuid 71b2d44b-7481-4d0f-8d89-1e2227155420 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:32.138320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.161520 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2a0c2418-374d-4974-9505-c1522d32276e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.726154 Aug 25 13:10:32.173869 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2181/4418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:31 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:32.256392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:32.257625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:32.272962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.273866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.274804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.275954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.276735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.277384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.474783 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3f3c6ac-ec2c-4f8c-b149-8aca26543242 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/action" status: 202 len: 0 microversion: 2.20 time: 0.693242 Aug 25 13:10:32.476851 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2238/4419] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 13:10:31 2022] POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:10:32.525166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:32.527378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:32.553974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.555746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.557166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.560984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.565403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.572581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.573775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.597293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.604022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.606525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c9d43ff1-f6a9-4e5b-ad31-6b22a471d486 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1282 microversion: 2.54 time: 0.358063 Aug 25 13:10:32.607667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2182/4420] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:32 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1282 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:32.913793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:32.915963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:32.931334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.932896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.934166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.937443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:32.938741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:32.939846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:32.986804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:32.991942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:33.023136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:33.026335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:33.028561 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21c4b916-778b-4d6e-ae22-4621e53ad282 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.535015 Aug 25 13:10:33.030048 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2239/4421] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:32 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:33.043371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d88aed8-bb9c-45ee-9049-d1f322d5d839", "tag": "a551e200-5a33-4f4d-8c71-ad3cbfefaf20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:33.075084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.076691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.078169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.101432 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] Creating event network-changed:a551e200-5a33-4f4d-8c71-ad3cbfefaf20 for instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 on n-h1-850468-18 Aug 25 13:10:33.117646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4e30bfed-bd7d-454d-8660-f0452447dff9 req-c1ef6dd6-0137-46e5-9356-39f417d99cd3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084268 Aug 25 13:10:33.121365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2240/4422] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:33.217504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:33.219243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:33.242831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.244085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.245134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.246938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.248010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.249044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.299945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:33.328762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37733954-ac2a-4c2b-a1b1-7548a975a2e9 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1589 microversion: 2.1 time: 0.423321 Aug 25 13:10:33.339668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2183/4423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:32 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1589 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:33.659584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:33.661205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:33.693133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.694303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.698392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.703228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:33.705948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:33.707683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:33.849277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:33.921411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43029c50-9fa6-44cc-87df-d7dd2a6a8b59 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.698190 Aug 25 13:10:33.922626 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2241/4424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:33 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:34.032350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.078325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.082402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.083630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:34.086642 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d9ba719-eb36-4824-b80c-c5241d53f273 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1338 microversion: 2.54 time: 0.436969 Aug 25 13:10:34.088630 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2184/4425] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:33 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1338 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:34.093685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:34.115685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.118990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.120102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.121908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.122947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.124200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.696369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.719409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.723981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:34.728394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9fd4ba74-92a9-4052-9f54-46867ca55d7a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.652026 Aug 25 13:10:34.730530 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2242/4426] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:34 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:34.971869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:34.973823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:34.987224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.988387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.990197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:34.995246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:34.995862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:34.996919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.139984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:35.141129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:35.157578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.159142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.159973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.162563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.163998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.164805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.376171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:35.402849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:35.407126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:35.411475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4e99d6e-6a0e-43b8-adeb-e741071fef47 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1336 microversion: 2.54 time: 0.277993 Aug 25 13:10:35.412720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:35.413031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2243/4427] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:35 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1336 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:35.431198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a0df65bd-4159-4c3c-b040-bebe499fc4f4 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.469629 Aug 25 13:10:35.432697 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2185/4428] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:34 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:35.488832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:35.490145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:35.503562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.505153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.506652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.508223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.509428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.510484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.569956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-314e060f-3801-4aba-89ee-91c3a0c98d85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/ips" status: 200 len: 150 microversion: 2.1 time: 0.089357 Aug 25 13:10:35.570994 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2244/4429] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:10:35 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:35.776808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:35.777857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:35.791077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.792440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.793621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.794925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:35.796041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:35.797064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:35.854797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:36.217494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.241914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.245881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.248697 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81723a53-ffda-4806-9895-1d5d85f3e793 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.480734 Aug 25 13:10:36.250335 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2186/4430] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:35 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:36.475759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:36.477309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:36.478826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:36.479191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:36.492051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.493553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.495940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.496178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.496933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.498278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.498742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.499952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.501127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.501575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:36.502912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:36.504060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:36.831263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.858843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.870042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:36.874219 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbe2669d-ae70-48af-9a70-9c5054e98a12 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1336 microversion: 2.54 time: 0.410224 Aug 25 13:10:36.876268 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2245/4431] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:36 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1336 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:37.032205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.061896 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91655d80-f316-4efc-9a35-20dd4b249ea8 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.591657 Aug 25 13:10:37.063057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2187/4432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:36 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:10:37.305225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:37.307172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:37.322354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.323750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.325010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.329132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.330794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.332094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.921205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:37.923214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:37.939654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.940898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.942896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.944835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:37.946456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:37.947426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:37.968817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.992739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.996074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:37.999020 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4908e16-86ed-4a36-b446-760aad62abd7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.703470 Aug 25 13:10:38.000164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2246/4433] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:37 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:38.096074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:38.109230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:38.110610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:38.119220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:38.124236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:38.128143 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e15d71fa-bddb-439d-8385-7aefbc9aa73b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1336 microversion: 2.54 time: 0.215238 Aug 25 13:10:38.131691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2188/4434] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:37 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:38.135715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.136701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.137648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.139175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.140196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.141470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.434566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:38.447682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fdc0751-87d8-42a3-83b9-143e27595c9e"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:38.453596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:38.457914 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e22af369-1788-4e1f-93ed-e69f61bae921 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.359637 Aug 25 13:10:38.458856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2247/4435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:38 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:38.466577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.467956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.469179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:38.470618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:38.471565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:38.472493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.046260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:39.047673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:39.061692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.062877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.063748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.065255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.066699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.067508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.341756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.359375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.363712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.366314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af12d82e-9eab-4226-8950-de786ccdc1f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.327127 Aug 25 13:10:39.367683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2248/4436] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:39 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:39.378095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:39.380572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:39.384742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=62 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:39.395728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.396679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.397557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.398939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.399794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.400625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.531368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.549929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.554718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.557003 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6742770d-d974-4ed8-9df6-0bf875e01f5d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1336 microversion: 2.54 time: 0.186540 Aug 25 13:10:39.558254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2249/4437] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:39 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1336 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:39.568822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:39.570085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:39.582904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.588296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.588296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.588296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:39.588296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:39.588296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:39.882188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:39.900538 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4257cdd7-fb5c-43e6-ad27-208516cbbb74 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.340349 Aug 25 13:10:39.901937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2250/4438] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:39 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:40.412153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:40.413381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:40.426067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.427410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.428290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.429694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.430807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.431438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.645679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:40.711429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.724031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.727071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.729319 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f976a6e5-70f6-4e52-885f-67d3438f3bd0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.324602 Aug 25 13:10:40.730340 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2251/4439] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:40 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:40.741205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:40.742419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:40.743678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:40.755267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.756305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.757124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.759410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.759410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.760585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.901905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.919607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.922809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:40.924984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d11c5707-aa87-43c4-a024-91f7c8fc83e8 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1336 microversion: 2.54 time: 0.192459 Aug 25 13:10:40.926847 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2252/4440] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:40 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1336 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:40.971913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:40.973718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:40.986471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.987834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.988719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:40.991022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:40.991982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:40.992740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.192003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:41.421455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:41.440215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f9a990f-9bcd-49c8-b045-0698c2279628 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.495050 Aug 25 13:10:41.442132 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2253/4441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:40 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:41.578530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-955b88b4-ef22-4f95-87b6-ebd7053136c0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.136260 Aug 25 13:10:41.579723 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2189/4442] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:10:38 2022] POST /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 194 bytes in 3139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:10:41.776859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.779191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.792835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.793780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.794616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.796277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.797502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.798561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:41.980244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:41.981580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:41.995910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:41.997835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:41.998735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.000148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.001027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.001794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.116990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.134530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.137576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.139742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73acf400-e44b-4424-990e-214d649f807a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.370944 Aug 25 13:10:42.141449 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2254/4443] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:42.172598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.188993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.192555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.194983 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b0cd8490-db1d-43b0-8676-96f179640a10 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1357 microversion: 2.54 time: 0.222836 Aug 25 13:10:42.196007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2190/4444] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:41 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:42.243914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-841e85f1-7f95-4085-a605-aa5e16338bb2 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Action: 'create', calling method: .version_select at 0x7fc6c1776700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-933429167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2CvZOq2fU55clQ+7qJDcW1cotjO8wOrFxo5YUZ/5wl8REWMGei1gEU8h3F6qmBaaA12A7Iq6pa8aBf2jTEmgkDKnkbxgdX49WxCeMfp/YfOT0+3lV0aDbVNIL0YUaWJw=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:42.279219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-841e85f1-7f95-4085-a605-aa5e16338bb2 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Getting quotas for project 343ca8ab890942228adef695450e7f7a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:10:42.288750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-841e85f1-7f95-4085-a605-aa5e16338bb2 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Getting quotas for user 2e91f51b3e3347d790722fd3d918b3d4 and project 343ca8ab890942228adef695450e7f7a. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:10:42.330760 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-841e85f1-7f95-4085-a605-aa5e16338bb2 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.092747 Aug 25 13:10:42.332771 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2255/4445] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 13:10:42 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:10:42.352163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-933429167", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:42.357759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:42.370965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.371847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.372811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.374115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.374955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.375749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.485881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:42.487055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:42.501007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.501961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.502679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.504764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.505667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.506705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.547091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:10:42.548278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:10:42.549449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:10:42.550415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:10:42.552643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:10:42.740749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:42.760360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.761729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.762863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.764644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.766364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.767389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.794272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:42.811200 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01e9dccc-55ad-4090-8489-d47fb53c1440 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.333932 Aug 25 13:10:42.812572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2256/4446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:42 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:42.861072 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f30c196a-c770-402f-8e24-f7e1b7faa503 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "POST /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573/action" status: 202 len: 1139 microversion: 2.54 time: 0.513407 Aug 25 13:10:42.865073 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2191/4447] 10.222.0.60 () {62 vars in 1320 bytes} [Thu Aug 25 13:10:42 2022] POST /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573/action => generated 1139 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 13:10:42.917767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:42.919293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:42.934246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.935473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.936265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:42.937587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:42.938449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:42.939205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.103880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.118582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.120852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.122560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e070a1b4-30c0-4b6d-b92c-9911bedd9fcf tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.218238 Aug 25 13:10:43.123533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2257/4448] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:42 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:43.194185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:43.195369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:43.212728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.214333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.215591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.218240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.219462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.221198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.593520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.608261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.611950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:43.615368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c662df62-18f8-4d23-a5c3-15bf973d79d7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.437922 Aug 25 13:10:43.616662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2192/4449] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:43 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:43.862378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:43.868924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:43.908052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.909030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.910451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.912027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:43.913095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:43.913807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:43.955852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:44.177992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:44.180319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:44.196706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.197744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.198460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.199801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.200745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.201560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.239194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:44.259036 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3118dad3-553e-4034-b21a-4f07883b9d31 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1486 microversion: 2.1 time: 0.407008 Aug 25 13:10:44.260294 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2258/4450] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:43 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1486 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:44.305660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:44.306607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:44.330073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.330073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.330073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.335274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.335274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.335274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.400477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:44.416056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:44.418999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:44.422166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3edc2a1c-e0e7-4432-8418-936584569138 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.255588 Aug 25 13:10:44.437005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2193/4451] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:44 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:44.510365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3f1b3f8-5b43-484e-997f-aa09a98f6ad3 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "POST /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e/action" status: 202 len: 0 microversion: 2.1 time: 0.212476 Aug 25 13:10:44.512500 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2259/4452] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:10:44 2022] POST /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:10:44.538399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:44.539145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:44.572422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.573292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.574328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.575602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.576500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.578081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.672962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:44.675080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:44.697260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.699625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.701092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:44.703271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:44.704697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:44.705827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:45.781004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.793355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.803518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.808373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:45.812073 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b619d24-4883-4217-ba07-843e7dc7fcc7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 1.155124 Aug 25 13:10:45.820639 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86829c2d-a713-494f-a215-593536bfbda9 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1494 microversion: 2.1 time: 1.302071 Aug 25 13:10:45.822250 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2194/4453] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:44 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1494 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:45.832580 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2260/4454] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:44 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:45.869819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:45.871446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:45.889708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:45.890878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:45.892259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:45.895441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:45.897478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:45.898831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:46.081205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:46.103194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:46.106363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:46.108894 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8f4bf17-bf27-40ef-a901-858f7732282b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.276987 Aug 25 13:10:46.110834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2261/4455] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:45 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:46.867284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:46.868702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:46.885247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.886483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.887719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:46.889374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.890368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.891455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:46.895741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:46.899412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:46.927112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.929723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.931754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:46.934060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:46.935760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:46.938605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:47.323098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.365519 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1808e8c1-b331-4cb4-9a84-1430d46a8267 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1494 microversion: 2.1 time: 0.507149 Aug 25 13:10:47.368578 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2195/4456] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:46 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1494 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:47.394318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:47.396878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:47.400291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.409406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:47.410000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:47.410976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:47.412800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:47.414178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:47.415346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:47.418145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.421723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.424704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ab8f5b5-a821-4044-aa1e-3a3c1bdfe824 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.542935 Aug 25 13:10:47.428406 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2262/4457] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:46 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:47.620202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.639092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.643037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:47.645585 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-33f5a48a-1a33-4199-8bc4-980068987f55 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.274734 Aug 25 13:10:47.647021 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2196/4458] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:47 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:48.406740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:48.408204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:48.422366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.423464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.424685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.426955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.428228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.429456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.484302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:48.490961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:48.507217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.508107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.508959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.510347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.511057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.511819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.875002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:48.898069 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1cb117a9-9115-40ff-a294-2bfc23674525 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1494 microversion: 2.1 time: 0.498684 Aug 25 13:10:48.901228 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2263/4459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:48 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1494 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:48.931393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:48.934335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:48.958877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.960413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.961785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.963785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:48.965058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:48.966031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:48.999877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.030798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.035234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.038797 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76feff46-6090-4627-a07c-9440a0318281 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.570060 Aug 25 13:10:49.056216 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2197/4460] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:48 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:49.132805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.153105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.155256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:49.157852 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba12b02c-7d79-498c-8447-93caa2e47fa3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.254262 Aug 25 13:10:49.158674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2264/4461] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:48 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:49.947859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:49.949752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:49.954147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:49.966923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:49.967833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:49.968680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:49.970307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:49.971274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:49.972148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.089184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:50.090341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:50.115026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.117703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.118898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.120879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.132965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.139795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.444210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.465019 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df47a248-c43d-4d59-a293-9b029bd7dc2d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1494 microversion: 2.1 time: 0.524677 Aug 25 13:10:50.469103 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2198/4462] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:49 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1494 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:50.479944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:50.481575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:50.496869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.498368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.499141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.500518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:50.501644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:50.502731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:50.519754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.539505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.544605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.547573 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cb856e9-5f75-4006-8c6d-3b042ae33cce tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.467601 Aug 25 13:10:50.562065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:50.564351 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2265/4463] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:50 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:50.655946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.674875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.679641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:50.682250 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-60f3d988-5d19-4582-9d0f-3469daaa5ce3 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.210656 Aug 25 13:10:50.683712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2199/4464] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:50 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:51.537751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:51.542610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:51.561790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.562674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.563488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.566556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.568845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.570146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.606462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:51.609186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:51.626161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.627646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.629490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.631260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:51.632736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:51.633884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:51.986015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.008838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-470fa858-f554-43d8-bbf6-f0326a9043f2 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1500 microversion: 2.1 time: 0.494592 Aug 25 13:10:52.009946 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2266/4465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:51 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1500 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:52.031282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:52.032367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:52.066799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.067770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.068638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.072350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.072350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.073141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.100097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.121627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.130344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.133513 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc944b18-8d0c-44cb-894f-d4a43cffb79d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.536682 Aug 25 13:10:52.140205 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2200/4466] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:51 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:52.153004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:52.154302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:52.177962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.182978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.184727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.186602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.187646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.188980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.242562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.257643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:10:52.261158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.264682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:52.267569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-075e44cf-1712-466f-8ddc-3cb7b2bef4eb tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.243330 Aug 25 13:10:52.270048 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2267/4467] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:52 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:52.413942 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79a4aef7-4713-49aa-9ff3-831b601fe21f tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 204 len: 0 microversion: 2.1 time: 0.276374 Aug 25 13:10:52.415141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2201/4468] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:10:52 2022] DELETE /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:10:52.430478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:52.432617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:52.437890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:52.454076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.455396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.456303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:52.457721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:52.458532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:52.459364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.117998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.133794 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e39a6b40-d2c9-4f38-a8c5-153036699a53 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.711573 Aug 25 13:10:53.134883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2268/4469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:52 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:53.180784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:53.183205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:53.198999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.199888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.200750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.201975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.203067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.203957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.320073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:53.321463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:53.336723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.337702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.338677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.340036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:53.341322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:53.342357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:53.527772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.556367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.561901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.567143 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d57a88d-4fe8-4bb7-bde4-8c1750610194 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.255614 Aug 25 13:10:53.571714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2269/4470] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:53 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:53.590708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.616798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.620248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:53.623672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a3d94e9-5b66-44cb-9df5-2856380ad0d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.450953 Aug 25 13:10:53.625314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2202/4471] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:53 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:54.175114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:54.177336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:54.190820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.192410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.192410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.193486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.193985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.194536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.444447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:54.455156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-315ac436-8e71-4f9f-a2c1-7f4df9f12a48 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.286550 Aug 25 13:10:54.455933 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2270/4472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:54 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:54.622266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:54.623181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:54.634044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.634801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.635384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.636298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.637012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.637777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.674462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:54.677561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:54.689796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.692327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.694277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.696225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:54.697641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:54.699022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:54.773847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:54.792144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:54.803616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:54.808294 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-073b0ddb-2bde-4880-bd45-2af257635584 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.190001 Aug 25 13:10:54.824164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2203/4473] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:54 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:54.991768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.008929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.012180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.015075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23bfe32d-29b8-4db1-81fb-ca23a3503a3e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.351538 Aug 25 13:10:55.016220 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2271/4474] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:54 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:55.492089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:55.493773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:55.507331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.509300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.513101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.513101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.513842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.515067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.622768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-plugged", "status": "completed", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:55.662264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.664197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.665429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.711937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] Creating event network-vif-plugged:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:10:55.725613 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-598135a7-a4e9-412a-ad20-e808c66dccd1 req-42c82881-6453-439c-b15c-d626ced8e5dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118308 Aug 25 13:10:55.727553 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2272/4475] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:55.828810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:55.853127 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a42d072-e5e8-4f3e-acac-f547a89dd91b tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.366433 Aug 25 13:10:55.854813 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2204/4476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:55 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:55.865422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:55.866408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:55.884204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.885026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.885862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:55.887203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:55.888027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:55.889918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.019815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.039836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.043261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.046375 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dabc8784-02ab-4701-89a6-a409ff564a86 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.196124 Aug 25 13:10:56.047438 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2273/4477] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:55 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:56.052946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:56.054740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:56.069265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.070034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.070849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.072293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.079354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.080754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.506297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.543940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.547432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:56.549154 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b022e2e-0fa1-4f8a-a3d4-e6cc8ddb3d9c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.504719 Aug 25 13:10:56.551099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2205/4478] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:56 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:56.899967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:56.901692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:56.929640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.931207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.932443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:56.934335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:56.936239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:56.937328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.092635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:57.094888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:57.109401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.110348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.111167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.112524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.113376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.114134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.281124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.298131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.302693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.304946 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42a7a1c8-4f06-43cb-a66a-047965aa498d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.219658 Aug 25 13:10:57.313001 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2206/4479] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:57 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:10:57.476001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:57.482186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:10:57.490622 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61af2d47-543d-4cc3-b2a1-314b91923621 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1506 microversion: 2.1 time: 0.598837 Aug 25 13:10:57.491918 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2274/4480] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:56 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:57.595872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:57.597890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:57.611935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.614106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.615481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.617567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:57.618608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:57.619549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:57.977027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef453fb2-636d-467f-8a8f-1f256419de2e", "name": "network-vif-deleted", "tag": "89da8f10-2387-4673-bf1d-1f549647532c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:10:58.024274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.025309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.028065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.066640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.074728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] Creating event network-vif-deleted:89da8f10-2387-4673-bf1d-1f549647532c for instance ef453fb2-636d-467f-8a8f-1f256419de2e on n-h1-850468-18 Aug 25 13:10:58.089208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.095147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.099385 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9cf7f503-b688-4b10-b6ff-9145d2adc847 req-3a01c33d-f1f1-41c4-b4b5-9ef0fcde2dee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147799 Aug 25 13:10:58.101292 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76eaae0c-f38a-49b0-9ee8-5ff9b22c92c4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.513958 Aug 25 13:10:58.103268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2207/4481] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:57 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:58.111592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2275/4482] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:10:58.343445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:58.344837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:58.359910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.360776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.361570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.363566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.364485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.365317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.496034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.514064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.517237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.521617 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a5d498e5-25c3-4955-82be-76c2db52d31f tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.185172 Aug 25 13:10:58.523233 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2208/4483] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:58 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:58.542477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:58.544017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:58.558985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.560162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.561266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.562611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.564290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.564290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.648610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:58.649570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:58.650427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:58.651320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lazy-loading 'fault' on Instance uuid ef453fb2-636d-467f-8a8f-1f256419de2e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:10:58.765271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:58.790111 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6a80589-c8a8-4d21-8b68-d3152e77e2f0 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 200 len: 1303 microversion: 2.1 time: 0.258528 Aug 25 13:10:58.791662 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2276/4484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:58 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:10:59.149905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:59.151113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:59.163208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.164286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.165285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.166921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.167973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.168936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.439581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.465241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.468498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.470804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9638e59-85d7-41ab-851c-0980a980364f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1741 microversion: 2.20 time: 0.328904 Aug 25 13:10:59.472668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2209/4485] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:59 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1741 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:59.574230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:59.575430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:59.589410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.590661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.591443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.592801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.593688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.594519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.739711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.760264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.763777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:10:59.766237 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b235b0a6-dee2-46de-a3da-5f91c9a05104 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.203832 Aug 25 13:10:59.767689 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2277/4486] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:10:59 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:10:59.833379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:59.834628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: ef453fb2-636d-467f-8a8f-1f256419de2e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:59.846203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.848011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.848921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.850293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.851211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.851893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.884614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] HTTP exception thrown: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Request method failure captured: Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e HTTP/1.1 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3QxcAJD1N-c5AXpNlBwtyrOGu8plo2YO5pYm2PIh9Hs0h-lxEyPUss6w1bPROqsHJ-LYlhINLcE_z_jYlcgDErFrDqcIvc7wGxHMhU8UpsWL4G8sVrxA1wiBDOsMKU2U1ryU0blznqz-PdSnsRT6KyXFtGaLGvrSR5iqVd1MBbSTCE Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 96559c8b454640b78ab5d4f849eda356 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_96559c8b454640b78ab5d4f849eda356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 96559c8b454640b78ab5d4f849eda356 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerRescueTestJSON-1061215561-project Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2c746c6cfcfd4c539b42b138f5d79c6a Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerRescueTestJSON-1061215561-project Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'ef453fb2-636d-467f-8a8f-1f256419de2e'} Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:10:59.887535 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. Aug 25 13:10:59.896420 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:10:59.902876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Returning 404 to user: Instance ef453fb2-636d-467f-8a8f-1f256419de2e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:10:59.902876 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e46c2e4-7256-42cd-a1c1-b1e151a85998 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e" status: 404 len: 111 microversion: 2.1 time: 0.077137 Aug 25 13:10:59.903948 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2210/4487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:10:59 2022] GET /compute/v2.1/servers/ef453fb2-636d-467f-8a8f-1f256419de2e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:10:59.915649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:10:59.916509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:10:59.925753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.927280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.928103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.929698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:10:59.930352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:10:59.930932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:10:59.973627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:11:00.175292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbe3358a-e25a-4a3a-9f35-49604d0ebce7 tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 204 len: 0 microversion: 2.1 time: 0.265406 Aug 25 13:11:00.177592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2278/4488] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:10:59 2022] DELETE /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:11:00.194679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:00.196136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:00.211387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.212612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.213418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.214333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.214950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.215623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.458911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:00.477772 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4f0e6c6-42fb-4422-a057-c779b7d53f2e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1491 microversion: 2.1 time: 0.292886 Aug 25 13:11:00.479047 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2211/4489] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:00 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1491 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:00.516044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:00.517260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:00.528478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.529480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.530303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.531648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.532540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.533348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.816906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:00.818717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:00.832105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.833099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.833918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.835314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:00.836264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:00.837104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:00.996054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.015742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.019047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.022206 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fdd11f2c-a62b-4f62-a529-0f6415d1eb3e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.215310 Aug 25 13:11:01.023724 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2212/4490] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:00 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:01.365830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.385504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.388542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.390732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c68bc36-471f-4da1-9ce6-9b195f774c2c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.882041 Aug 25 13:11:01.391644 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2279/4491] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:00 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:01.522937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:01.529706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:01.561384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:01.562207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:01.563060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:01.564497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:01.565414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:01.567376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:01.861630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:01.877715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51d18867-c2a3-45cd-973e-8fbf2604d41a tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1491 microversion: 2.1 time: 0.364419 Aug 25 13:11:01.879438 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2213/4492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:01 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1491 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:02.069513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:02.070626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:02.085090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.086042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.086860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.088289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.089202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.089985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.229067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.247197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.250270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.253266 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96412df7-8a6d-4155-bdb6-d982d3e79493 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.191229 Aug 25 13:11:02.254460 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2280/4493] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:02 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:02.443905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:02.445922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:02.457977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.458864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.459675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.461195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.462037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.463700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.821797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.840672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.846874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:02.849949 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02bfae46-f684-47df-ac5d-00e1048e3f5c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.417336 Aug 25 13:11:02.851677 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2214/4494] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:02 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:02.921443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:02.922785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:02.934067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.935723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.937012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:02.938534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:02.940180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:02.940180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:03.260394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:03.287801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9df2b743-3fd4-4a5b-84a7-8de3f79e2d3e tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1491 microversion: 2.1 time: 0.374856 Aug 25 13:11:03.289796 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2281/4495] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:02 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1491 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:03.324187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:03.328312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:03.347638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:03.348984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:03.349826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:03.351153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:03.352298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:03.353110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:03.364606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:03.599905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:03.633615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:03.637753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:03.655358 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b04e31c-d51b-4121-be7d-359b49e3fd2e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.337393 Aug 25 13:11:03.659260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2215/4496] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:03 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:03.900004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:03.905389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:03.953935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:03.956031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:03.958566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:03.964888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:03.972755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:03.980964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:04.339415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:04.346767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:04.382992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:04.384342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:04.396184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:04.397864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:04.399004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:04.400059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:04.933005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:04.960993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:04.983089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:04.991262 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9800be2-5d00-4593-8507-ef9e7632eb88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 1.099535 Aug 25 13:11:04.993450 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2282/4497] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:03 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:05.016421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:05.018389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:05.051213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.055672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.059581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.063829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.071301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.074016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.135215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c746c6cfcfd4c539b42b138f5d79c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96559c8b454640b78ab5d4f849eda356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:05.162117 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46bb99b5-20c1-45ee-b157-0c83e262db18 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/ips" status: 200 len: 144 microversion: 2.1 time: 0.162607 Aug 25 13:11:05.163747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2283/4498] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:11:04 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/ips => generated 144 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:05.174682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:05.176556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:05.194737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.197293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.200868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.203469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.204540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.206658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.215659 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d53de09-611f-41b6-97d6-682bd311e6db tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 200 len: 1491 microversion: 2.1 time: 0.879514 Aug 25 13:11:05.267764 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2216/4499] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:04 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 1491 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:05.313031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fdc0751-87d8-42a3-83b9-143e27595c9e"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:05.326232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:05.362979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.365710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.366915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.368857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.371830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.372658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.690807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments HTTP/1.1 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 74 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: {"volumeAttachment": {"volumeId": "6fdc0751-87d8-42a3-83b9-143e27595c9e"}} Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': '4e11534e-e7d6-4476-97ba-107c7b14e4ce', 'body': {'volumeAttachment': {'volumeId': '6fdc0751-87d8-42a3-83b9-143e27595c9e'}}} Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:11:05.707757 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce Aug 25 13:11:05.719637 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:05.724274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 400 to user: Invalid volume: volume 6fdc0751-87d8-42a3-83b9-143e27595c9e is already attached to instances: 4e11534e-e7d6-4476-97ba-107c7b14e4ce {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:05.729910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-87ad740d-d80b-4052-8468-9c44f27b621f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.457550 Aug 25 13:11:05.731982 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2217/4500] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:11:05 2022] POST /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 174 bytes in 463 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:11:05.765343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1", "name": "network-vif-deleted", "tag": "f2d55742-f49f-4480-af0b-7cf31d7d85c1"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:05.775831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:05.792886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:05.804747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:05.812537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9ab8c75-28c8-4954-a510-a7a106022e14 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.646358 Aug 25 13:11:05.818302 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2284/4501] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:05 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:05.834791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:05.834791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:05.835190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:05.930154 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] Creating event network-vif-deleted:f2d55742-f49f-4480-af0b-7cf31d7d85c1 for instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 on n-h1-850468-18 Aug 25 13:11:05.947730 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8367aa80-e670-41a7-809d-37f66537f9a5 req-1d977fd4-7d3f-4101-841f-6cb9df810c21 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211173 Aug 25 13:11:05.950348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2218/4502] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:06.013444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:06.019526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:06.042044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:06.044071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:06.050829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.053975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.058608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.066420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.071454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.075413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.077096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.081950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.087748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.092476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.095637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.096835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.430416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lazy-loading 'services' on Instance uuid 4e11534e-e7d6-4476-97ba-107c7b14e4ce {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:11:06.757058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d2e2e92-e419-42ad-a346-4bf59a77fb3b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments/6fdc0751-87d8-42a3-83b9-143e27595c9e" status: 202 len: 0 microversion: 2.1 time: 0.728590 Aug 25 13:11:06.758209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2285/4503] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:11:06 2022] DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments/6fdc0751-87d8-42a3-83b9-143e27595c9e => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:11:06.792184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.821011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.826704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:06.826987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:06.828243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] [instance: 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:06.836404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ec57863-4fe1-4e65-80cb-2878af7ba31b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.806064 Aug 25 13:11:06.871119 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2219/4504] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:06 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:06.897953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.899036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.899500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:06.899850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.901288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.902181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.903002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.905399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:06.927059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.933314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.934522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.936468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:06.941022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:06.942595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:06.974397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] HTTP exception thrown: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Request method failure captured: Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 HTTP/1.1 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3QxcAJD1N-c5AXpNlBwtyrOGu8plo2YO5pYm2PIh9Hs0h-lxEyPUss6w1bPROqsHJ-LYlhINLcE_z_jYlcgDErFrDqcIvc7wGxHMhU8UpsWL4G8sVrxA1wiBDOsMKU2U1ryU0blznqz-PdSnsRT6KyXFtGaLGvrSR5iqVd1MBbSTCE Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 96559c8b454640b78ab5d4f849eda356 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_96559c8b454640b78ab5d4f849eda356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/96559c8b454640b78ab5d4f849eda356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 96559c8b454640b78ab5d4f849eda356 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerRescueTestJSON-1061215561 Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerRescueTestJSON-1061215561-project Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 2c746c6cfcfd4c539b42b138f5d79c6a Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerRescueTestJSON-1061215561-project Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1'} Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:06.978761 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. Aug 25 13:11:06.987589 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:11:06.992616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] Returning 404 to user: Instance 7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:06.992616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32d82810-a07c-49a0-bed3-abeb9e5b3d0d tempest-ServerRescueTestJSON-1061215561 tempest-ServerRescueTestJSON-1061215561-project] 10.222.0.60 "GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1" status: 404 len: 111 microversion: 2.1 time: 0.217520 Aug 25 13:11:06.993910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2286/4505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:06 2022] GET /compute/v2.1/servers/7a4dac3e-8e0b-4afd-8e72-7b26c4ea4fd1 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:07.009735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:07.011814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:07.045472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.051701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.053320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.055032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.056279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.057387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.226007 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a94e7c5d-f680-4e38-bc68-8ba80ee881a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.352199 Aug 25 13:11:07.227668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2220/4506] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:06 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:07.262470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:07.290175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:07.309683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:07.312937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5719bca3-ba40-448a-9ff1-7c4c31ff1d03 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.310413 Aug 25 13:11:07.314438 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2287/4507] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:07 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:07.889261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:07.894993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:07.921527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.929441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.932040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:07.937822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:07.939439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:07.946747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.248057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:08.257400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:08.301942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.303397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.307164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.309472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.311126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.312440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.477854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e40193b0-efc6-4102-a55c-d7acbf02dbc0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236169 Aug 25 13:11:08.481132 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2288/4508] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:08 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:08.514128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:08.515869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:08.548281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.553625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.572339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.574217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:08.583026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:08.584454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:08.759266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.790196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.793534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.796006 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-717d49a2-3852-42c7-8326-37a2e1c5b728 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.919099 Aug 25 13:11:08.809777 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2221/4509] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:07 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:08.868584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.891791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.903812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:08.913207 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a0e0644e-3855-4c70-9223-9e3b8228acfd tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.416306 Aug 25 13:11:08.955411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2289/4510] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:08 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:09.500262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:09.509053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:09.541745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.542700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.543866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:09.547239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.548709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.557470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:09.683858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42e929ac-f2aa-4188-94a0-eb948341bf76 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190927 Aug 25 13:11:09.685009 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2222/4511] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:09 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:09.762015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86546882-03ca-4e88-8b4a-9e3fda3d226e"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:09.767385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:09.788961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:09.801613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.809418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.817771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:09.819814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.821215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.822414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:09.877351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:09.886430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:09.894229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:09.919276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.920887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.922142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:09.924001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:09.925914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:09.927279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.515799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.537738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.541126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.556955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77621221-ebc0-4e5c-a66e-80565d879e4a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.692744 Aug 25 13:11:10.563284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2223/4512] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:09 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:10.579855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:10.584629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:10.604512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.606099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.607459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.609523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.610936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.612309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.832965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.870437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.881912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:10.885999 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d79c698-25e4-449e-aad5-e90a2206baab tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.320657 Aug 25 13:11:10.888689 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2224/4513] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:10 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:10.898876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:10.904095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:10.918538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.920194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.921626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.923738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:10.926537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:10.927929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:10.996301 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-21997631-b6cf-4ae0-a794-12a5410f6015 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104944 Aug 25 13:11:10.998476 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2225/4514] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:10 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:11.604398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:11.609102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:11.622973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:11.624546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:11.625838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:11.628938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:11.630512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:11.631858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:11.633549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c25dfebe-5f77-4026-b66b-02fb62be52d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.854677 Aug 25 13:11:11.634731 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2290/4515] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:11:09 2022] POST /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 194 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:11.946647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:11.947958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:12.001896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.002869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.004287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:12.027039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:12.036264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:12.037154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:13.392152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.459146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.466612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.487184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d6eb998-ea99-42ac-89cd-c2e85b4d0643 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 1.556366 Aug 25 13:11:13.505031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2291/4516] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:11 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:13.539758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:13.559455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:13.570512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.595766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:13.597237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:13.601547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:13.603891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:13.606787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:13.622360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:13.640374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.643859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:13.667835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b4204a4-d580-40a3-9245-220dfc56566c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 2.070684 Aug 25 13:11:13.680400 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2226/4517] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:11 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:13.767011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b6f9dc4c-7e21-4349-b441-baf801a3a871 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259400 Aug 25 13:11:13.774750 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2292/4518] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:13 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:14.551231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:14.558827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:14.600957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.606327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.607239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.608625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.609501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.610292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.717274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:14.718407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:14.761526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.763058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.766689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.769877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.778939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.779833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.882209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.903741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.910523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:14.921637 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf6faa7e-1e61-43e5-9e37-66687a46e003 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.376700 Aug 25 13:11:14.924597 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2227/4519] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:14 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:14.946657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:14.954915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:14.986797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.988773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.990323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:14.994356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:14.995707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:14.996927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:15.133177 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cfe5a83e-0ba2-4055-8a6c-c64b467241a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206014 Aug 25 13:11:15.142981 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2228/4520] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:14 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:15.188940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:15.213581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:15.218433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:15.221555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4009ba53-ff57-41fb-ad21-ef5759fd396c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.512618 Aug 25 13:11:15.224585 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2293/4521] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:14 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:15.982177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:15.985308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:16.028664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.029611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.030500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.031700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.051912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.053254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.181376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:16.207801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:16.299280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.318748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.320381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.322254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.323830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.325075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.401509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.456945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.462574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.466054 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-44b6a449-2172-462a-8778-6d0a08d0346e tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.493649 Aug 25 13:11:16.469234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ced170d-722a-4064-a14a-9d5ea59b1e14 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.320342 Aug 25 13:11:16.477641 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2229/4522] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:15 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:16.478799 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2294/4523] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:16 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:16.499663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:16.501566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:16.529622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.531402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.532571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.536529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:16.539119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:16.539873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:16.933769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.954590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.959676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:16.962105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-82cb5599-20aa-40ff-a566-b42249d747f5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.481282 Aug 25 13:11:16.963755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2230/4524] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:16 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:17.499891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:17.504928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:17.518193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.520046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:17.521563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.535641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:17.537923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:17.542438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.548814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:17.551499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.558398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.559761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:17.561181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.562791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:17.564166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:17.565330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:17.703629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea4198bd-7f2b-455a-af20-c921913b8218 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219367 Aug 25 13:11:17.712736 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2295/4525] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:17 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:18.018782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:18.021041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:18.035742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.037336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.039281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.041048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.042224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.043313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.128609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.168007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.179472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.182552 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7614ec8-9ee7-439f-b7bb-fdc09ea19a2c tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1408 microversion: 2.54 time: 0.663417 Aug 25 13:11:18.189557 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2231/4526] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:17 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1408 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:18.729487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:18.740480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:18.780013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.783056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.788189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.791805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:18.792702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:18.794156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:18.841783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:18.865298 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40bf3e73-05b1-4b3d-8737-3915396e1491 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146865 Aug 25 13:11:18.866878 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2232/4527] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:18 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:18.961070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.986672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.990756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:18.993654 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1878e6a3-aca5-4b56-87b0-5cd7d33d9fb6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.987251 Aug 25 13:11:18.995026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2296/4528] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:18 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:19.245541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:19.251310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:19.281945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.282894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.283742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.286205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.287475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.289790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.438108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:19.461683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:19.463974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:19.466425 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbe581da-f0fb-4956-b4b7-79727531941b tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1414 microversion: 2.54 time: 0.229961 Aug 25 13:11:19.468002 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2233/4529] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:19 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1414 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:19.899597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:19.904600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:19.922121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.923659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.927888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:19.931338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:19.933246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:19.934433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.025513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3811ab0b-e7d3-410b-b6bd-bac7ae6d29ef tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137877 Aug 25 13:11:20.028186 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2297/4530] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:19 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:20.064084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:20.067000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:20.072490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:20.097887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.109490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.110921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.113366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.114863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.116474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.520682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:20.525327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:20.554239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.555458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.556678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.558229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:20.559241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:20.561471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:20.767831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.798001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.801495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.810459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3749f1d0-dfe8-4a5e-be39-707defb46831 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.754272 Aug 25 13:11:20.850626 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2234/4531] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:20 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:20.943214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.978682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.982437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:20.984675 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-846a0a61-63a4-4002-a21f-ae18c08d8170 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1414 microversion: 2.54 time: 0.472308 Aug 25 13:11:20.988056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2298/4532] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:20 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1414 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:21.059623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:21.065644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:21.083477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.085056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.086273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:21.088719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.090318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.091559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:21.172222 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-416aff48-4f84-4553-8586-e3ea6a067293 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126808 Aug 25 13:11:21.175287 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2235/4533] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:21 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:21.860277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:21.881847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:21.919279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.929602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.933692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:21.935499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:21.936551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:21.939879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.042872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:22.052917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:22.108505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.126588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.128534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.149903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.151043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.152204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.538316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:22.563017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:22.573153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:22.579857 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-58241300-442b-498e-b76e-d66a8ea6177b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.726718 Aug 25 13:11:22.582954 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2299/4534] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:21 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:22.593369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:22.599120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:22.611864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.614664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.616211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.618103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:22.619220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:22.620609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:22.743957 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef1ab170-b3fa-43b6-8813-9c52b4dfbf9e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157749 Aug 25 13:11:22.745558 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2300/4535] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:22 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:11:23.037217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:23.038154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:23.080231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:23.087036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:23.092426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:23.098378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:23.099684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:23.100894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:23.167812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:11:23.233729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:23.266795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:23.271097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:23.278791 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19800994-bb42-45f7-986e-4301edc7b43d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1414 microversion: 2.54 time: 1.241960 Aug 25 13:11:23.280383 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2236/4536] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:22 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1414 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:23.478732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-994a153c-6102-42c0-86fe-b296a7ef5f5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 204 len: 0 microversion: 2.1 time: 0.443010 Aug 25 13:11:23.489949 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2301/4537] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:11:23 2022] DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:11:23.524635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:23.526745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:23.577015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:23.578400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:23.582877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:23.588893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:23.590614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:23.596430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:23.916374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-599847592", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:24.084462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.087421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:11:24.088867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:11:24.090083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:11:24.091210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:11:24.092874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:11:24.105056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-777f7231-4495-4700-a0cf-3f6030c5aec6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1681 microversion: 2.1 time: 0.609277 Aug 25 13:11:24.106239 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2302/4538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:23 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1681 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:24.126787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.128270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.129555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.131594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.132866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.133965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.143198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:24.145307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:24.167568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.168493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.169317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.170631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.171493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.177466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.184074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Getting quotas for project c1ccaa32b0154d4689be90562fcf1641. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:11:24.199450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Getting quotas for user fe4fb3e346c24796a2c70592df24b527 and project c1ccaa32b0154d4689be90562fcf1641. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:11:24.230612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:11:24.235962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:11:24.488482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d0819e5-237c-458e-93d2-a6ac7c58575f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.064200 Aug 25 13:11:24.509573 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2237/4539] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 13:11:24.535328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:24.537306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:24.559565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.568256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.569679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.576835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:24.578169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:24.583330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:24.635766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.669796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.673270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.686116 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c08eb423-1a92-4e7b-a945-81be4663b517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.563036 Aug 25 13:11:24.700190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2303/4540] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:24 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:24.700190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:24.712224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:24.899718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.941210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.944105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:24.978143 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b6dc119-3fa2-41a8-a0af-13f4c185b3a3 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 200 len: 1277 microversion: 2.47 time: 0.279062 Aug 25 13:11:24.979304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2304/4541] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:24 2022] GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 1277 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:25.002346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:25.053529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:25.057088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:25.059850 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b934020-4b02-43bb-a147-698801ec9e48 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1399 microversion: 2.54 time: 0.548105 Aug 25 13:11:25.061080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2238/4542] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:24 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1399 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:25.111905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb57c1ef-1c4f-40c7-9e00-733aa4f90c82 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '.version_select at 0x7fc6c17a2c10>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:25.153698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:25.158086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:25.199755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.200830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.202530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.204105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.204907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.205608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.258637 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb57c1ef-1c4f-40c7-9e00-733aa4f90c82 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-933429167" status: 204 len: 0 microversion: 2.54 time: 0.153522 Aug 25 13:11:25.260747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2305/4543] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 13:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-933429167 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:11:25.311371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-283242608", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": "none"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:25.572336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:11:25.575931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:11:25.582013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:11:25.585606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:11:25.588884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:11:25.617613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.620466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.622557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.626205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.628549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.630205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.651352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:25.682282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Getting quotas for project c1ccaa32b0154d4689be90562fcf1641. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:11:25.702936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Getting quotas for user fe4fb3e346c24796a2c70592df24b527 and project c1ccaa32b0154d4689be90562fcf1641. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:11:25.712322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:25.739878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:11:25.746464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:11:25.761406 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d01067f0-f3f3-4882-ab59-2310f9f566e3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1681 microversion: 2.1 time: 0.617477 Aug 25 13:11:25.774982 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2239/4544] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:25 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1681 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:25.796920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:25.797282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:25.820263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.820612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.821341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.822790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:25.823676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:25.824502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:25.945247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:11:26.023908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25f42d15-16ff-4655-8a6c-155a183087e2 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.760532 Aug 25 13:11:26.025550 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2306/4545] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:11:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:11:26.058413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:26.059527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:26.092480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.094133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.099076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.101393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.102442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.105271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.460498 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d58ca56b-277a-4a57-9dc9-23dc1daf526d tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 204 len: 0 microversion: 2.54 time: 0.671683 Aug 25 13:11:26.462801 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2240/4546] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:11:25 2022] DELETE /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:11:26.484099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d79d99c5-d176-4f8f-abf6-54ff69d50284 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:26.491609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d79d99c5-d176-4f8f-abf6-54ff69d50284 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:26.627371 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d79d99c5-d176-4f8f-abf6-54ff69d50284 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "PUT /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 991 microversion: 2.47 time: 0.161671 Aug 25 13:11:26.629651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2241/4547] 10.222.0.60 () {62 vars in 1297 bytes} [Thu Aug 25 13:11:26 2022] PUT /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 991 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:11:26.669821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:26.683468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:26.828260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.858431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.861303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:26.881589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:26.882600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:26.895329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:27.766337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:27.800911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:27.814292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:27.823266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-857e1469-5246-4f71-ad29-c27a3308bef1 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1405 microversion: 2.54 time: 1.162939 Aug 25 13:11:27.825586 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2242/4548] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:26 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1405 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:27.890583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:27.891475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:28.135189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.188025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.195321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.201347 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1a7a194-9cbf-4999-b3f1-ea20d72b0cf2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 2.174170 Aug 25 13:11:28.209378 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2307/4549] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:26 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:28.240483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:28.249916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:28.286934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:28.297789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:28.299157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:28.304772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:28.306275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:28.310173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:28.525399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.564855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.575440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:28.582844 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d298743-6090-4efa-93d9-79cc816a24cc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1277 microversion: 2.47 time: 0.742441 Aug 25 13:11:28.584688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2243/4550] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:27 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1277 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:28.892509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:28.894087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:28.957784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:28.958721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:28.959613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:28.976908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:28.977888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:28.978757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:29.537273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:29.590173 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46b8badc-8bdf-43ed-9271-f319297eb984 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1681 microversion: 2.1 time: 1.376598 Aug 25 13:11:29.620363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2308/4551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:28 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1681 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:29.645422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:29.657618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:29.692137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:29.700995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:29.702430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:29.704289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:29.705593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:29.709319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:30.252573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.288758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.292799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e91f51b3e3347d790722fd3d918b3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '343ca8ab890942228adef695450e7f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.295798 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6de73e6d-de5e-44eb-9095-89b7d71718d6 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 200 len: 1405 microversion: 2.54 time: 1.422820 Aug 25 13:11:30.301943 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2244/4552] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:28 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 1405 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:30.322921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:30.329185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:30.369361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.375757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.376825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:30.378817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.389447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.390338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:30.706686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.720803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.758957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.770574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.780893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.783149 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39349a8c-76c0-4b62-b22f-ec9a395269d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 1.160544 Aug 25 13:11:30.785426 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2309/4553] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:29 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:30.800458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:30.805300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:30.813687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:30.818291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f26cffb3-6349-4f61-98d9-8f38e53be91e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1329 microversion: 2.47 time: 0.513726 Aug 25 13:11:30.824369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2245/4554] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:30 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1329 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:30.840729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.841773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.843137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:30.844981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:30.847808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:30.850198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.386315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:31.386633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:31.393364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] [instance: 0c57af3c-1e29-4b00-aa2c-ceff8b89a573] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:31.444893 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72bb2adf-fedc-475f-bda8-d1defaddd83d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1614 microversion: 2.1 time: 0.644049 Aug 25 13:11:31.444893 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2310/4555] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:30 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1614 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:31.447645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.486128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.487487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.489100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.490631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.492043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.532234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] HTTP exception thrown: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Request method failure captured: Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 HTTP/1.1 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3TFjgfBTLEW72tJ1ejUdF6E-8DwYVfEBVA0gyQwPeXFeTBV97O7QKeALGoWJcwif8RfymIwwUJuhWZdI-fHYpUcbMj5I8qiN7TAwf8F6_45YY2GAHYVkNJdLzp-zNNGzd0vhjNVozTeMn9qmTwMO-XS_pkMMHoj2jEo0SCmgWNHDzQ Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.54 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 343ca8ab890942228adef695450e7f7a Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerShowV254Test-64786865 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_343ca8ab890942228adef695450e7f7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/343ca8ab890942228adef695450e7f7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/343ca8ab890942228adef695450e7f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/343ca8ab890942228adef695450e7f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerShowV254Test-64786865 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 343ca8ab890942228adef695450e7f7a Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerShowV254Test-64786865 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerShowV254Test-64786865-project Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2e91f51b3e3347d790722fd3d918b3d4 Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerShowV254Test-64786865-project Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0c57af3c-1e29-4b00-aa2c-ceff8b89a573'} Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:31.538081 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. Aug 25 13:11:31.547263 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:31.550209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] Returning 404 to user: Instance 0c57af3c-1e29-4b00-aa2c-ceff8b89a573 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:31.553394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbc6f836-9b2c-4162-a467-384fb9993e09 tempest-ServerShowV254Test-64786865 tempest-ServerShowV254Test-64786865-project] 10.222.0.60 "GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573" status: 404 len: 111 microversion: 2.54 time: 0.202413 Aug 25 13:11:31.571991 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2246/4556] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:31 2022] GET /compute/v2.1/servers/0c57af3c-1e29-4b00-aa2c-ceff8b89a573 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:11:31.842463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:31.848207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:31.873724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:31.874905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:31.901686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.905471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.905830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.906683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.911486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.912374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.912927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.913784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:31.913970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.914652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:31.918119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:31.928415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.263481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.282042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.299152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.309686 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee80e9b6-1394-4524-aece-576c3f2cfb8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1337 microversion: 2.47 time: 0.444509 Aug 25 13:11:32.314798 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2247/4557] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:31 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1337 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:32.489913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:32.494084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:32.512910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.514363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.515494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.517876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.519957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.521832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.653441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.688108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.703696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.709835 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b10591ce-5c6b-478b-b6f9-3f649b36429c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.874887 Aug 25 13:11:32.717051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2311/4558] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:31 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:32.745587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e11534e-e7d6-4476-97ba-107c7b14e4ce", "name": "network-vif-deleted", "tag": "91cec168-3e7d-4bf2-904e-34af7e0941ea"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:32.791952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:32.793510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:32.795120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:32.805724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:32.838099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b222eb8-bf11-41b1-908d-e48a3a3d75fb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1614 microversion: 2.1 time: 0.360614 Aug 25 13:11:32.839119 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] Creating event network-vif-deleted:91cec168-3e7d-4bf2-904e-34af7e0941ea for instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce on n-h1-850468-18 Aug 25 13:11:32.853756 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2248/4559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:32 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1614 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:32.876027 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3a47518f-88d8-4f82-aa45-bfe15bd3dfe9 req-8563c4bb-f516-4bbc-95c9-ebf2b3da883f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148851 Aug 25 13:11:32.885865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2312/4560] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:33.395266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:33.406118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:33.466595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:33.478613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:33.482529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:33.491524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:33.495961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:33.497223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:33.778109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:33.784624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:33.850433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:33.850766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:33.855196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:33.858055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:33.859540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:33.865028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:33.865887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:33.920570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:33.953426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:33.969883 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7a87db8-e09a-4559-8115-ab4ce265e3e7 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1337 microversion: 2.47 time: 0.592650 Aug 25 13:11:33.974125 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2249/4561] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:33 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1337 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:34.007827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:34.017627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:34.050406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.059119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.067080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.073534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:34.074879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:34.079093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:34.286690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:34.699210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:34.721139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:34.768072 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7405d571-61c1-4d10-932d-ebb5582a6699 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1326 microversion: 2.1 time: 0.790822 Aug 25 13:11:34.789271 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2250/4562] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:33 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1326 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:34.968209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.045459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.051158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.053961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:35.055312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:35.057227 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f792c36-e6a0-4eca-a63c-538a83021484 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 1.290625 Aug 25 13:11:35.059598 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2313/4563] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:33 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:35.091090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.091949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.092823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.103194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.104312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.106885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.382828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.423038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.430418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:35.438812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79888220-951c-4466-b724-8e5a950f04f5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1335 microversion: 2.47 time: 0.423672 Aug 25 13:11:35.460295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2251/4564] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:35 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1335 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:35.857063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:35.858312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:35.885555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:35.890866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:35.919064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.923155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.924355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:35.928104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:35.931540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:35.938026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.103160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.106006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.107180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.108505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:36.109613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:36.114527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lazy-loading 'fault' on Instance uuid 4e11534e-e7d6-4476-97ba-107c7b14e4ce {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:11:36.167141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.174799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.177720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.206845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.209113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.210209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.371296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:36.423026 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8a34885-6b96-4de0-8e8a-baf2cb770d65 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 200 len: 1331 microversion: 2.1 time: 0.594880 Aug 25 13:11:36.431901 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2314/4565] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:35 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 1331 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:36.500464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:36.505604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:36.527854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.529630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.530784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:36.532994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:36.536761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:36.539469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:37.041523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.058755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.073477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.090838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.097913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.103617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-77095d4c-8bf2-4128-9c4b-84d14bb192f0 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1335 microversion: 2.47 time: 0.608654 Aug 25 13:11:37.104934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:37.107235 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b78e43e-118e-4930-9fb1-f4dd37623a0a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 1.005798 Aug 25 13:11:37.108762 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2315/4567] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:36 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1335 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:37.119888 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2252/4567] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:36 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:37.475809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:37.479444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:37.496977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:37.498805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:37.500008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:37.502595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:37.504102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:37.505858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:37.544788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce HTTP/1.1 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4e11534e-e7d6-4476-97ba-107c7b14e4ce'} Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:11:37.549160 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:11:37.557983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:11:37.562211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:11:37.564610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-689af44f-cfc5-423d-9db9-f8245f587505 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 404 len: 111 microversion: 2.1 time: 0.098334 Aug 25 13:11:37.589096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0f56802-90f4-4b7a-b2ca-e99a88cdf362 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '.version_select at 0x7fc6c186b820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:37.590502 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2253/4568] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:37 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:11:37.645589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0f56802-90f4-4b7a-b2ca-e99a88cdf362 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617163862" status: 202 len: 0 microversion: 2.1 time: 0.067111 Aug 25 13:11:37.667490 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2316/4569] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617163862 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:11:38.171153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:38.189421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:38.251376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.253027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.253995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:38.257857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.269757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.273994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:38.555511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:38.848323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae4007d9-4e4d-4f6f-8574-154d1c73ac61 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] Calling method '.version_select at 0x7fc6c2e4e820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:38.854905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:38.897093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:38.902340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:38.904822 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb469de8-a1ac-47f4-99cd-57ecfac99802 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1335 microversion: 2.47 time: 0.752472 Aug 25 13:11:38.906883 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2317/4570] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:38 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1335 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:38.923584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:38.929921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:38.950086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.951572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.953551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:38.955342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:38.958601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:38.960182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:39.095888 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae4007d9-4e4d-4f6f-8574-154d1c73ac61 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.966258 Aug 25 13:11:39.098160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2254/4571] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 13:11:38 2022] GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2/defaults => generated 371 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:39.121248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-656aacbf-9fc2-4145-9176-5410997485ee tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] Calling method '.version_select at 0x7fc6c341d280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:39.368690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-656aacbf-9fc2-4145-9176-5410997485ee tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2" status: 200 len: 371 microversion: 2.1 time: 0.257328 Aug 25 13:11:39.392292 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2255/4572] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 13:11:39 2022] GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2 => generated 371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:39.425027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a41cf85-cddb-449d-9392-f2bb96489488 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] Calling method '.version_select at 0x7fc6c2acab80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:39.607049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a41cf85-cddb-449d-9392-f2bb96489488 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.208157 Aug 25 13:11:39.611589 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2256/4573] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 13:11:39 2022] GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2/defaults => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:39.642335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84d2aed9-52b0-47b9-907d-62ab081ec6d7 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] Calling method '.version_select at 0x7fc6c2aca670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:39.689218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:39.736426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:39.748595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:39.751792 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09f9bde2-4d51-44ff-bb87-0794f89d5a11 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.837323 Aug 25 13:11:39.756951 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2318/4574] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:38 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:39.923043 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84d2aed9-52b0-47b9-907d-62ab081ec6d7 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2" status: 200 len: 371 microversion: 2.1 time: 0.294544 Aug 25 13:11:39.938726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2257/4575] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 13:11:39 2022] GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2 => generated 371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:39.966210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa09afff-2443-4aa1-878e-4674acb25fc4 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] Calling method '.version_select at 0x7fc6c17dd0d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:40.015258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:40.016545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:40.044022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:40.047029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:40.048102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:40.049681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:40.050659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:40.056394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:40.262416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:40.334084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:40.367999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:40.376271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:40.378963 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d408ed65-4cb9-43e3-a19a-294e1d5973fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1335 microversion: 2.47 time: 0.416537 Aug 25 13:11:40.408578 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2258/4576] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:39 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1335 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:40.426806 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa09afff-2443-4aa1-878e-4674acb25fc4 tempest-QuotasTestJSON-191584205 tempest-QuotasTestJSON-191584205-project] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2?user_id=70c4fb0860f449e6a581bd38b8778733" status: 200 len: 371 microversion: 2.1 time: 0.470812 Aug 25 13:11:40.430874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2319/4577] 10.222.0.60 () {58 vars in 1323 bytes} [Thu Aug 25 13:11:39 2022] GET /compute/v2.1/os-quota-sets/7fa5f3f9061a4642b3b68f69114b8ee2?user_id=70c4fb0860f449e6a581bd38b8778733 => generated 371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:40.736692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59c66d29-379f-4885-9f2c-2781b9bf1d37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: .version_select at 0x7fc6c6be5670>, body: {"keypair": {"name": "tempest-keypair-1452479651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF+EYZJRogmaqmgWt46mxeX/8gXNCQ/oA+N7zSIQUW03X9iDDFriHvyiVBRrcmYt8sbpQKseaponloNDgfARFizU7BE8QryCCTFyyFRLTsdr5O1TfBUiZgxX2EIATSEuA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:40.822379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:40.823450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:40.842795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-59c66d29-379f-4885-9f2c-2781b9bf1d37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:11:40.848067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:40.867085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:40.868692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:40.870400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:40.877015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:40.879049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:40.881910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-59c66d29-379f-4885-9f2c-2781b9bf1d37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:11:40.983468 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59c66d29-379f-4885-9f2c-2781b9bf1d37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248321 Aug 25 13:11:40.986885 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2259/4578] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:11:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:41.361481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.382299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.385914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.388727 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b40f4f7e-7253-464a-bd89-d09f6b3c9ac2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.586076 Aug 25 13:11:41.406628 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2320/4579] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:40 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:41.445098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:41.447414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:41.461375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.462526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.464788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:41.468331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.469472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.470534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:41.781362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.803584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.807606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:41.810687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a171241-ac26-447e-8ba4-f3ebf1071e62 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1356 microversion: 2.47 time: 0.379027 Aug 25 13:11:41.813140 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2260/4580] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:41 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1356 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:41.862807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:41.871108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:41.887163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.888944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.891354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:41.892851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:41.894665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:41.896278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.141468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:11:42.142279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:11:42.142822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:11:42.145121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:11:42.145924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:11:42.323206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:42.357119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.357941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.358708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.360098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.361059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.366923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.452260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:42.462691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:42.493594 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b6a7f8fc-e745-411f-b071-c8e4fc3c3872 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "POST /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a/action" status: 202 len: 1078 microversion: 2.47 time: 0.640800 Aug 25 13:11:42.501918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.510258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.512605 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2321/4581] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 13:11:41 2022] POST /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a/action => generated 1078 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 25 13:11:42.529600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.533031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:42.535510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:42.544318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.550799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.551943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.552755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.553920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.555505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.556078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:42.557388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:42.558559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:42.927185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:42.947657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:42.951593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:42.954373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4672de6b-68eb-4bc2-a57c-5bd4e042f568 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.428974 Aug 25 13:11:42.956920 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2322/4582] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:42 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:43.169273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.200583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.222061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:43.225030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f0ac3ce3-f930-411d-8d4c-336da0d66df7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1736 microversion: 2.20 time: 0.790217 Aug 25 13:11:43.232354 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2261/4583] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:42 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1736 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:44.005623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:44.007052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:44.023881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.026842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.027994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.030533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.031972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.033042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.276749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:44.283494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:44.287256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:44.301132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:44.318019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:44.322165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.325750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:44.327992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.331706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41534234-18e8-42a2-ad62-87dfc45b0971 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.332690 Aug 25 13:11:44.344153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2323/4584] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:43 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:44.354726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:44.356948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:44.357846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:44.358689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:45.390632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:45.407648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:45.430085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:45.461992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:45.463253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:45.464208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:45.480025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:45.484180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:45.485841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:45.487601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:45.493563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:45.527501 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee1eb594-7455-4fd0-9ec4-8cf285255de8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1718 microversion: 2.20 time: 1.251072 Aug 25 13:11:45.538721 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2262/4585] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:44 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1718 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:45.574968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:45.578660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:45.622284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:45.629613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:45.638714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:45.639546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:45.640931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:45.641871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:45.652238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:45.850219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea1a3911-c010-4b45-b315-7cbb5df37798 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.301909 Aug 25 13:11:45.859707 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2263/4586] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:11:45 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 197 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:45.886898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:45.887851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:45.979457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:45.983464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.002976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.018892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.021443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.026490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.051429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.081173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.085526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:46.088883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ba5ec16-b1ea-4555-95e2-07f9870a9d94 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.711552 Aug 25 13:11:46.090937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2324/4587] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:45 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:46.105153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1604397890", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a60d176-8c8c-4348-8828-aa3cd40d7203"}], "security_groups": [{"name": "tempest-securitygroup--1472092851"}], "key_name": "tempest-keypair-1452479651", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:46.170127 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74a87409-fa3d-4ead-8779-afbfe91ce511 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e" status: 200 len: 194 microversion: 2.1 time: 0.293398 Aug 25 13:11:46.172227 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2264/4588] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 25 13:11:45 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:11:46.217334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-unplugged", "status": "completed", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:46.304491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.305746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.306759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.346789 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] Creating event network-vif-unplugged:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:11:46.366415 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-64b3149c-1cf9-447b-ac1b-017ca3f26341 req-fb2e5874-d2b2-42a8-b62c-9ce164467f07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167458 Aug 25 13:11:46.368086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2265/4589] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:46.453092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] validate_networks() for [('2a60d176-8c8c-4348-8828-aa3cd40d7203', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:11:46.589930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:46.591167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:46.605178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.606748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.609360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:46.613209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:46.615226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:46.616514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:47.286396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:47.313629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:47.354727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:47.364487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7849cc68-84c5-4792-bb6c-1f1ebe8ed3e4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1718 microversion: 2.20 time: 0.782243 Aug 25 13:11:47.370959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2266/4590] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:46 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1718 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:47.402798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:47.410832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:47.473652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.474767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.475661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:47.477168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:47.478077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:47.492914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.175146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.206631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.214552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.222458 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-daf1f158-049e-4f8a-b17c-a21c934b4691 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.852015 Aug 25 13:11:48.240742 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2267/4591] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:47 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:48.424008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:48.434654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:48.466054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.477379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.478143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.479450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.480302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.481074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.809961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:11:48.813503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:11:48.815096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:11:48.817512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:11:48.819118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:11:48.842486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.854413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.857302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.858843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:48.859761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:48.860614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:48.899629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:11:48.913287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Getting quotas for user 916a9effd2334a1b909f03a6c7d0997a and project b0aae972b1104fe1b08c1cfa13f5ac99. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:11:48.942885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:11:48.948141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:11:48.957219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.981108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.986686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:48.989769 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3657a3df-130a-4c2e-a547-a2ea4d1c8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1721 microversion: 2.20 time: 0.572397 Aug 25 13:11:48.996579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2268/4592] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:48 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:49.038960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6dccd75-5c94-4e68-8d38-72fc86c216f3"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:49.044471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:49.065282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.068797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.070445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.071576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.072458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.073480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.087641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-806165ae-3e4b-4d9b-a6ad-ae7af2eb159d tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.985356 Aug 25 13:11:49.087641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2325/4593] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:11:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:11:49.132584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90ff3625-ea46-4b09-a378-3bd7f387e3c9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:49.136695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-90ff3625-ea46-4b09-a378-3bd7f387e3c9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:49.327823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90ff3625-ea46-4b09-a378-3bd7f387e3c9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.357946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90ff3625-ea46-4b09-a378-3bd7f387e3c9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1242 microversion: 2.1 time: 0.254524 Aug 25 13:11:49.359836 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2326/4594] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:49 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:49.395328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:49.397393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:49.419316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.420629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.422476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.427835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:49.429150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:49.430207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:49.643308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.718217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.723193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:49.726573 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50ed1080-6b8a-4d7d-8249-824a991b166e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.364182 Aug 25 13:11:49.729347 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2327/4595] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:49 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:50.056972 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43b55e01-44b3-4f8e-9ce8-de2e787fa6cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.027970 Aug 25 13:11:50.058922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2269/4596] 10.222.0.60 () {62 vars in 1364 bytes} [Thu Aug 25 13:11:49 2022] POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 188 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:11:50.379476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:50.388001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:50.405506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f37d025f-408d-4011-ad2b-997aec54bd40 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:50.407448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f37d025f-408d-4011-ad2b-997aec54bd40 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:50.413430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.414347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.415268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:50.425820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.429037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.430487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:50.529331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122701) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:11:50.579797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f37d025f-408d-4011-ad2b-997aec54bd40 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:50.607444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f37d025f-408d-4011-ad2b-997aec54bd40 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1242 microversion: 2.1 time: 0.212407 Aug 25 13:11:50.616330 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2270/4597] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:50 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1242 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:50.785682 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b736f7c1-2963-4ffa-a9b6-840a85dbf024 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/action" status: 202 len: 0 microversion: 2.20 time: 0.416682 Aug 25 13:11:50.789527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2328/4598] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 13:11:50 2022] POST /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:11:50.795620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:50.797293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:50.811569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:50.817245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:50.833393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.838792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.842027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:50.843531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.844961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.845968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:50.848206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.848840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:50.849950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.850945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:50.851770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:50.853448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.203424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.283134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.290433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.293490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ee491aa-c8af-4c07-8d79-cde65b5bba03 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.515356 Aug 25 13:11:51.309545 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2271/4599] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:50 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:51.345983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aab35bf-1dfa-4f25-b9ea-27479aab45ea"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:11:51.352024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:51.380567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.381467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.388648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.390511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.391407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.392321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.408588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:51.457840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.482423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.488580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.491204 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c278c01b-00b4-4306-99a5-708c4e28f95f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1747 microversion: 2.20 time: 0.693695 Aug 25 13:11:51.493091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2329/4600] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:50 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1747 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:51.658142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:51.669454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:51.706762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.707864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.708658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.709938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:51.710683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:51.711574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:51.878857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:51.920608 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0da1ff15-d011-4dcc-81f9-cb3dccb43b19 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1294 microversion: 2.1 time: 0.277449 Aug 25 13:11:51.937858 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2330/4601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:51 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1294 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:52.351606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:52.353363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:52.359955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-087fb2f6-35be-4bc0-9bf6-74e52a58766b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "POST /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047514 Aug 25 13:11:52.369249 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2272/4602] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:11:51 2022] POST /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:52.387204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:52.390549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:52.392003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:52.398652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:52.399571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:52.400459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:52.559470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:52.567637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:52.615168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:52.616629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:52.628820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:52.636475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:52.637829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:52.646159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:52.903880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:52.928576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:52.931376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:52.934185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f3a5c73-a725-460a-81be-a26cb0ec5d9c tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.591110 Aug 25 13:11:52.941730 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2331/4603] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:52 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:52.997707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:53.008149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.015789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Searching by: {'deleted': False, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:11:53.039265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.040553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.041924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.043599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.044511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.045319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.149651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:11:53.288743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c1dd7c8-18f5-4f86-9da2-ed300e07d669 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.309877 Aug 25 13:11:53.289781 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2332/4604] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 13:11:52 2022] GET /compute/v2.1/servers => generated 340 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:53.312646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:53.313954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:53.338558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.346892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.348184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.349845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.350948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.352025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.830046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.871294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.883641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4e2885a-359c-4ece-a8da-00999d7b79e0 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1300 microversion: 2.1 time: 0.584668 Aug 25 13:11:53.885855 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2333/4605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:53 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1300 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:53.916316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:53.925538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.926459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.928516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Searching by: {'deleted': False, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:11:53.931897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:53.950471 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22b3e105-7cfc-44b8-8caf-53c87bc42431 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1747 microversion: 2.20 time: 1.414876 Aug 25 13:11:53.950853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.952536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.953933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.956772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:53.958355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:53.959811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:53.978003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2273/4606] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:52 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1747 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:54.017024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:54.030236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:54.068326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.073686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.077326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.089205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.090833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.097347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.136058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:11:54.294039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.318378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.319195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.320062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.554174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.575590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.578654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:54.582098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-427c6ec1-875b-4d81-beb6-03d88f5f9b58 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.579914 Aug 25 13:11:54.583144 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2274/4607] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:53 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:54.941597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:54.944496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:54.962104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.963655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.966211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:54.968485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:54.969579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:54.970416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.101368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af5edd46-3c5a-48b5-a3b1-898467dbc3b0 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.208854 Aug 25 13:11:55.105939 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2334/4608] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:11:53 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:55.123792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:55.128530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:55.152799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.154231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.155671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.158006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.159879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.161361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.196408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:55.220076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ae876e9d-4794-4457-af6d-51d27b2c1ef8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1300 microversion: 2.1 time: 0.288683 Aug 25 13:11:55.221115 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2275/4609] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:54 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1300 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:55.252931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a93a068-72b8-4a9d-96a1-1bd124181591 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:55.321244 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a93a068-72b8-4a9d-96a1-1bd124181591 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.094603 Aug 25 13:11:55.326812 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2276/4610] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 13:11:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:11:55.634412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:55.639017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:55.703738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:55.719570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.721994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.726446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.731673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.737598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.739498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:55.740391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.743755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:55.765185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7be6c58-0cf1-4f8d-a1fa-3c790dd5e3e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.654768 Aug 25 13:11:55.766157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2335/4611] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:55 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:55.819242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:55.820235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:55.847016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.847932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.848839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.850605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:55.851581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:55.865012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:55.988890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:11:56.145255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:56.193562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:56.204461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:56.218105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2769a7b2-d314-4c02-b0e5-b153c65a02ee tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.592994 Aug 25 13:11:56.220019 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2277/4612] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:55 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:56.277360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:56.281201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:56.336164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.339394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.342796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.351984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.355596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.356840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.410605 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1cf440f1-b248-4562-936c-067b880ef9b7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 204 len: 0 microversion: 2.1 time: 0.604093 Aug 25 13:11:56.423148 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2336/4613] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:11:55 2022] DELETE /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:11:56.467144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:56.468829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:56.526451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.526811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.530973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:56.541264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:56.542373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:56.543192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.073057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.102988 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68635ed4-6393-412a-bad4-7735a1c5fad7 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1714 microversion: 2.1 time: 0.670318 Aug 25 13:11:57.114766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2337/4614] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:56 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1714 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:11:57.128139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:57.138252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:57.164381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.178048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.180449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.187998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.190952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.195353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.197318 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ae8d525-291e-4828-a09f-834d39ad236f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.933184 Aug 25 13:11:57.199659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.210805 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2278/4615] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:56 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:57.253372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:11:57.277264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:57.278851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:57.303534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.306727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.308066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.316792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:57.321294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:57.324830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:57.616870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.661800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.665097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.679341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-786221d7-4064-4359-8546-1b53cceea1ab tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.411126 Aug 25 13:11:57.697594 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2279/4616] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:57 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:11:57.931538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:57.996152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:58.015072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:58.017781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a47e2ab-a3f0-47f6-85a5-ad13b77735d6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.900554 Aug 25 13:11:58.044783 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2338/4617] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:57 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:11:58.173240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:58.173240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:58.199972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.203131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.206996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.210040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.212976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.214200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.244108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:58.245881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:58.290539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.298927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.300920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:58.302624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:58.304431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:58.311283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:59.416789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.444884 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e061fa9b-00f7-4b19-b84b-d546e64ae044 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 1.208799 Aug 25 13:11:59.451884 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2339/4618] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:58 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:59.475783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:59.478832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:59.501775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:59.509144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:59.510673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:59.515274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:59.519334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:59.520816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:59.532901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.601154 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b3d7392-5f91-42bf-aa45-b0f887a85d9b tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1714 microversion: 2.1 time: 1.453385 Aug 25 13:11:59.616687 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2280/4619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:11:58 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1714 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:11:59.649456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:11:59.650544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:11:59.675840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:59.676772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:59.677618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:59.678965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:11:59.679921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:11:59.696766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:11:59.792347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.840102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.855789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:11:59.869159 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1f272c6f-3b0b-43a3-b0d8-af6cd1e5c982 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.399817 Aug 25 13:11:59.878673 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2340/4620] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:59 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:00.466502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.508676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:00.509980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:00.538087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.545292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:00.550451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a1fbfe00-99dc-4ebe-bd0e-9362cd077faa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.930148 Aug 25 13:12:00.556702 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2281/4621] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:11:59 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:00.576797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.592856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.604891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:00.608867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.611108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.618774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:00.661097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:00.663835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:00.690628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:00.694441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.699576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.701894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:00.706846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:00.707924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:00.708965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:01.515921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:01.577068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-400c2d4a-d94c-4969-b873-cd2bd22e4d5e tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1647 microversion: 2.1 time: 0.915982 Aug 25 13:12:01.640579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2282/4622] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:00 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1647 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:01.675214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:01.680775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:01.727609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:01.730860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:01.737706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:01.741857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:01.748621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:01.753086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:02.894558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:02.922828 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43355521-109e-4df4-92a5-c66cfd9081a9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 2.433598 Aug 25 13:12:02.931020 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2341/4623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:00 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:02.943459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:02.977992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:02.979341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e35515f-2174-40a1-b6f6-2a2858d829bb", "tag": "d3e51f2e-a5ca-4e38-9882-59c845c95372"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:02.999831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:03.028068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6b8846c-2d36-484a-85da-9c93bb5cb247 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 1.381595 Aug 25 13:12:03.048710 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2283/4624] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:01 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:03.076867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.080249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:03.087529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.088723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.092498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:03.114743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.116466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.117919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.120644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.122105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.123311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.224590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] Creating event network-changed:d3e51f2e-a5ca-4e38-9882-59c845c95372 for instance 5e35515f-2174-40a1-b6f6-2a2858d829bb on n-h1-850468-18 Aug 25 13:12:03.254906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-610b2ebf-23b0-436d-b01f-8d32ed43e2d4 req-ebaf1ff8-6980-432a-b6d8-bf611c63d5b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305039 Aug 25 13:12:03.256560 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2342/4625] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:03.292641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d88aed8-bb9c-45ee-9049-d1f322d5d839", "name": "network-vif-deleted", "tag": "a551e200-5a33-4f4d-8c71-ad3cbfefaf20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:03.328185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.340703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.342165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.414528 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] Creating event network-vif-deleted:a551e200-5a33-4f4d-8c71-ad3cbfefaf20 for instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 on n-h1-850468-18 Aug 25 13:12:03.437146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a3771d42-c9c1-4a9e-b7bc-9ea37f18b121 req-2a3ae80c-8a6a-4988-b3f9-5efe5dee0fa8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172055 Aug 25 13:12:03.460255 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2343/4626] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:03.483588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:03.497321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:03.522576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.523492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.524368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.525885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.526752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.527240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.713558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:03.714969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:03.716226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:03.717413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lazy-loading 'fault' on Instance uuid 7d88aed8-bb9c-45ee-9049-d1f322d5d839 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:03.973473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:04.160108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d73b9062c10487abbf224443bb8f8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6cbe746ff684406b96f4f93b5ff425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:04.210610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61df396c-e37c-4b44-b73e-1d504d188166 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 200 len: 1368 microversion: 2.1 time: 0.740264 Aug 25 13:12:04.212190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2344/4627] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:03 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 1368 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:04.273192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:04.275123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:04.278783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:04.300709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.303913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.305679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.308763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.312892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.315775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.578554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:04.622052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:04.632705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:04.635271 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43cfa97d-c182-4c62-91a2-832e0413e423 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.581666 Aug 25 13:12:04.636962 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2284/4628] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:03 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:04.659412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:04.677945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:04.711186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.713565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.714690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:04.716361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:04.717872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:04.719219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:05.024786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:05.064641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:05.071989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:05.077329 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-048bc34f-a7a0-4eb6-bdbd-fa8bdcf6e55e tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.427329 Aug 25 13:12:05.078349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:05.100587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2285/4629] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:04 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:05.105983 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3a76cb1-ee6f-40be-91d0-08ed6a6e5da2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.876712 Aug 25 13:12:05.117276 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2345/4630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:04 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:05.269320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:05.272766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] [instance: 7d88aed8-bb9c-45ee-9049-d1f322d5d839] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:05.308481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:05.310212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:05.312628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:05.317070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:05.319510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:05.322032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:05.372718 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] HTTP exception thrown: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Request method failure captured: Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 HTTP/1.1 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3SjyUY7dQiOXXLERG8Ih0U64nFZf01wDIsgW4wdSJyXZ8TkBskvgt53JxVnMQjQ2bwMZ1tqLfInVMw1W9FiVGFvStSm44gN_umkBaUqJMg4zPQFjoLaKRoj6hG6iQuvehPDOMj5B_rT1Ivx3EZy_mRqv5Mi099jy7ntFwW-2n8LMvo Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d6cbe746ff684406b96f4f93b5ff425b Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersTestManualDisk-600400690 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d6cbe746ff684406b96f4f93b5ff425b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d6cbe746ff684406b96f4f93b5ff425b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d6cbe746ff684406b96f4f93b5ff425b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d6cbe746ff684406b96f4f93b5ff425b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersTestManualDisk-600400690 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d6cbe746ff684406b96f4f93b5ff425b Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersTestManualDisk-600400690 Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersTestManualDisk-600400690-project Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 2d73b9062c10487abbf224443bb8f8ee Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersTestManualDisk-600400690-project Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7d88aed8-bb9c-45ee-9049-d1f322d5d839'} Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:05.381546 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Returning 404 to user: Instance 7d88aed8-bb9c-45ee-9049-d1f322d5d839 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-052c397e-9139-4a54-817b-f18f0d95c572 tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839" status: 404 len: 111 microversion: 2.1 time: 0.123774 Aug 25 13:12:05.390574 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2286/4631] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:05 2022] GET /compute/v2.1/servers/7d88aed8-bb9c-45ee-9049-d1f322d5d839 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:12:05.401140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-712cf963-7839-4e3d-bcff-8d190a2ac0de tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] Calling method '.version_select at 0x7fc6c1eb4310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:05.454083 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-712cf963-7839-4e3d-bcff-8d190a2ac0de tempest-ServersTestManualDisk-600400690 tempest-ServersTestManualDisk-600400690-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648735347" status: 202 len: 0 microversion: 2.1 time: 0.060745 Aug 25 13:12:05.456024 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2346/4632] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 13:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648735347 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:12:05.688905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:05.703849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:05.733152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:05.744021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:05.745796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:05.750810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:05.751910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:05.754002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:06.139903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:06.146233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:06.175038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:06.193565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:06.195041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:06.196509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:06.206711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:06.208314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:06.209694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:06.338355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.377045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.389044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.395104 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c3afae5-80e5-4e54-ae1d-ed54a24b7614 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.715889 Aug 25 13:12:06.404071 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2287/4633] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:05 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:06.482713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.516089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.521989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:06.525058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d285ca0-24c4-4c26-8895-9a0c62814827 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.394933 Aug 25 13:12:06.531329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2347/4634] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:06 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:07.216335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:07.233694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:07.306978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.308591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.309715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.311542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.317934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.319304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.463605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:07.477350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:07.553685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.556788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.558969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:07.569714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:07.570865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:07.571787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.126733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.167631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.176574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.183689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7bc40abf-a05f-43fc-89a2-ef9da36ab483 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.733531 Aug 25 13:12:09.196754 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2348/4635] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:07 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:09.210414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:09.212367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:09.241472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:09.242871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:09.244317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.249765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:09.250950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:09.251476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:09.389022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:09.419557 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f5fe8378-fcd3-4017-85ee-418dbacf3843 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 3.009849 Aug 25 13:12:09.422791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2288/4636] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:06 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:10.105315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:10.179785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:10.220726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:10.235008 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f3fa7b0-e99f-47c4-9c38-b4c0961c4889 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 1.035655 Aug 25 13:12:10.268159 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2349/4637] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:09 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:10.268519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:10.268519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:10.288707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.290118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.291349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.293609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.295925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.297988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.334810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:10.468540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:10.478848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:10.535278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.543587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.544592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:10.553946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:10.562401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:10.564201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:11.248574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.296496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.304349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.314239 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a1641640-7085-4543-b858-5c1fd9fad08b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.083696 Aug 25 13:12:11.315850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2289/4638] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:10 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:11.367740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:11.374471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:11.407037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:11.415268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:11.416548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:11.421775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:11.423282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:11.426940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:11.590465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.652954 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24bfd836-980d-4ddb-86f3-9c2e3fa5954b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 1.193587 Aug 25 13:12:11.663969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2350/4639] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:10 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:11.704158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.749581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.759825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:11.765290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1cf7828-e389-4745-a475-b33277f66756 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.409208 Aug 25 13:12:11.783059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2290/4640] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:11 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:12.366708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:12.367653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:12.395507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.406425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.407752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.410316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.411502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.412629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.736962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:12.754609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:12.808284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.815875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.818700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:12.824873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:12.829317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:12.832411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:13.011438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.068219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.087495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.112741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7577dc8a-c291-4580-bdfc-e21ad10b7191 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.738011 Aug 25 13:12:13.120937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2351/4641] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:12 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:13.162946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:13.174047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:13.207133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:13.207605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:13.209887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:13.210954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:13.211794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:13.224057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:13.425102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.498702 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a5dd541-77ff-433a-8666-aea81541aa5a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.790487 Aug 25 13:12:13.501794 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2291/4642] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:12 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:13.599431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.687705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.704661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:13.708615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5cf1f9ce-3034-4e6f-baf2-4f751d321e09 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 0.578632 Aug 25 13:12:13.710201 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2352/4643] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:13 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:14.039992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e35515f-2174-40a1-b6f6-2a2858d829bb", "name": "network-vif-plugged", "status": "completed", "tag": "d3e51f2e-a5ca-4e38-9882-59c845c95372"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:14.091221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.103874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.104976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.153750 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] Creating event network-vif-plugged:d3e51f2e-a5ca-4e38-9882-59c845c95372 for instance 5e35515f-2174-40a1-b6f6-2a2858d829bb on n-h1-850468-18 Aug 25 13:12:14.199814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6dd4b8a2-9e69-48a0-92a4-3b54da5192ff req-6a34ca03-99d4-46be-aed7-d75398fbe074 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176380 Aug 25 13:12:14.200626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:14.203249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:14.208464 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2292/4644] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:14.241992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.253703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.255373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.257627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.259575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.280033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.563217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:14.569574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:14.611093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.614500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.615258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.622186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:14.623399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:14.624480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:14.939523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:14.991296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:14.995051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:15.008801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99397837-dea1-46a5-93a9-f371f10ff6a5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.836703 Aug 25 13:12:15.033317 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2353/4645] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:14 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:15.090002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:15.104601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:15.131719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:15.155152 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f5adcbe8-a3f4-4e37-bacc-abaf5c2588bf tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.610752 Aug 25 13:12:15.165205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.175927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.180750 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2293/4646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:14 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:15.186585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:15.193870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:15.204161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:15.217060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.050358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:16.074404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:16.077501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:16.089846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=64 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:16.094039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:16.095362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:16.097184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.099215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:16.099471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:16.100318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:16.101630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.108842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:16.125604 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1de8710-47d2-4222-b34e-8dfa13261c15 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1365 microversion: 2.47 time: 1.076574 Aug 25 13:12:16.131993 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2354/4647] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:15 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1365 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:16.213170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:16.215712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:16.251652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:16.253081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:16.254157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:16.255779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:16.271991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:16.274573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:17.262031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.307900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ac6afef-a847-4637-be8a-74dc16a8505c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 1.107464 Aug 25 13:12:17.309076 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2355/4648] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:16 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:12:17.341454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:17.349781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:17.381871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:17.383379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:17.384866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:17.387773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:17.395944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:17.397904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:17.534390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.581282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.591107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.594488 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e14e3f5-229f-4872-aeda-f50c1d37949b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.527625 Aug 25 13:12:17.601324 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2294/4649] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:16 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:17.713691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.761275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.764480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:17.774795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-354de945-327d-4a18-99e2-b61c1a18dc55 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1371 microversion: 2.47 time: 0.449658 Aug 25 13:12:17.781803 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2356/4650] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:17 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:18.353452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:18.354822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:18.391349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.392278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.393140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.394446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.395263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.409577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.657047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:18.658158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:18.691208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.692696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.696521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.698335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:18.711206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:18.712604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:18.719508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=100 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:19.120168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.147231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b4cd54e-0d18-467e-8825-91ccf05db83e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.800713 Aug 25 13:12:19.150452 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2295/4651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:18 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:19.175565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:19.177466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:19.194430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.196429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.197863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.199744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:19.204647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:19.206933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:19.716046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.717407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.766482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.770417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.782162 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9db9ef2f-a9aa-43df-ae92-15e8132f41d4 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1371 microversion: 2.47 time: 0.628598 Aug 25 13:12:19.782747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.787420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:19.788457 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2296/4652] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:19 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1371 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:19.791308 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fdb8068c-eebb-4a84-9fb9-42161c5716c3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.148062 Aug 25 13:12:19.794266 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2357/4653] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:18 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:20.216743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:20.219746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:20.237450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.238500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.239386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.240712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.242438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.247700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.867473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:20.881221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:20.922986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.924776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.933137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.935192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:20.936387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:20.937614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:20.983647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.022047 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bcf62b4f-64e6-41dc-997e-48304f5fba0b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1368 microversion: 2.1 time: 0.829458 Aug 25 13:12:21.038685 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2297/4654] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:20 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1368 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:21.070449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:21.077685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:21.095595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:21.116329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:21.118022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:21.120290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:21.123954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:21.132070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:21.235372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.276344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.285520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.292610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc97f739-38b2-42ad-8ad4-5cf99bf511d5 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1371 microversion: 2.47 time: 0.432525 Aug 25 13:12:21.296408 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2358/4655] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:20 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:21.769429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.819388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.823140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:21.842176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b343b6eb-c8fe-438d-8dc4-5514768fb3ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 0.799244 Aug 25 13:12:21.843313 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2298/4656] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:21 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:22.093031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:22.094525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:22.137387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.153649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.153649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.153649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.154616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.155458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.350221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:22.356327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:22.389319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.391898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.394662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.402271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.403565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.405564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.704756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.706687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.742740 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cdd2dc01-2069-4984-bf95-aae30f20dd85 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1558 microversion: 2.1 time: 0.652167 Aug 25 13:12:22.750102 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2359/4657] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:12:22 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1558 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:12:22.751665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.755183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.765459 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad16438c-a811-4d4a-b520-3b2b73fc731f tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1356 microversion: 2.47 time: 0.427742 Aug 25 13:12:22.766555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2299/4658] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:22 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1356 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:22.803305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:22.804359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:22.823306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:22.840639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:22.842858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Searching by: {'deleted': False, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641'} {{(pid=122700) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 13:12:22.845089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.854480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.855876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.865427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.865735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.866599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.866995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.867795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.871895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:22.874273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:22.875511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:22.877707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.185147 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e6cf2d3-d6d1-4a7e-a978-a2501d478b0e tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.398488 Aug 25 13:12:23.187407 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2360/4659] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:12:22 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-interface => generated 284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:23.220155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:23.228153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:23.255092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:23.257504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:23.258916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.261652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:23.263194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:23.264451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.546850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.multi_cell_list [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122700) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 13:12:23.906370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:23.952308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:23.954189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:23.956928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:23.998765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:24.010487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:24.217265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ee37c84-73e1-4a55-9a65-796828046b60 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.403012 Aug 25 13:12:24.218595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2300/4660] 10.222.0.60 () {60 vars in 1187 bytes} [Thu Aug 25 13:12:22 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:24.294206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:24.305158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:24.326909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:24.327926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:24.328891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:24.330613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:24.331734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:24.332637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:24.424683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:12:24.495429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:24.516557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:24.520527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:24.522838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-210d7411-2759-4ec4-b827-030591a3f239 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1749 microversion: 2.20 time: 1.331586 Aug 25 13:12:24.533051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2361/4661] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:23 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1749 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:24.783823 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b04dd16-4342-4928-9c7b-a6195584fa77 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 204 len: 0 microversion: 2.47 time: 0.496157 Aug 25 13:12:24.787216 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2301/4662] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:12:24 2022] DELETE /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:12:24.808710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:24.811132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:24.869280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:24.870863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:24.872042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:24.875360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:24.876748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:24.877839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.415344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.449591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.453971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:25.463559 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00baa00e-4523-4119-a893-d5ecbb397c8b tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1362 microversion: 2.47 time: 0.662267 Aug 25 13:12:25.472638 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2362/4663] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:24 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:25.589463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:25.595475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:25.613046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:25.615279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:25.616743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:25.618988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:25.620389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:25.621619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.005680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.012503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:26.038297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.040600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.041742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.044297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.045441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.046482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.117326 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f87591b-671d-47bd-88f1-d9097bda4b88 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.122525 Aug 25 13:12:26.128204 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2363/4664] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:12:25 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:26.290663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.292272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:26.307429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.309064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.310431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.312880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.314137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.315919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.396272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e036c29-9bef-482e-a522-6ea8c5eb0363 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e" status: 200 len: 194 microversion: 2.1 time: 0.117742 Aug 25 13:12:26.408757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2364/4665] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 25 13:12:26 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:26.422709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.425368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:26.440328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.441946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.443235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.444938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:26.445899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:26.446904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:26.744833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lazy-loading 'services' on Instance uuid 702767f3-638b-4dcd-8f94-66973db66364 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:26.946635 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0aba4ff4-2f0b-436e-b8a0-fcb511826e11 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e" status: 202 len: 0 microversion: 2.1 time: 0.535444 Aug 25 13:12:26.947877 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2365/4666] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:12:26 2022] DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/86546882-03ca-4e88-8b4a-9e3fda3d226e => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:12:26.965519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:26.967847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:27.018042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:27.021998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:27.031501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:27.033805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:27.034930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:27.035952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:27.417733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.452006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.465879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.468804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b15c2812-f5b2-4270-95b8-a428cdd44141 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.900310 Aug 25 13:12:27.474959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2302/4667] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:25 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:27.732343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.763759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.779276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:27.782151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8dc4459-40fa-44b9-a86b-78c76a98a148 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1362 microversion: 2.47 time: 0.831488 Aug 25 13:12:27.796364 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2366/4668] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:26 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1362 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:28.552057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:28.558654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:28.574493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e35515f-2174-40a1-b6f6-2a2858d829bb", "tag": "d3e51f2e-a5ca-4e38-9882-59c845c95372"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:28.609330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.610285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.611074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.613065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.619487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.621743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.623066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.626308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.628182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.671482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] Creating event network-changed:d3e51f2e-a5ca-4e38-9882-59c845c95372 for instance 5e35515f-2174-40a1-b6f6-2a2858d829bb on n-h1-850468-18 Aug 25 13:12:28.703480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e946f980-1434-4bac-974c-7ca1eee1834a req-871652fd-9b11-430b-88a8-d4f46c615f9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140497 Aug 25 13:12:28.709439 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2367/4669] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:28.840269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:28.841480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:28.871178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.872102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.876656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:28.879015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:28.883309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:28.884727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:29.251788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.310568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.316891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.320401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-10038f5e-c979-4633-bad5-3532c3c60b67 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1362 microversion: 2.47 time: 0.487646 Aug 25 13:12:29.322501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2368/4670] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:28 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:29.800838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.840681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.853136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:29.856631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfa1c030-6f7c-4729-bab1-e292d827e009 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.326815 Aug 25 13:12:29.858209 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2303/4671] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:28 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:30.373397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:30.376583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:30.416980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:30.418611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:30.426008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:30.428047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:30.429487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:30.430697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:30.563100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:30.564165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:30.565058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:30.566514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lazy-loading 'fault' on Instance uuid b66b8c01-960f-4d09-a2ca-21eabe0d256a {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:30.754640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:30.803576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:30.807485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:30.811484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f438917-c25e-4f24-9f65-7741401b7479 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 200 len: 1367 microversion: 2.47 time: 0.447954 Aug 25 13:12:30.840220 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2369/4672] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:30 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:30.913878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:30.942383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:30.974476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:30.980351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:30.985436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:30.989290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:30.993208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:30.997807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:31.167489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:31.884469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:31.890294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: b66b8c01-960f-4d09-a2ca-21eabe0d256a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:31.945793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:31.946183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:31.947080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:31.947562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:31.958782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:31.959712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:31.971299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.019883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:32.039694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:32.056513 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f934d2f-57e0-4c8e-95d3-24fa1b4e5c52 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.141361 Aug 25 13:12:32.057264 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] HTTP exception thrown: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Request method failure captured: Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a HTTP/1.1 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3T6U2Q3VaWUsFokkX785HFs5YD9P4udqYq4_SM8c0cAJ4jQAyqTjmEgRaHcBtXzuUiXWgaLanvhdjvzLzZcC41Y7ybb6uEhgRBJUOOamvoWXuDFmtpbQZOragZBFd82PmTiSZ8fTOzs7wZ7on8tcY9YbRJ80afO8NpYfndpPL_y8fQ Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: c1ccaa32b0154d4689be90562fcf1641 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerShowV247Test-417104695 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerShowV247Test-417104695 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: c1ccaa32b0154d4689be90562fcf1641 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerShowV247Test-417104695 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerShowV247Test-417104695-project Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: fe4fb3e346c24796a2c70592df24b527 Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerShowV247Test-417104695-project Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'b66b8c01-960f-4d09-a2ca-21eabe0d256a'} Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:32.061292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. Aug 25 13:12:32.098507 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:32.099927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2304/4673] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:30 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:32.110801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Returning 404 to user: Instance b66b8c01-960f-4d09-a2ca-21eabe0d256a could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:12:32.110801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5486e35c-1157-44b8-9e19-e3b681e43fc6 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a" status: 404 len: 111 microversion: 2.47 time: 0.201619 Aug 25 13:12:32.110801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2370/4674] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:31 2022] GET /compute/v2.1/servers/b66b8c01-960f-4d09-a2ca-21eabe0d256a => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:12:32.118443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:32.119974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:32.159728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:32.164357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:32.170871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.177947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:32.183554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:32.184681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.384108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:12:32.832102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f269c96-e53a-495b-9cbe-8ea1ef9b6e29 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 204 len: 0 microversion: 2.47 time: 0.752842 Aug 25 13:12:32.845295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2305/4675] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:12:32 2022] DELETE /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:12:32.861688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:32.866900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:32.903649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:32.920140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:32.925393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:32.929931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:32.931153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:32.936618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:33.133120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:33.141948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:33.200461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:33.210306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:33.211796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:33.217103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:33.218986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:33.219920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:33.242809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:33.889667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:34.298196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.363543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.378599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.395631 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3bf7529d-5dac-49d5-9155-0aad45a186fc tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 200 len: 1362 microversion: 2.47 time: 1.530971 Aug 25 13:12:34.406533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2371/4676] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:32 2022] GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 1362 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:34.890208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.938750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.954170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:34.959008 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b92d3838-f98e-4ab0-98b6-42c6e74f3530 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.842498 Aug 25 13:12:34.966358 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2306/4677] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:33 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:35.475825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:35.478937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:35.522757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:35.528978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:35.530427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:35.535801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:35.538490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:35.540212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:36.022535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:36.032587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:36.034978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:36.070252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:36.079390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:36.090409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0950ce84-0442-4593-91b9-605dfb1d8617 tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 200 len: 1362 microversion: 2.47 time: 0.645766 Aug 25 13:12:36.096600 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2372/4678] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:35 2022] GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:36.131136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:36.147748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.051s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:36.156612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:36.158483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:36.159974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:36.164433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.173468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:37.198693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:37.284360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=53 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:37.294212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.296735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.302152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.305723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.308657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.312849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.355318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.449633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:37.450877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:37.452982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:37.456447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lazy-loading 'fault' on Instance uuid 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:37.458539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.486335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.491236 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3686bfe-44e3-499b-a32a-fd222bb6a2bd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.478646 Aug 25 13:12:37.504866 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2307/4679] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:36 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:37.677542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.845386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.851421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4fb3e346c24796a2c70592df24b527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ccaa32b0154d4689be90562fcf1641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:37.854392 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-119e4f0d-ba30-4d64-9231-12f875dea38d tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 200 len: 1367 microversion: 2.47 time: 0.698728 Aug 25 13:12:37.865164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2373/4680] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:37 2022] GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 1367 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:38.559799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:38.563811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:38.607226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:38.608419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:38.614917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:38.617370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:38.619041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:38.620572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:38.917258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:38.921648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] [instance: 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:38.979361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:38.983351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:38.985495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:39.008924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:39.013117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:39.022637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:39.058403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:39.159879 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] HTTP exception thrown: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Request method failure captured: Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d HTTP/1.1 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3T6U2Q3VaWUsFokkX785HFs5YD9P4udqYq4_SM8c0cAJ4jQAyqTjmEgRaHcBtXzuUiXWgaLanvhdjvzLzZcC41Y7ybb6uEhgRBJUOOamvoWXuDFmtpbQZOragZBFd82PmTiSZ8fTOzs7wZ7on8tcY9YbRJ80afO8NpYfndpPL_y8fQ Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.47 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: c1ccaa32b0154d4689be90562fcf1641 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerShowV247Test-417104695 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c1ccaa32b0154d4689be90562fcf1641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerShowV247Test-417104695 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: c1ccaa32b0154d4689be90562fcf1641 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerShowV247Test-417104695 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerShowV247Test-417104695-project Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: fe4fb3e346c24796a2c70592df24b527 Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerShowV247Test-417104695-project Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d'} Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:12:39.178820 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:12:39.189428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] Returning 404 to user: Instance 2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:12:39.192874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dcab5832-3546-4291-b301-40ec3a1f2cde tempest-ServerShowV247Test-417104695 tempest-ServerShowV247Test-417104695-project] 10.222.0.60 "GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d" status: 404 len: 111 microversion: 2.47 time: 0.279246 Aug 25 13:12:39.209110 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2374/4681] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:38 2022] GET /compute/v2.1/servers/2ea31b5b-a6ce-4e3d-8eb7-77fa3e9f350d => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:12:39.743471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:39.847592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:39.868022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:39.874762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-26471919-6bf1-4c5e-ab3d-70cda3097b68 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.328429 Aug 25 13:12:39.875848 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2308/4682] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:38 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:40.950796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:40.958263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:41.033407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:41.034432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:41.035589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:41.037110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:41.077883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:41.086532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:42.204280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:42.321221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:42.355242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:42.381064 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7695adc-61fb-477f-8659-c7f6fb54312c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.448654 Aug 25 13:12:42.387462 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2375/4683] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:40 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:43.436841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:43.438342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:43.489217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:43.496520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:43.497072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:43.497874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:43.498363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:43.499036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:44.789146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:44.868602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:44.885211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:44.895496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e99d7caa-56cf-4240-b20b-45e8bd409e69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.467012 Aug 25 13:12:44.912457 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2309/4684] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:43 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:45.991093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:45.999840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:46.097768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:46.098957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:46.100155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:46.102095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:46.103292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:46.113142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:47.912917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:47.990221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:48.002748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:48.012401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27ba1832-5278-470c-af90-ecd361067183 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 2.037041 Aug 25 13:12:48.022894 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2376/4685] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:45 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:49.093920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:49.102064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:49.130978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:12:49.154704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:49.155665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:49.169209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:49.172797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:49.174075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:49.175783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:50.356418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3d69a91-7e2d-4c86-9a29-0cab66ba0028 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Action: 'create', calling method: .version_select at 0x7fc6c2827160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-991228647"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:52.390717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:52.454845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:52.475406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:52.481441 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3d69a91-7e2d-4c86-9a29-0cab66ba0028 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.185997 Aug 25 13:12:52.484623 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2377/4686] 10.222.0.60 () {60 vars in 1155 bytes} [Thu Aug 25 13:12:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3191 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 13:12:52.543690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0be8b27a-f71a-4dc9-bb5e-fe22d22d4fc1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 3.480889 Aug 25 13:12:52.573893 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2310/4687] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:49 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 3517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:52.576510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2efc9b5-c080-4075-a4d0-9601fac086f5 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c189aa60>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:52.976808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2efc9b5-c080-4075-a4d0-9601fac086f5 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.470965 Aug 25 13:12:52.977971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2378/4688] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:12:52 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:53.473742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:53.476610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:53.580022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:53.589411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:53.593470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:53.605021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:53.606472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:53.608213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:53.868024 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e029ebea-a0c3-4adb-92cb-e390c9deeb57 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/0aab35bf-1dfa-4f25-b9ea-27479aab45ea" status: 200 len: 194 microversion: 2.1 time: 0.404611 Aug 25 13:12:53.887772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2311/4689] 10.222.0.60 () {58 vars in 1413 bytes} [Thu Aug 25 13:12:53 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/0aab35bf-1dfa-4f25-b9ea-27479aab45ea => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:53.920724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:53.925057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:53.951391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:53.952318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:53.953122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:53.959896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:53.960488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:53.961241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:54.569129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lazy-loading 'services' on Instance uuid 702767f3-638b-4dcd-8f94-66973db66364 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:12:54.696156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:54.710489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:54.735556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:54.737196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:54.738050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:54.739385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:54.763425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:54.764883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:55.526922 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b355405-29e2-40e6-9386-14404a5f3b3d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/0aab35bf-1dfa-4f25-b9ea-27479aab45ea" status: 202 len: 0 microversion: 2.1 time: 1.623133 Aug 25 13:12:55.548310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2312/4690] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:12:53 2022] DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments/0aab35bf-1dfa-4f25-b9ea-27479aab45ea => generated 0 bytes in 1640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:12:55.591123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-15d56f44-1740-4e49-a27b-74126d30fd85 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1705f70>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:55.761523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:55.816503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:55.820337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:55.825106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4641c83f-3082-47d5-bca5-c19efcb606e6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 2.232393 Aug 25 13:12:55.827278 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2379/4691] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:53 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:12:55.974953 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-15d56f44-1740-4e49-a27b-74126d30fd85 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.423737 Aug 25 13:12:55.976667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2313/4692] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:12:55 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:56.690021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7b95975-e74d-476a-bb68-64ba88599f27 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: .version_select at 0x7fc6c292e940>, body: {"keypair": {"name": "tempest-keypair-119530470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeJkWBVaiqYIEpxfdys6qRFmYt/zM5aSKUNIVfwkR7AzzM3mpRosP9CVards3gCjQ3aWDaCdPNbXlDrbpQA/ZLa+q3rXYNH1jz/4I7ZERi5w2PvOhD/F62r2b1mWJxtYg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:56.766702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f7b95975-e74d-476a-bb68-64ba88599f27 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:12:56.802840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f7b95975-e74d-476a-bb68-64ba88599f27 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:12:56.914349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7b95975-e74d-476a-bb68-64ba88599f27 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.083886 Aug 25 13:12:56.915490 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2380/4693] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:12:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:12:57.000096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-33988ee2-87c2-49ac-b66d-12caa1f44213 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c17e9f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:57.004883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:57.007962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:57.138115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:57.149082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:57.164415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:57.175590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:57.177015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:57.178182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:57.941273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-33988ee2-87c2-49ac-b66d-12caa1f44213 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 345 microversion: 2.1 time: 0.947665 Aug 25 13:12:57.944501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2381/4694] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:12:56 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 345 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:12:57.967903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-91b301b3-969f-4ab2-9bd0-79c528c1a341 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Action: 'create', calling method: .version_select at 0x7fc6c17aa1f0>, body: {"snapshot": {"volume_id": "6461bc13-b352-49d7-9c89-aaad0db630a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1863166587"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:12:58.333764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:58.410871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:58.433610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:12:58.461405 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df92dfa3-e233-4a89-b3c9-ce134db5e874 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.549779 Aug 25 13:12:58.464542 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2314/4695] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:56 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:12:59.530647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:12:59.539256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:12:59.589251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.591462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.594061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:12:59.596241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:12:59.597852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:12:59.599851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:00.320238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.368042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.382274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:00.384692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dd8c34bd-3b43-4dc2-860d-4bddf6dccb5a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.868670 Aug 25 13:13:00.389444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2315/4696] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:12:59 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:01.222722 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-91b301b3-969f-4ab2-9bd0-79c528c1a341 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 3.261137 Aug 25 13:13:01.223948 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2382/4697] 10.222.0.60 () {60 vars in 1162 bytes} [Thu Aug 25 13:12:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:01.246940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bbdabefe-23cc-4a66-85af-774eb85c717c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c6bff820>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:01.459689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:01.461014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:01.505820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:01.507596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:01.511729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:01.512868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:01.513316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:01.513894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:01.673335 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bbdabefe-23cc-4a66-85af-774eb85c717c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.437236 Aug 25 13:13:01.674893 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2316/4698] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:01 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:01.695507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5fdde294-6c3a-4bf7-8105-1f4f2e472aa3 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c6c06ee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:01.909879 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5fdde294-6c3a-4bf7-8105-1f4f2e472aa3 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.223217 Aug 25 13:13:01.910905 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2317/4699] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 25 13:13:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:01.961339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-479c6c70-5b18-4168-ab5a-7d089500303c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c6c78a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:02.155855 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-479c6c70-5b18-4168-ab5a-7d089500303c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.230343 Aug 25 13:13:02.158850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2318/4700] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:01 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:02.403042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:02.467127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:02.483383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:02.490097 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-820a647b-63f4-469b-a03b-91d2384ec2f2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.052423 Aug 25 13:13:02.495766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2383/4701] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:01 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:03.217178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8ea9016-08fd-452f-a135-10f057417025 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c2e5e670>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:03.400696 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8ea9016-08fd-452f-a135-10f057417025 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.229219 Aug 25 13:13:03.403252 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2319/4702] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:03 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:03.557943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:03.559540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:03.621058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.627501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.671138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:03.674258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:03.686833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2079838123", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "723617c5-71c1-48f0-b95e-eb7a1111c402"}], "security_groups": [{"name": "tempest-securitygroup--1284723104"}], "key_name": "tempest-keypair-119530470", "user_data": "}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:03.697077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:03.707430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:04.600492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:04.637773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:04.641287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:04.643860 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3445c19-785f-4d88-b0cb-1cdc97857b7e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.094783 Aug 25 13:13:04.654203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2384/4703] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:03 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:04.667795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] validate_networks() for [('723617c5-71c1-48f0-b95e-eb7a1111c402', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:13:04.705375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a814399c-2899-4fd5-94e0-853e6b509367 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c25d90d0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:04.818119 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a814399c-2899-4fd5-94e0-853e6b509367 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.140685 Aug 25 13:13:04.819232 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2385/4704] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:04 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:05.710464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:05.711658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:05.749660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:05.750619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:05.751429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:05.753445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:05.764788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:05.766738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.607092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:13:06.610575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:13:06.612705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:13:06.620999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:13:06.622215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:13:06.646632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:06.648539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:06.649858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.652266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:06.653635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:06.654938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:06.713866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:06.740663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.762978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:13:06.779204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.800565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:06.801878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:13:06.811172 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d933f4ab-81ce-4e83-aeea-077b0873df10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.111835 Aug 25 13:13:06.829301 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2386/4705] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:05 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:06.860254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25399126-2009-4152-8b8e-dfdefc16abae tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c188a310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:06.883616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:06.888977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:13:06.901459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:13:07.035731 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5338d783-3448-4da1-b131-26e07ecc013d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.387641 Aug 25 13:13:07.037857 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2320/4706] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:13:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 3391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:13:07.069921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-649657eb-5df9-4e47-9d28-e9d6b99862e0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:07.082397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-649657eb-5df9-4e47-9d28-e9d6b99862e0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:07.140202 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25399126-2009-4152-8b8e-dfdefc16abae tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.308610 Aug 25 13:13:07.141300 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2387/4707] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:06 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:07.408430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-649657eb-5df9-4e47-9d28-e9d6b99862e0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:07.427859 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-649657eb-5df9-4e47-9d28-e9d6b99862e0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1238 microversion: 2.1 time: 0.376767 Aug 25 13:13:07.472615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2321/4708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:07 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1238 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:07.877680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:07.899564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:07.903584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:07.995502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:07.998268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:08.000635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:08.006304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:08.007196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:08.009090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:08.162582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb09aff1-f227-4578-b6cb-e06513bfa663 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1705550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:08.483325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb09aff1-f227-4578-b6cb-e06513bfa663 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 288 microversion: 2.1 time: 0.327944 Aug 25 13:13:08.488088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2322/4709] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:08 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 288 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:08.493247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.515044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.518648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.521395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15f5b82c-d56e-4b55-a308-3cf758c213d4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.656178 Aug 25 13:13:08.532513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-115c6b15-8e5a-4d04-9281-bd24d3961bdd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:08.542018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-115c6b15-8e5a-4d04-9281-bd24d3961bdd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:08.565801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2388/4710] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:07 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:08.576579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a51a787f-00ca-4c66-a805-04468b374159 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c17dd430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:08.739002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-115c6b15-8e5a-4d04-9281-bd24d3961bdd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:08.770365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-115c6b15-8e5a-4d04-9281-bd24d3961bdd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1238 microversion: 2.1 time: 0.277925 Aug 25 13:13:08.788169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2323/4711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:08 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1238 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:08.841802 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a51a787f-00ca-4c66-a805-04468b374159 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 202 len: 0 microversion: 2.1 time: 0.273088 Aug 25 13:13:08.843996 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2389/4712] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 13:13:08 2022] DELETE /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:08.858221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-65359510-f919-48ae-8dfe-f060f1149168 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c17053a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:09.115022 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-65359510-f919-48ae-8dfe-f060f1149168 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.264081 Aug 25 13:13:09.116104 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2324/4713] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:08 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:09.579927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:09.590864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:09.665903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.667365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.672616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.674237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.675733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.676972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.837915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:09.840579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:09.850857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.851757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.852571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:09.853826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:09.854611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:09.855357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:10.167339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.217417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee7f2e29-6142-46e8-8651-cb0150e9a228 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1234 microversion: 2.1 time: 0.400208 Aug 25 13:13:10.224952 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2325/4714] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:09 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1234 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:10.234895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-746a8f65-1ab3-4269-8f83-9485272f08aa tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1705b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:10.374321 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-746a8f65-1ab3-4269-8f83-9485272f08aa tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.146560 Aug 25 13:13:10.376795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2326/4715] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:10 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:10.526604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.605439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.618504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:10.628811 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-074f1ba8-7b68-4582-8796-1e39e2fe3138 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.056429 Aug 25 13:13:10.637236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2390/4716] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:09 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:13:11.286494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:11.289689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:11.323040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:11.329045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:11.330530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:11.333381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:11.335380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:11.336749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:11.398960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3aaa9435-714a-423e-983e-1e4b1cb17bf4 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1dfe670>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:11.528995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3aaa9435-714a-423e-983e-1e4b1cb17bf4 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.137725 Aug 25 13:13:11.539258 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2391/4717] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:11 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:11.626559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:11.660138 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84bb68b0-e8e9-46d9-9751-ebaf0d11bcf7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1296 microversion: 2.1 time: 0.399055 Aug 25 13:13:11.664930 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2327/4718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:11 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1296 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:11.698763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:11.707724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:11.750693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:11.755330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:11.757952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:11.762755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:11.769560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:11.770920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:11.792878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=50 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:12.608870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.658401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.663538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:12.674028 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6abf5df7-153f-4d52-9a8e-417d3f05ed69 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.988519 Aug 25 13:13:12.677000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2392/4719] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:11 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:12.702661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-600c7a22-a6a1-40db-9326-3235ee874c4b tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1e16ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:12.730690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Calling method '.version_select at 0x7fc6c16f6040>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:12.738447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.739583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.740914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:12.788442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.789963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.791343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:12.821420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.822550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.823590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:12.838506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9140f049-953d-4467-be1f-dc7eec5b08ac tempest-PortsAdminExtendedAttrsTestJSON-1612921275 tempest-PortsAdminExtendedAttrsTestJSON-1612921275-project-admin] 10.222.0.60 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.683547 Aug 25 13:13:12.843064 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2328/4720] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:13:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:12.849572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-600c7a22-a6a1-40db-9326-3235ee874c4b tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 200 len: 287 microversion: 2.1 time: 0.169226 Aug 25 13:13:12.851068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2393/4721] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:12 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:12.859555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:12.863898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:12.894564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.896480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.898131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:12.901018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:12.903118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:12.905492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.530458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:13.553692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4aa8975b-b06e-4522-8c18-2cda1c9496c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1296 microversion: 2.1 time: 0.707957 Aug 25 13:13:13.566677 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2329/4722] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:12 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1296 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:13.736712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:13.738376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:13.761280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:13.762206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:13.769510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.771157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:13.772027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:13.773071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:13.872827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b7c859e-172a-47e3-a5a6-c9b977e56b3e tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c16e7430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:13.934223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-8b7c859e-172a-47e3-a5a6-c9b977e56b3e tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] HTTP exception thrown: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b7c859e-172a-47e3-a5a6-c9b977e56b3e tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Request method failure captured: Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 HTTP/1.1 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3VQ_2GVwDSSBqtGMHtbIN186PAsy3QH53RB9HhdVTyyB0otcMyAvly2hK1N3Abe-rz2O1SgsRaCyQp1Jnp8ET5c-nH7_LN0uflgSJ1S_lOAdZXdETjFbuVjgfnDs3mXQZDymqG-TZXGtCu98sJhFgxy_RdJ51FMpqUXHoy0PSNVVdo Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 239e1492260d4613b49ba8d3162dd8f9 Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: exception: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8bf0e277-a88f-4474-817b-240ad5341920'} Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. (HTTP 404) (Request-ID: req-99599bff-c29c-45bb-a12f-412b426c8c62) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:13:13.943603 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. Aug 25 13:13:13.952441 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:13.962239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8b7c859e-172a-47e3-a5a6-c9b977e56b3e tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Returning 404 to user: Snapshot 8bf0e277-a88f-4474-817b-240ad5341920 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:13.962239 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8b7c859e-172a-47e3-a5a6-c9b977e56b3e tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920" status: 404 len: 111 microversion: 2.1 time: 0.094581 Aug 25 13:13:13.962986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2330/4723] 10.222.0.60 () {58 vars in 1251 bytes} [Thu Aug 25 13:13:13 2022] GET /compute/v2.1/os-snapshots/8bf0e277-a88f-4474-817b-240ad5341920 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:13:13.983112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4a2f8cb-a677-4b94-b4b5-1a9982fef348 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c16f6e50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:14.146435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4a2f8cb-a677-4b94-b4b5-1a9982fef348 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 202 len: 0 microversion: 2.1 time: 0.176150 Aug 25 13:13:14.148062 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2331/4724] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:13:13 2022] DELETE /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:14.167244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-704a7dbf-40d9-4f65-8015-dd65f492862f tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c162f940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:14.370388 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-704a7dbf-40d9-4f65-8015-dd65f492862f tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.212853 Aug 25 13:13:14.374298 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2332/4725] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:14 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:14.730181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-plugged", "status": "completed", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:14.795868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.801521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.802169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.833865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] Creating event network-vif-plugged:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:13:14.854241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1af52b30-0560-4562-b21d-f2d9758624e8 req-1ba0528c-8231-4c7c-9527-998fdf459186 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440527 Aug 25 13:13:14.855686 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2333/4726] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:14.875501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:14.877766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:14.895683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.897597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.899007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:14.903508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:14.905727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:14.909272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.203558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.229045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8ee0194-fa27-446a-88e4-90ba0ce7545f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1296 microversion: 2.1 time: 0.363897 Aug 25 13:13:15.231027 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2334/4727] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:14 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1296 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:15.244413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.249321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:15.264639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.269904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.271173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.278047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.279251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.285435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.380436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f9662a9-9abf-4eec-a141-416c8712f107 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146683 Aug 25 13:13:15.382430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2335/4728] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:13:15.400771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a687d075-e609-48c6-8ba6-7d39cf1f4013 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c1762280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.422632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.455509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.458565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:15.470072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9325b619-3522-403a-94a2-4acb68a250c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 1.732304 Aug 25 13:13:15.475187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2394/4729] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:13 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:15.644809 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a687d075-e609-48c6-8ba6-7d39cf1f4013 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.252266 Aug 25 13:13:15.646169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2336/4730] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:15.883458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:15.897896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:15.933294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.934110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.941178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:15.946320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:15.947686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:15.949799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.111959 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ac397ab-22d7-422e-b6ce-435dbb6391d9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.260000 Aug 25 13:13:16.135632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2395/4731] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:13:15 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364/os-volume_attachments => generated 25 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:13:16.273861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:16.274959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:16.336768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:16.345033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:16.346755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.349179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.353308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.355235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.360464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.362411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.364957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.366291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.367395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.369390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.370517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.373025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.453644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:13:16.714019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:16.799106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7293288b-06e6-4088-b203-f2334781872c tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 204 len: 0 microversion: 2.1 time: 0.469140 Aug 25 13:13:16.800236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2396/4732] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:13:16 2022] DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:13:16.817128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:16.818651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:16.854005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.854971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.855822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:16.857245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:16.858162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:16.858997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.104706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.126810 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a038e78f-3aaa-4f38-8261-ef01f087cdd2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.859847 Aug 25 13:13:17.148038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2337/4733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:16 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:17.170438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45ab192f-0a1d-4a32-8eaf-7a2ec4bc3326 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c2e5e3a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:17.364866 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-45ab192f-0a1d-4a32-8eaf-7a2ec4bc3326 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.214021 Aug 25 13:13:17.381355 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2338/4734] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:17 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:17.421106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:17.425497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:17.468906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.470513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.476099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.478352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:17.496813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:17.497776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:17.620475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.653815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.660238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:17.663979 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-527c151c-709e-4527-9431-fc0dbc10e5cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.857482 Aug 25 13:13:17.677875 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2397/4735] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:16 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:18.199663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:18.201576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:18.231326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.235320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.241063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.245795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.249547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.254685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.351296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:18.386090 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a53e2587-7359-4082-9c37-0d1770cfd82d tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1672 microversion: 2.1 time: 1.002596 Aug 25 13:13:18.388250 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2339/4736] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:17 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1672 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:18.402205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2dc32d34-3b78-4b65-8235-34a86de41413 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c29e4dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:18.561563 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2dc32d34-3b78-4b65-8235-34a86de41413 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.170281 Aug 25 13:13:18.564839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2340/4737] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:18 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:18.717017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:18.718149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:18.748024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.750508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.752093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.754598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:18.755822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:18.756994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:18.758288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:18.990244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.034920 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f617a3e-1df1-46b0-a116-f352d2ed396c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.855477 Aug 25 13:13:19.060203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2398/4738] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:18 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:19.434703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:19.435888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:19.446485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.471189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.475246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:19.479156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef447c58-1a33-40da-88e7-dcb39caa89c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.768006 Aug 25 13:13:19.480845 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2341/4739] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:18 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:19.484260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:19.485398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:19.492559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:19.494318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:19.497374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:19.514008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:19.590202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16ecf077-f3d6-4c0e-bf2f-43229a2dcbd2 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c6bffb80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:19.814592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-16ecf077-f3d6-4c0e-bf2f-43229a2dcbd2 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 200 len: 344 microversion: 2.1 time: 0.230477 Aug 25 13:13:19.817076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2342/4740] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:19 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:20.072817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:20.076437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:20.082704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:20.116863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:20.120311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:20.122535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:20.129861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:20.131253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:20.135063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.259027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:21.297319 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6469284d-1328-48e9-8f38-98488cd56957 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1672 microversion: 2.1 time: 1.870211 Aug 25 13:13:21.299282 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2399/4741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:19 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1672 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:21.319543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:21.321187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:21.348494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.349776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.350630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.354447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:21.358457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:21.364622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:21.751074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:21.771609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5077765d-f79f-42a0-b0d6-0a33a1dd61dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 1.708172 Aug 25 13:13:21.786860 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2343/4742] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:20 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:21.811426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27bb0fb6-db4e-4217-8dba-f3e494810293 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c161f1f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:21.901031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-27bb0fb6-db4e-4217-8dba-f3e494810293 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] HTTP exception thrown: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27bb0fb6-db4e-4217-8dba-f3e494810293 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Request method failure captured: Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 HTTP/1.1 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3VQ_2GVwDSSBqtGMHtbIN186PAsy3QH53RB9HhdVTyyB0otcMyAvly2hK1N3Abe-rz2O1SgsRaCyQp1Jnp8ET5c-nH7_LN0uflgSJ1S_lOAdZXdETjFbuVjgfnDs3mXQZDymqG-TZXGtCu98sJhFgxy_RdJ51FMpqUXHoy0PSNVVdo Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 239e1492260d4613b49ba8d3162dd8f9 Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6461bc13-b352-49d7-9c89-aaad0db630a3'} Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. (HTTP 404) (Request-ID: req-494f9181-df56-4a2a-b0f5-e369349b2a57) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:13:21.906752 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:21.917522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27bb0fb6-db4e-4217-8dba-f3e494810293 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Returning 404 to user: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:21.926514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27bb0fb6-db4e-4217-8dba-f3e494810293 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 404 len: 109 microversion: 2.1 time: 0.118725 Aug 25 13:13:21.934084 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2344/4743] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:21 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:21.952011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b75ce695-3c0f-4852-9e24-8ff8befe6684 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c2759940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:22.047381 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b75ce695-3c0f-4852-9e24-8ff8befe6684 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] HTTP exception thrown: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b75ce695-3c0f-4852-9e24-8ff8befe6684 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Request method failure captured: Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 HTTP/1.1 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3VQ_2GVwDSSBqtGMHtbIN186PAsy3QH53RB9HhdVTyyB0otcMyAvly2hK1N3Abe-rz2O1SgsRaCyQp1Jnp8ET5c-nH7_LN0uflgSJ1S_lOAdZXdETjFbuVjgfnDs3mXQZDymqG-TZXGtCu98sJhFgxy_RdJ51FMpqUXHoy0PSNVVdo Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 239e1492260d4613b49ba8d3162dd8f9 Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6461bc13-b352-49d7-9c89-aaad0db630a3'} Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. (HTTP 404) (Request-ID: req-1b57ad8e-64f0-4868-97ee-731185f70172) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:13:22.055132 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b75ce695-3c0f-4852-9e24-8ff8befe6684 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Returning 404 to user: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b75ce695-3c0f-4852-9e24-8ff8befe6684 tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 404 len: 109 microversion: 2.1 time: 0.123505 Aug 25 13:13:22.068582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2345/4744] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:13:21 2022] DELETE /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:22.086308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c66cffc-83e9-453b-9413-f748f3a5bd6c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Calling method '.version_select at 0x7fc6c6bff8b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:22.160293 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-1c66cffc-83e9-453b-9413-f748f3a5bd6c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] HTTP exception thrown: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c66cffc-83e9-453b-9413-f748f3a5bd6c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Request method failure captured: Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 HTTP/1.1 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3VQ_2GVwDSSBqtGMHtbIN186PAsy3QH53RB9HhdVTyyB0otcMyAvly2hK1N3Abe-rz2O1SgsRaCyQp1Jnp8ET5c-nH7_LN0uflgSJ1S_lOAdZXdETjFbuVjgfnDs3mXQZDymqG-TZXGtCu98sJhFgxy_RdJ51FMpqUXHoy0PSNVVdo Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8bc189e243346b9a1e4513011c9bd7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: c8bc189e243346b9a1e4513011c9bd7c Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1237312411 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 239e1492260d4613b49ba8d3162dd8f9 Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1237312411-project Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6461bc13-b352-49d7-9c89-aaad0db630a3'} Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. (HTTP 404) (Request-ID: req-000e7905-56de-450d-bdf5-ef66bd2cfddc) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:13:22.165129 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1c66cffc-83e9-453b-9413-f748f3a5bd6c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] Returning 404 to user: Volume 6461bc13-b352-49d7-9c89-aaad0db630a3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:22.178631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1c66cffc-83e9-453b-9413-f748f3a5bd6c tempest-VolumesSnapshotsTestJSON-1237312411 tempest-VolumesSnapshotsTestJSON-1237312411-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3" status: 404 len: 109 microversion: 2.1 time: 0.104227 Aug 25 13:13:22.186424 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2346/4745] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:13:22 2022] GET /compute/v2.1/os-volumes/6461bc13-b352-49d7-9c89-aaad0db630a3 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:22.253036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:22.290936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:22.297045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:22.299901 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b4dca2e2-d92e-4201-8e87-ff25e89874da tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1805 microversion: 2.20 time: 0.998220 Aug 25 13:13:22.320979 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2400/4746] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:21 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1805 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:22.362104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:22.363812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:22.384212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.385631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.392366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:22.394271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:22.395567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:22.396825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.537323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:23.577780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.587723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.587723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.632912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] Creating event network-changed:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:13:23.651570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-86179497-8962-49d5-8397-112e6ffaa207 req-fe2c83ce-1389-4a62-89ad-c3ad849eb8ff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.058248 Aug 25 13:13:23.657083 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2401/4747] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:23.672468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:23.674538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:23.691066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.691844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.692578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.693705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.694402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.695264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.722541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:23.754785 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a0388791-fbaa-48be-a2da-06944e069a81 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1672 microversion: 2.1 time: 1.410319 Aug 25 13:13:23.756027 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2347/4748] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:22 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1672 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:23.774579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:23.779031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:23.801262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.802088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.802697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:23.803645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:23.804339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:23.804777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:24.722699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.745515 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d510438c-08a4-4246-bfc5-fd15c8caf13f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 1.085288 Aug 25 13:13:24.756174 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2402/4749] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:23 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:24.765868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.811246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:24.814504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.815895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:24.830172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:24.838879 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ca500d8-2490-426b-8221-a8e7a5fecfdd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1792 microversion: 2.20 time: 1.080681 Aug 25 13:13:24.844250 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2348/4750] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:13:23 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1792 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:13:24.847828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:24.849636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:24.851164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:24.853096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:24.854301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:24.855385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:25.040107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:25.068996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-921e2e32-113b-4c23-86c2-d17e49454451 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1604 microversion: 2.1 time: 0.271929 Aug 25 13:13:25.086922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2403/4751] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:24 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:25.797004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:25.798222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:25.835002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:25.837570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:25.841971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:25.855374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:25.859894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:25.864711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.024358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702767f3-638b-4dcd-8f94-66973db66364", "name": "network-vif-deleted", "tag": "2a71de3a-71b7-496a-8946-8d01138e69fd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:26.055269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.056799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.058087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.111846 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] Creating event network-vif-deleted:2a71de3a-71b7-496a-8946-8d01138e69fd for instance 702767f3-638b-4dcd-8f94-66973db66364 on n-h1-850468-18 Aug 25 13:13:26.126760 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0589800c-1ade-4706-b219-e25f74126f20 req-b85d54d7-6b8d-48a8-bdcc-11ceb26439b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112840 Aug 25 13:13:26.129110 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2404/4752] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:26.147354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:26.150087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:26.190161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.193023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.194631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.196414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:26.197322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:26.200394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:26.564501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:26.593131 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a7e91d67-90c8-4f33-9170-8c9febe0dd7b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1604 microversion: 2.1 time: 0.457557 Aug 25 13:13:26.604241 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2405/4753] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:26 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:26.771773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:26.792411 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78706305-7b57-4e85-9349-75e1efdc1f9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 1.010273 Aug 25 13:13:26.795642 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2349/4754] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:25 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:27.641344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:27.648869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:27.677272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.678224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.679076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.680493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.681388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.682355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.850541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:27.851795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:27.886786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.887792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.889100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.893775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.895161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lazy-loading 'fault' on Instance uuid 702767f3-638b-4dcd-8f94-66973db66364 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:13:27.905526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.911494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:27.913794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:27.915289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:27.927246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:28.208883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58d37ebb4c1469fb8bb4973a8bcb602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8604d32274a42923d8304d5b191b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.240234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a5605cf-e92e-4d3d-9c78-aeb77327abdc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 200 len: 1327 microversion: 2.1 time: 0.606140 Aug 25 13:13:28.248674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2406/4755] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:27 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 1327 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:28.759951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:28.793125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66b113fe-2c08-4aa2-ad20-a3147fcf14cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.952476 Aug 25 13:13:28.799674 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2350/4756] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:29.289742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:29.294448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:29.320584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.321907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.326929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.328739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.329646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.330442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.366363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 HTTP/1.1 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '702767f3-638b-4dcd-8f94-66973db66364'} Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:29.372011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:29.382935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:29.386401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-942fff23-bf67-45f2-b8c4-dc6d882c914b tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 404 len: 111 microversion: 2.1 time: 0.105072 Aug 25 13:13:29.387498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2407/4757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:29 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:29.402849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ffb330e-4729-4936-9866-ab2fb7a0b9d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '.version_select at 0x7fc6c162f0d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:29.497768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ffb330e-4729-4936-9866-ab2fb7a0b9d1 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905515667" status: 202 len: 0 microversion: 2.1 time: 0.102006 Aug 25 13:13:29.505270 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2351/4758] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 13:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905515667 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:13:29.843480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:29.845453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:29.879467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.885573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.887196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:29.889211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:29.897461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:29.918473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:30.815952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:30.842705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a020e73-9836-49db-9672-0c2708a42db6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 1.004600 Aug 25 13:13:30.845876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2408/4759] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:29 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:31.896786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:31.907991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:31.920564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:31.921455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:31.922410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:31.925292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:31.941407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:31.942415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:32.480179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-plugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:32.515123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:32.516339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:32.518015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:32.545759 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] Creating event network-vif-plugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:13:32.558574 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1c407375-c304-49cc-8cc9-2141937e8221 req-d70d2f0a-7a0d-4eb2-abbe-989e13dabaa7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084368 Aug 25 13:13:32.561593 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2409/4760] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:32.649867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:32.670160 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a00cbd1-aabe-4887-8a2e-d19674779281 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.784161 Aug 25 13:13:32.685211 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2352/4761] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:31 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:33.726234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:33.727592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:33.772461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.773887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.775024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.776750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:33.778034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:33.780335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:33.832967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:34.270622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:34.287817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c4abf85d-93a7-464c-92c5-df4e83855794 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.571733 Aug 25 13:13:34.289957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2410/4762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:33 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:35.336165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:35.346015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:35.367094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:35.369510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:35.377094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:35.385091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:35.387345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:35.388565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:35.907027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:35.928070 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ca981ce-72d1-4d98-a1ef-5d451b0e7668 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1364 microversion: 2.1 time: 0.599308 Aug 25 13:13:35.930836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2353/4763] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:35 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1364 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:13:36.973285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:36.978672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:37.003951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.006149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.007332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.009443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.010823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.012409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.402607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:13:37.422442 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-26ce4d8e-c5fd-424c-91db-aaa2253c502e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1551 microversion: 2.1 time: 0.460206 Aug 25 13:13:37.425227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2411/4764] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:36 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1551 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:13:37.472597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:37.473299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:37.527532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.528791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.529785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.531181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:37.532059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:37.532927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:37.560832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:37.760555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d135caee-c4d8-4243-8ce2-3ec131f36e6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296998 Aug 25 13:13:37.776357 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2354/4765] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:13:37 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:42.414675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:42.494873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:42.519108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.520350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.529993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.630365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] Creating event network-changed:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:13:42.666397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f4b79da1-502c-4123-adf2-d630ac70dcdf req-fec9381c-1870-49be-be24-64e1bdb2e0f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258618 Aug 25 13:13:42.667494 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2412/4766] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:13:42.862878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:42.863703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:42.894540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.896006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.897720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:42.899609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:42.901137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:42.902508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:43.002124 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c13379c-d362-4eac-a1a1-a1732a4d9551 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/ips" status: 200 len: 149 microversion: 2.1 time: 0.154632 Aug 25 13:13:43.012293 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2355/4767] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:13:42 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/ips => generated 149 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:48.122952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4beb668-1c8d-4b6c-8d0e-9c7af0e33ef1"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:13:48.129440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:48.147064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:48.149139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:48.150682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:48.152661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:48.153857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:48.154551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:49.048312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb7b879d-934f-4858-998f-7c87b1a2c1ea tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "POST /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932258 Aug 25 13:13:49.053780 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2413/4768] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:13:48 2022] POST /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:13:49.915667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:49.920824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:49.969394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:49.971782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:49.973148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:49.977392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:49.978917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:49.980181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:50.033783 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 HTTP/1.1 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '702767f3-638b-4dcd-8f94-66973db66364'} Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:50.037088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.046410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.050467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:50.052443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6f880a19-c61f-4c0f-a5c5-45f5e47bf9e9 tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 404 len: 111 microversion: 2.1 time: 0.147472 Aug 25 13:13:50.058572 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2356/4769] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:13:49 2022] DELETE /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:13:50.071113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:50.078509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: 702767f3-638b-4dcd-8f94-66973db66364] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:50.109443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:50.112421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:50.117268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:50.118980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:50.120007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:50.126720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:50.189059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 HTTP/1.1 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '702767f3-638b-4dcd-8f94-66973db66364'} Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:50.208335 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:50.218095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance 702767f3-638b-4dcd-8f94-66973db66364 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:50.229647 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9dd9a12-d706-47c1-a0cd-a516a8cfc9ba tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364" status: 404 len: 111 microversion: 2.1 time: 0.160994 Aug 25 13:13:50.231912 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2414/4770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:50 2022] GET /compute/v2.1/servers/702767f3-638b-4dcd-8f94-66973db66364 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:59.352179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:59.352179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:59.375644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:13:59.387445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.393503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.394703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.399347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.400203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.400942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.491729 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de HTTP/1.1 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd9bbc8eb-7caf-489c-b055-34c0c33302de'} Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:59.494843 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.505723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:59.517395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e6ebcf40-7aee-4130-bd0c-156e5fd306ab tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 404 len: 111 microversion: 2.1 time: 0.174554 Aug 25 13:13:59.520999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2357/4771] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:13:59 2022] DELETE /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:13:59.537107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:13:59.543066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] [instance: d9bbc8eb-7caf-489c-b055-34c0c33302de] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:13:59.566543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.576312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.577831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.579424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:13:59.580461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:13:59.581387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:13:59.670448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] HTTP exception thrown: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Request method failure captured: Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de HTTP/1.1 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3KBidesoaPOYNsl4jry2hCSTw_8EtmSMPPaTPLf1nW8-mzoHfNfFFK-NBPGlJLv1Rc2CqlE4kxTwgFxed90NOn53xOniZ8NKb0AxhG0qnHMfjGGq6wK5M6cjkeRMd-dTAXvqKY_3G9u5WfwPUURQke01lTNJZw69BzEWmM887ZHfQE Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47d8604d32274a42923d8304d5b191b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47d8604d32274a42923d8304d5b191b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 47d8604d32274a42923d8304d5b191b8 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444310000 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: f58d37ebb4c1469fb8bb4973a8bcb602 Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeTestJSON-444310000-project Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd9bbc8eb-7caf-489c-b055-34c0c33302de'} Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:13:59.674682 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] Returning 404 to user: Instance d9bbc8eb-7caf-489c-b055-34c0c33302de could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-584a5138-f097-4c9b-aa5e-b8e23223bccc tempest-AttachVolumeTestJSON-444310000 tempest-AttachVolumeTestJSON-444310000-project] 10.222.0.60 "GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de" status: 404 len: 111 microversion: 2.1 time: 0.149881 Aug 25 13:13:59.684918 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2415/4772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:13:59 2022] GET /compute/v2.1/servers/d9bbc8eb-7caf-489c-b055-34c0c33302de => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:14:13.511681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:13.512717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:13.526571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:13.528656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:13.532579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:13.534147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:13.535040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:13.536496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:13.537636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:13.538701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:13.830490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lazy-loading 'services' on Instance uuid 5e35515f-2174-40a1-b6f6-2a2858d829bb {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:14:14.028370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-191f6b92-dc63-4b69-aa41-7d7097886f04 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments/a4beb668-1c8d-4b6c-8d0e-9c7af0e33ef1" status: 202 len: 0 microversion: 2.1 time: 0.525980 Aug 25 13:14:14.030370 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2358/4773] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:14:13 2022] DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments/a4beb668-1c8d-4b6c-8d0e-9c7af0e33ef1 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:14:14.051063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:14.055663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:14.068702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:14.070029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:14.072732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.073683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.074540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.075938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:14.076873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:14.078046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:14.158912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f663729f-399a-41f7-9801-179fe6fc33b9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117266 Aug 25 13:14:14.164325 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2416/4774] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:14 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:15.013080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-706728702", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "506d09a3-9012-4917-9e6c-fdb2f4fe21c8"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:15.182296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:15.187551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:15.214809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] validate_networks() for [('506d09a3-9012-4917-9e6c-fdb2f4fe21c8', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:14:15.219983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:15.225332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:15.226761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:15.233676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:15.236305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:15.237931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:15.336590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2354f607-c959-47a9-acd1-f0acab51924f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162228 Aug 25 13:14:15.347009 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2417/4775] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:15 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:16.359451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:16.369634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:16.411291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.420851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.425560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.427560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:16.431089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:16.432953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:16.627437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a43ab30-94ef-4b78-97c5-f6b7bb323b37 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.275061 Aug 25 13:14:16.655905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2418/4776] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:16 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:17.206773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:17.208733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:17.209676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:17.210449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:17.211223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:17.249131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:17.250069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:17.251151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:17.253693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:17.255091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:17.256200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:17.331326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Getting quotas for project adbf1358a205453f843ed96473be65f3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:14:17.343510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Getting quotas for user f8dff9d749e044e98a4e93c81b8f65d0 and project adbf1358a205453f843ed96473be65f3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:14:17.373778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:14:17.380733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:14:17.542079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-600f9214-31b2-41f7-afc3-db9b11c2aaba tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538023 Aug 25 13:14:17.544134 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2359/4777] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:14:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:14:17.575933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f803a746-72da-4fd5-bfc5-0167a01b9203 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:17.577137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f803a746-72da-4fd5-bfc5-0167a01b9203 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:17.665824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:17.684176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:17.727187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:17.728079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:17.728937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:17.744893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:17.746982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:17.747897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:17.850471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f803a746-72da-4fd5-bfc5-0167a01b9203 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:17.887632 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f803a746-72da-4fd5-bfc5-0167a01b9203 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1213 microversion: 2.1 time: 0.318827 Aug 25 13:14:17.889957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2419/4778] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:17 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:17.935920 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ff71a229-d950-4fe5-ba38-86362ac4cc44 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.280932 Aug 25 13:14:17.940569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2360/4779] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:17 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:18.981143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:18.993079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-befe1f49-8310-4d15-a21c-ac0ab5c30e5c tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:19.012205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:19.015874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-befe1f49-8310-4d15-a21c-ac0ab5c30e5c tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:19.119359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:19.129684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:19.137339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:19.139459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:19.140767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:19.142536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:19.215045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-befe1f49-8310-4d15-a21c-ac0ab5c30e5c tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:19.234217 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-befe1f49-8310-4d15-a21c-ac0ab5c30e5c tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1213 microversion: 2.1 time: 0.310568 Aug 25 13:14:19.236407 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2420/4780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:18 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1213 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:19.331682 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-991de55f-a9c2-414a-9060-4f53f3bd1b72 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.378462 Aug 25 13:14:19.333228 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2361/4781] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:18 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:20.280465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:20.287977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:20.323055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.324650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.325937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.327758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.329042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.330232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.362540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:20.372927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:20.397208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.406251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.407360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.410797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:20.413830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:20.415919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:20.515370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:20.535465 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-751ecb77-773b-45fd-bfe6-dd51575a80ac tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191417 Aug 25 13:14:20.537716 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2362/4782] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:20 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:20.541407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf7a5362-c86f-4a1f-b184-92a165a25fc3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1209 microversion: 2.1 time: 0.269563 Aug 25 13:14:20.542926 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2421/4783] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:20 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1209 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:21.565050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:21.583132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:21.588780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:21.593478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:21.619314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.619983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.620476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.627793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.628456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.628860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.629826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.630648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.632175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.637935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:21.639960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:21.643971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:21.758184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63545652-bd4c-40b8-a3ee-28f7e8dc274b tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206423 Aug 25 13:14:21.775196 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2363/4784] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:21 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:21.790799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8597003f-2feb-4185-9acf-48d1f16d28b7 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c29aa0d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:22.120402 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8597003f-2feb-4185-9acf-48d1f16d28b7 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e90bacbf-899d-4805-98d4-fb5aca21e89c" status: 200 len: 350 microversion: 2.1 time: 0.339952 Aug 25 13:14:22.121623 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2364/4785] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:14:21 2022] GET /compute/v2.1/os-volumes/e90bacbf-899d-4805-98d4-fb5aca21e89c => generated 350 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:22.131511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:22.154524 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a920f73-74d2-4aa5-9b5c-fb834d2130b0 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1271 microversion: 2.1 time: 0.576472 Aug 25 13:14:22.161161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2422/4786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:21 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1271 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:22.811785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:22.859323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:22.914448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.916446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.922784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:22.924609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:22.925949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:22.930453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:23.083169 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-45f026fc-4956-4c3a-8a76-c9a93414afb3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.285983 Aug 25 13:14:23.093499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2365/4787] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:22 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:23.214884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:23.223821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:23.301679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:23.303174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:23.309025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:23.314686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:23.316159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:23.317539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.060310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:24.111033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3be4f865-2b59-467b-bfca-651ca8fe4fa9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.908538 Aug 25 13:14:24.112259 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2423/4788] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:23 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:24.121892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:24.137213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:24.189837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.194959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.195353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.199666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:24.202832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:24.203683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:24.322955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6d34235-f802-4a61-922c-f6de2cd350cb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214751 Aug 25 13:14:24.324369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2366/4789] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:24 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:25.165657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:25.171365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:25.203655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.204710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.210147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.216073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.217446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.218220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.351243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:25.356534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:25.374468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.377711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.378997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.380300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:25.388450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:25.389575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:25.559583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd936a91-010f-4251-a643-887f2f7330a1 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222051 Aug 25 13:14:25.562020 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2367/4790] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:25 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:26.014043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:26.056039 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4eb9cca-95b0-4141-9a8b-fc6780457c71 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.903220 Aug 25 13:14:26.059299 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2424/4791] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:25 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:26.367309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e", "tag": "b8e6c6f1-b105-4c7c-bf29-48e620fabb28"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:26.409695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:26.411696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:26.413160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:26.442370 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] Creating event network-changed:b8e6c6f1-b105-4c7c-bf29-48e620fabb28 for instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e on n-h1-850468-18 Aug 25 13:14:26.463308 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6561059f-8387-4bd2-9de0-e7e94921b0b1 req-a14f0b75-4926-4008-999b-2741413d7139 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094814 Aug 25 13:14:26.465695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2368/4792] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:26.582091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:26.586082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:26.634264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:26.635056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:26.635856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:26.637145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:26.639456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:26.640658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:26.765021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d88d294d-b7cf-448d-9fd9-1fc2f8b37621 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187375 Aug 25 13:14:26.798719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2425/4793] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:26 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:27.049635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-497c36f7-162b-4890-a855-b5534f83d4e3 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c162f940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:27.116192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:27.118430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:27.134050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.135891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.137571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.140099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.143450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.144846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.278365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-497c36f7-162b-4890-a855-b5534f83d4e3 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d99bc59c-e536-4fb2-a09e-3a08c90d1bd1" status: 200 len: 350 microversion: 2.1 time: 0.251332 Aug 25 13:14:27.279949 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2369/4794] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:14:27 2022] GET /compute/v2.1/os-volumes/d99bc59c-e536-4fb2-a09e-3a08c90d1bd1 => generated 350 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:27.806126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:27.808159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:27.835096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:27.835403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:27.845975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:27.871090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb0a640e-ff86-49ee-96b2-edbf2dbe5e36 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.769336 Aug 25 13:14:27.889409 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2426/4795] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:27 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:27.889655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.889655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.889655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:27.892183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:27.893828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:27.895115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.035342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-562650a1-1ecb-44eb-ae72-078c1b09e0a2 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.230776 Aug 25 13:14:28.048761 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2370/4796] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 13:14:27 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb/os-volume_attachments => generated 25 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:14:28.190155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:28.191674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:28.207158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.208916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.210033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.211583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.212734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.213792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.284838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:28.580078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-426cd302-31a2-4af7-8610-797e88eabf31 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 204 len: 0 microversion: 2.1 time: 0.393681 Aug 25 13:14:28.582490 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2427/4797] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:14:28 2022] DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:14:28.597608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:28.599154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:28.613277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.614271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.615208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.617094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.618217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.619679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.925974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:28.932575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:28.959014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.959912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.962018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:28.963744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:28.967633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:28.978064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:28.979297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:29.009583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3679ea4-7368-412b-972f-4a51463b8c89 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1682 microversion: 2.1 time: 0.418033 Aug 25 13:14:29.029946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2371/4798] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:28 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1682 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:29.238366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:29.394903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:29.415978 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf38817a-e532-4c34-9ae0-0469aedbbfd6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.501080 Aug 25 13:14:29.428621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2428/4799] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:28 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:30.057299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:30.058587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:30.072579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.073901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.075067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:30.077068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.078367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.080074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:30.408041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:30.416160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-866d3c42-9c2c-4d01-8a79-2a6dbbb2f756 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c25d9f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:30.433596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78426eef-4c06-42ca-b305-61af7806c533 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1682 microversion: 2.1 time: 0.382494 Aug 25 13:14:30.438075 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2372/4800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:30 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1682 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:30.459171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:30.460366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:30.474325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.475776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.477286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:30.479107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:30.479786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:30.480581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:30.563787 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-866d3c42-9c2c-4d01-8a79-2a6dbbb2f756 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/7c532d46-8a71-480f-ad56-d0fc394333fc" status: 200 len: 350 microversion: 2.1 time: 0.157500 Aug 25 13:14:30.565443 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2429/4801] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:14:30 2022] GET /compute/v2.1/os-volumes/7c532d46-8a71-480f-ad56-d0fc394333fc => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:30.587684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8883b44-d674-4307-b3b3-c5c8bee3d6f9 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c271f5e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:30.782755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:30.820439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ee1bf19-d2c4-4d81-ad4d-a7b19befb5d5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.352845 Aug 25 13:14:30.822498 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2373/4802] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:30 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:30.928718 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8883b44-d674-4307-b3b3-c5c8bee3d6f9 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.349822 Aug 25 13:14:30.944325 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2430/4803] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 25 13:14:30 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:30.956176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53d7f6ce-96f9-4229-85b9-0258715b4bec tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c1c3e0d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.181095 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53d7f6ce-96f9-4229-85b9-0258715b4bec tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.232806 Aug 25 13:14:31.193359 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2374/4804] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 13:14:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:31.213270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5e8272ab-b543-49ca-9123-b2d535aca8d3 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c25d9550>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.405038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5e8272ab-b543-49ca-9123-b2d535aca8d3 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.201974 Aug 25 13:14:31.420910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2431/4805] 10.222.0.60 () {58 vars in 1134 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:31.434115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-221a1f5d-8fe9-4d4d-92bb-e676791285d1 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c16f6940>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.498733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.499800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:31.535609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.537165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.538478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.551396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.558141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.565392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.709622 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-221a1f5d-8fe9-4d4d-92bb-e676791285d1 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.282444 Aug 25 13:14:31.710776 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2375/4806] 10.222.0.60 () {58 vars in 1167 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:31.741833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe43b9ca-aabd-42c0-a53d-10b24d3d8e9b tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c171f430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.889588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:31.905299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e248327-4acf-4bb2-b0fa-2f5203d69ff8 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1682 microversion: 2.1 time: 0.420041 Aug 25 13:14:31.907403 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2432/4807] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:31.917629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:31.919325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:31.933032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.933711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.934849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.936671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:31.939105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:31.940769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:31.995452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe43b9ca-aabd-42c0-a53d-10b24d3d8e9b tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.261169 Aug 25 13:14:32.009094 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2376/4808] 10.222.0.60 () {58 vars in 1170 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:32.035120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b4ef137-07f4-4803-af9d-71538c2a6953 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c162f280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:32.231231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b4ef137-07f4-4803-af9d-71538c2a6953 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.208429 Aug 25 13:14:32.244681 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2377/4809] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 13:14:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:32.256560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:32.257436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:32.293049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:32.294564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:32.296432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:32.301036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:32.304097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:32.305550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:32.470994 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-45bfa3cc-db97-4ed5-802b-fd782519cbec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments/c6dccd75-5c94-4e68-8d38-72fc86c216f3" status: 200 len: 194 microversion: 2.20 time: 0.213966 Aug 25 13:14:32.473455 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2378/4810] 10.222.0.60 () {60 vars in 1454 bytes} [Thu Aug 25 13:14:32 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments/c6dccd75-5c94-4e68-8d38-72fc86c216f3 => generated 194 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:32.512838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0492929d-99b0-498c-88e6-22c4d4dad8ac tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c1762dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:32.722810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:32.755189 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65cd197a-ee98-41c7-90e6-d30e90a58dee tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.844800 Aug 25 13:14:32.756986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2433/4811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:31 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:32.769982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:32.771438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:32.789904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:32.791461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:32.792647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:32.794824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:32.796106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:32.797445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:32.811657 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0492929d-99b0-498c-88e6-22c4d4dad8ac tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.334976 Aug 25 13:14:32.811657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2379/4812] 10.222.0.60 () {58 vars in 1188 bytes} [Thu Aug 25 13:14:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:32.839074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e6ab07f-9461-4ab6-86df-03292e57e490 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] Calling method '.version_select at 0x7fc6c16e7280>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:33.127275 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e6ab07f-9461-4ab6-86df-03292e57e490 tempest-VolumesTestJSON-1238001830 tempest-VolumesTestJSON-1238001830-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.295667 Aug 25 13:14:33.128981 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2380/4813] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 13:14:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:33.147258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:33.147645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lazy-loading 'services' on Instance uuid 71b2d44b-7481-4d0f-8d89-1e2227155420 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:14:33.157668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:33.197652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.198487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.204369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.208855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.210564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.211720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.449377 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2951231a-c02b-4905-aee6-aeeebc67b2e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments/c6dccd75-5c94-4e68-8d38-72fc86c216f3" status: 202 len: 0 microversion: 2.20 time: 0.687884 Aug 25 13:14:33.452533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2434/4814] 10.222.0.60 () {60 vars in 1457 bytes} [Thu Aug 25 13:14:32 2022] DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments/c6dccd75-5c94-4e68-8d38-72fc86c216f3 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:14:33.474152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:33.475700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:33.501072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.525976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.529994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.534975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.544017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.549069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.578266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:33.796415 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01e7f735-b66c-43c8-b188-e256924f45f4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.331605 Aug 25 13:14:33.803974 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2435/4815] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:33 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:14:33.833371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:33.835862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:33.879957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.883711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.885054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:33.886773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:33.887943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:33.889035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:34.512364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:34.551096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac11d7af-491f-474f-89a5-561afed1887f tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1682 microversion: 2.1 time: 1.419804 Aug 25 13:14:34.558101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2381/4816] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:33 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1682 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:34.843857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:34.870436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:34.925223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.930719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.934045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:34.940756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:34.947853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:34.951760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:35.090702 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-39e412bc-b15d-42b6-b40d-a77aed3a8a88 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.271089 Aug 25 13:14:35.105795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2382/4817] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:34 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:35.608741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:35.621752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:35.641300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:35.650384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:35.651875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:35.654603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:35.655861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:35.657582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:35.686597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:35.711299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c2465bb-4602-4d2c-866d-5138f9f5adb1 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 1.902618 Aug 25 13:14:35.720093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:35.744654 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2436/4818] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:33 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:35.886492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e", "name": "network-vif-plugged", "status": "completed", "tag": "b8e6c6f1-b105-4c7c-bf29-48e620fabb28"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:35.941927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:35.946005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:35.947394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.008724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] Creating event network-vif-plugged:b8e6c6f1-b105-4c7c-bf29-48e620fabb28 for instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e on n-h1-850468-18 Aug 25 13:14:36.030883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2584569c-1498-4fec-8e7f-4b07d1dd853e req-3697fc77-4f45-4a40-a0cd-c173e9878236 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149398 Aug 25 13:14:36.032270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2437/4819] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:36.129033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:36.133615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:36.148749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.149730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.150686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.152082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.153033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.154274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.318730 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8db63bf2-c1a3-4224-9e98-e4f951125b22 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189104 Aug 25 13:14:36.320463 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2438/4820] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:36 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:36.782765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:36.793735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:36.838425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.845938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.851474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:36.855829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:36.857248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:36.862538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:37.171608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:37.204702 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c1a9e68b-1b69-4659-b9f0-3ea6bba2eb3a tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1682 microversion: 2.1 time: 1.599764 Aug 25 13:14:37.209632 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2383/4821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:35 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1682 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:37.358755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:37.392814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:37.433817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:37.434599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:37.447616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:37.452419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:37.459584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:37.463407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:37.679057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:37.680449 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8e57c1c-b8ce-482b-8fe9-c940f5617de0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.346560 Aug 25 13:14:37.682450 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2384/4822] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:37 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:37.697316 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b510e7b4-9e95-4372-ab82-1e7bc2c6bc3a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1313 microversion: 2.1 time: 0.921973 Aug 25 13:14:37.699820 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2439/4823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:36 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:38.138972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e35515f-2174-40a1-b6f6-2a2858d829bb", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e51f2e-a5ca-4e38-9882-59c845c95372"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:38.162693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.163544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.164658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.208511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] Creating event network-vif-unplugged:d3e51f2e-a5ca-4e38-9882-59c845c95372 for instance 5e35515f-2174-40a1-b6f6-2a2858d829bb on n-h1-850468-18 Aug 25 13:14:38.262820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a9197fba-f9d2-4058-8714-932b28af2db9 req-2b284bd0-5348-46e8-a4af-34b4d5b222a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133078 Aug 25 13:14:38.283092 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2385/4824] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:14:38.310366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:38.324052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:38.382480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.383184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.398438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.405532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.419810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.427230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.729770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:38.773730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:38.820097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.826716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.830379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.837963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:38.839614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:38.840746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:38.918792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:38.986456 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c906c5fb-085e-414e-9767-745686ac5c03 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1614 microversion: 2.1 time: 0.683252 Aug 25 13:14:38.996384 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2440/4825] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:38 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1614 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:39.011148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b989e52-8d01-4e74-aaed-7cb3d32f1036 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.314401 Aug 25 13:14:39.021054 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2386/4826] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:38 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:14:39.065267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:39.084787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:39.110755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:39.112684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:39.114294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:39.118862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:39.120571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:39.122034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.045393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:40.058310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:40.076959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:40.135222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.142877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.148872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.152073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.160836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.162219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.202350 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-342b24c1-9ee0-47a5-91ec-7ba8a64d70ce tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1496 microversion: 2.1 time: 1.190768 Aug 25 13:14:40.205643 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2441/4827] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:38 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1496 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:40.240546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:40.245196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:40.278645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.279837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.284861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.286579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.288339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.292453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.458557 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b339c2ba-39fb-48c1-b7bb-f804ff2b7d09 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.424387 Aug 25 13:14:40.467840 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2387/4828] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:40 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:40.491339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e35515f-2174-40a1-b6f6-2a2858d829bb", "name": "network-vif-deleted", "tag": "d3e51f2e-a5ca-4e38-9882-59c845c95372"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:40.519858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:40.521406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:40.522642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:40.551800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] Creating event network-vif-deleted:d3e51f2e-a5ca-4e38-9882-59c845c95372 for instance 5e35515f-2174-40a1-b6f6-2a2858d829bb on n-h1-850468-18 Aug 25 13:14:40.571832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-84df25eb-2f77-4888-aa75-950ade0e02a9 req-47f03845-6e00-4c74-98c1-48b1a019e583 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095992 Aug 25 13:14:40.574347 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2388/4829] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:40.740880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916a9effd2334a1b909f03a6c7d0997a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aae972b1104fe1b08c1cfa13f5ac99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:40.791951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2faa9176-a399-4c2d-a5ca-3a519405bf16 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 200 len: 1614 microversion: 2.1 time: 0.577660 Aug 25 13:14:40.800525 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2442/4830] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:40 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 1614 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:41.496155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:41.510057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:41.542654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:41.548629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:41.551144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:41.556943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:41.559894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:41.568736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:41.799337 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee0c746c-c48e-462f-9cde-7d0761fea41d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.319263 Aug 25 13:14:41.818601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2389/4831] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:41 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:41.851965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:41.858907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:41.940685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:41.941613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:41.942413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:41.943767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:41.955999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:41.956890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:42.054641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb HTTP/1.1 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5e35515f-2174-40a1-b6f6-2a2858d829bb'} Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:42.058492 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:14:42.070233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:14:42.075543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:14:42.078102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-44e607df-e4e3-426c-a26f-4a9890ff6df6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 404 len: 111 microversion: 2.1 time: 0.243396 Aug 25 13:14:42.081712 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2443/4832] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:41 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:14:42.096897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0a730fa9-8cab-4dc1-b901-024fc5fb04b3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '.version_select at 0x7fc6c1218b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:42.146215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0a730fa9-8cab-4dc1-b901-024fc5fb04b3 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452479651" status: 202 len: 0 microversion: 2.1 time: 0.056161 Aug 25 13:14:42.151510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2390/4833] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 13:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452479651 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:14:42.829066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:42.841313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:42.898482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:42.899504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:42.899731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:42.909318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:42.915809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:42.917061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:42.928018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:42.931477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:42.987797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:42.998870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:42.999774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:43.004085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:43.005375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:43.009051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:43.090206 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0a86347-f07e-489f-ad9f-772237bc18b2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.275016 Aug 25 13:14:43.111972 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2444/4834] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:42 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:43.186377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:43.521778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd79ab26-83f2-4cff-89fb-aba756590df5 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 204 len: 0 microversion: 2.1 time: 0.613202 Aug 25 13:14:43.524661 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2391/4835] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:14:42 2022] DELETE /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:14:43.543760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:43.549195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:43.574675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:43.575564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:43.576425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:43.577742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:43.590589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:43.596302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:44.131417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:44.154337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:44.167758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:44.210386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:44.211266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:44.212308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:44.213625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:44.228609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:44.229634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:44.450683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92b69359-9406-4c87-a73f-cca9aecfe111 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.341035 Aug 25 13:14:44.462053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2392/4836] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:44 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:14:44.485571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:44.526535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f375b3a3-adf8-4826-8e01-cdd5f7980ea3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1502 microversion: 2.1 time: 0.994173 Aug 25 13:14:44.527626 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2445/4837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:43 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1502 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:14:45.482726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:45.486623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:45.542420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:45.552238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:45.552238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:45.552238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:45.552238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:45.552238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:45.570722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:45.576893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:45.613093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:45.617591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:45.617591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:45.618175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:45.627298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:45.628548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:45.629378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:45.740187 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e72ac53-f526-4b8d-98e0-acb9f9c8fcec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.255082 Aug 25 13:14:45.742979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2393/4838] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:45 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:14:46.765429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:46.784595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:46.810523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:46.811526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:46.812325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:46.814179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:46.815700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:46.816740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:46.942269 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ef590a6-4fdf-462a-873a-483d6e0f125c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.166623 Aug 25 13:14:46.943720 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2394/4839] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:46 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:47.335436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:47.377445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9f2441e-c885-45d6-a144-225f2ff76b7e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1502 microversion: 2.1 time: 1.816523 Aug 25 13:14:47.392150 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2446/4840] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:45 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1502 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:47.968791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:47.972982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:47.992629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:47.993707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:47.994929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:47.997771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:47.999274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:48.001710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.093722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e12450ea-367b-4ff5-8e6c-6d4b0fc7e085 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136786 Aug 25 13:14:48.097683 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2395/4841] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:47 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:48.113806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e", "name": "network-vif-deleted", "tag": "b8e6c6f1-b105-4c7c-bf29-48e620fabb28"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:48.177071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:48.180591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:48.181697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.291209 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] Creating event network-vif-deleted:b8e6c6f1-b105-4c7c-bf29-48e620fabb28 for instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e on n-h1-850468-18 Aug 25 13:14:48.329875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-330d66aa-68e8-4a2b-b62e-12e4fefb38dc req-c7da4179-1eed-4b4b-b97a-ff5b742e8dab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222679 Aug 25 13:14:48.333203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2447/4842] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:14:48.425476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:48.428109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:48.465589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:48.471963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:48.475679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.479388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:48.481513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:48.482319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.638709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:48.639651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:48.640562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:48.642062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lazy-loading 'fault' on Instance uuid 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:14:48.885754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:48.915608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef27ed2d-5f9a-41b0-9f27-e4c2e274e73a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 200 len: 1303 microversion: 2.1 time: 0.504267 Aug 25 13:14:48.939633 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2396/4843] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:48 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 1303 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:49.124785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:49.149358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:49.200991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:49.200991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:49.200991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:49.210939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:49.211803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:49.212641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:49.380089 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02d0dbc0-b333-4964-a9fc-e2787530719b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.269348 Aug 25 13:14:49.396425 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2448/4844] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:49 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:49.961351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:49.965338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:50.006935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.008389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.013164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.014874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.017280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.023902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.061534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] HTTP exception thrown: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Request method failure captured: Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e HTTP/1.1 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Whrh78dUuqP3tAgLkI3JMeWhPEvdhDIocghpiUAl8MYtXKsws7JHoMwqg80SZxoYhCoNJAUXcyrKlHD9eUnOxRruqh-eFikxOJSzqagVj7Pd4l-9DUdYCBJCHv8MG0cFmQyWLEDdIx0sZ32I6EQwG3UaMWdqgfrpDCia3UY79_dTw Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: adbf1358a205453f843ed96473be65f3 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesActionsTest-1728792897 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adbf1358a205453f843ed96473be65f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adbf1358a205453f843ed96473be65f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adbf1358a205453f843ed96473be65f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adbf1358a205453f843ed96473be65f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesActionsTest-1728792897 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: adbf1358a205453f843ed96473be65f3 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesActionsTest-1728792897 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesActionsTest-1728792897-project Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f8dff9d749e044e98a4e93c81b8f65d0 Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesActionsTest-1728792897-project Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e'} Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:14:50.066529 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. Aug 25 13:14:50.075935 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:14:50.081068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Returning 404 to user: Instance 3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:14:50.081512 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9eaffb92-90f2-4f06-9bd5-b9552ef59628 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e" status: 404 len: 111 microversion: 2.1 time: 0.129089 Aug 25 13:14:50.083401 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2397/4845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:49 2022] GET /compute/v2.1/servers/3ee5138c-2bb4-4d8a-8b6a-e2b8b173972e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:14:50.415445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:50.425558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:50.462377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.470919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.472384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.482032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:50.483520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:50.485337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:50.525677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1524247561", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "506d09a3-9012-4917-9e6c-fdb2f4fe21c8"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:50.660962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f5ee369-db22-4300-bfaa-5b9c85627dbb tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.257924 Aug 25 13:14:50.671846 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2449/4846] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:50 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:50.784798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] validate_networks() for [('506d09a3-9012-4917-9e6c-fdb2f4fe21c8', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:14:51.688613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:51.696637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:51.716308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.718230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.720218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:51.724364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:51.726670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:51.728846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:51.953837 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a4a2808-7999-4c7e-9699-1248ab23754e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.273943 Aug 25 13:14:51.965120 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2450/4847] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:51 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 197 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:14:52.054541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:14:52.055342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:14:52.056479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:14:52.057173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:14:52.057637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:14:52.117499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:52.132422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:52.133292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:52.134737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:52.135564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:52.136385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:52.326414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Getting quotas for project adbf1358a205453f843ed96473be65f3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:14:52.376424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Getting quotas for user f8dff9d749e044e98a4e93c81b8f65d0 and project adbf1358a205453f843ed96473be65f3. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:14:52.439532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:14:52.449007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:14:52.683188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43abc886-915f-49be-bb2d-db765c371889 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.172152 Aug 25 13:14:52.685529 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2398/4848] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:14:52.705694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13de2aa8-6beb-4b41-8fcb-b5551366121e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:52.708614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13de2aa8-6beb-4b41-8fcb-b5551366121e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:52.983963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:52.996702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:53.007398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13de2aa8-6beb-4b41-8fcb-b5551366121e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:53.032657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.037618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.040064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.042674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13de2aa8-6beb-4b41-8fcb-b5551366121e tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1214 microversion: 2.1 time: 0.342710 Aug 25 13:14:53.056158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.056158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.056158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.072003 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2451/4849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:52 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:53.201052 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b760c3f9-3442-4cde-9131-c82cae75054b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.227487 Aug 25 13:14:53.213112 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2399/4850] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:14:52 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420/os-volume_attachments => generated 25 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:53.505577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:53.508732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:53.539074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.546792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.549330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.553652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:53.554996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:53.563986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:53.678656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:14:53.983883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cdd90286-da21-4dfd-9fcf-771af72b7e12 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 204 len: 0 microversion: 2.20 time: 0.479666 Aug 25 13:14:54.009327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:54.010387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:54.012239 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2452/4851] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:14:53 2022] DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:14:54.035403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:54.037440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:54.037663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:54.039037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:54.039933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:54.040805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:54.115209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f20ff8f-ae34-426e-8520-c6d3e3c8edf6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:54.121919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f20ff8f-ae34-426e-8520-c6d3e3c8edf6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:54.590316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f20ff8f-ae34-426e-8520-c6d3e3c8edf6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:54.636266 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f20ff8f-ae34-426e-8520-c6d3e3c8edf6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1214 microversion: 2.1 time: 0.543868 Aug 25 13:14:54.639932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2453/4852] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:54 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1214 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:54.850530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:54.890114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:54.899418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:54.902615 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2105bd5-e58e-4103-b447-031141e208af tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.900591 Aug 25 13:14:54.912528 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2400/4853] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:53 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:55.684224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:55.685224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:55.729030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.732588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.734175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.737707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:55.741972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:55.743260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:55.767012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:55.959557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:55.960790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:56.022435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:56.023794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:56.024966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:56.026681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:56.027951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:56.028976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:56.120814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:14:56.236303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.271215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d793052c-2f2a-426a-ab95-c41405bd93a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1210 microversion: 2.1 time: 0.594244 Aug 25 13:14:56.282062 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2454/4854] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:55 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1210 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:56.865833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.897491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.913437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:56.917363 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e08c705c-eda7-4b5d-b9c4-390c933017e7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 0.964791 Aug 25 13:14:56.932675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2401/4855] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:55 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:57.326479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:57.331340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:57.364161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:57.365698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:57.367025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:57.372872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:57.374340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:57.376761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:57.757386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:57.851449 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-429033c3-83b1-4a03-9f56-e7b2b60c2f7b tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1272 microversion: 2.1 time: 0.532097 Aug 25 13:14:57.874023 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2455/4856] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:57 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1272 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:57.976461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:57.982231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:58.031887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.040143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.043707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.048963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.057675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.061535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.933519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:14:58.938070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:14:58.972769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.987881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:58.989459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:58.991792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:58.993864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.026274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:59.522354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.557876 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4578664e-69bb-445d-ae53-d75435bc5baa tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1272 microversion: 2.1 time: 0.628737 Aug 25 13:14:59.563632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.585708 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2456/4857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:14:58 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1272 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:14:59.604281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-unplugged", "status": "completed", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:14:59.633960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.645074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:14:59.648401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:14:59.659939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:14:59.662456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:14:59.663295 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e27c7a29-d704-45fc-a4cd-94405702b165 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1720 microversion: 2.20 time: 1.700325 Aug 25 13:14:59.667695 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2402/4858] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:14:57 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1720 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:14:59.712220 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] Creating event network-vif-unplugged:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:14:59.742225 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-57810803-b5a3-4858-9b16-35d38da69f41 req-dc6dc298-4eb8-4b4c-90de-13970aec48fd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148791 Aug 25 13:14:59.748855 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2457/4859] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:00.606196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:00.607395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:00.664944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.665895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.666684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.668008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.682496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.683531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.725192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:00.732665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:00.777963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.783506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.791409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:00.801678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:00.803426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:00.806732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:01.427593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.465534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d424f17-5958-4079-b637-cd6ad783dbec tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1272 microversion: 2.1 time: 0.861329 Aug 25 13:15:01.473022 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2403/4860] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:00 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1272 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:01.497048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:01.500549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.502426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:01.569409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:01.576282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:01.583112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:01.591520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.593054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:01.598454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:01.604809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:01.614521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:01.624848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c37cb144-5f8d-4c8b-82e9-c3c6529b618d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1653 microversion: 2.20 time: 0.906959 Aug 25 13:15:01.633300 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2458/4861] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:00 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1653 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:02.225594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:02.417322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:02.519143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:02.527106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:02.602599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.608196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.614310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:02.618305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:02.620917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:02.622243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.194105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:03.245450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d720601b-c678-48c2-a771-7f70f1b71744 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1272 microversion: 2.1 time: 0.736377 Aug 25 13:15:03.246983 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2459/4862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:02 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1272 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:03.270933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:03.272483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:03.303311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.309690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.311308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.314526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.320493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.328754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.503844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:03.540808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a84e140a-7e53-4c93-a125-072970065660 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.058732 Aug 25 13:15:03.542340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2404/4863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:01 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:03.559709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:03.566396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:03.610850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.622427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.625643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.628606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.630309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.635670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.731701 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb HTTP/1.1 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5e35515f-2174-40a1-b6f6-2a2858d829bb'} Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:03.734650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:03.744459 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:03.748164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:03.756341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0559b388-96c8-4481-a2dc-c5e66a394ece tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 404 len: 111 microversion: 2.1 time: 0.211664 Aug 25 13:15:03.767501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2405/4864] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:03 2022] DELETE /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:03.798096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:03.806274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:03.839584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.842223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.846156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:03.850623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:03.853109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:03.854243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.057887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:04.106915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:04.110827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:04.132061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4b6ea17-ee77-4dca-bbe1-bf440fa36786 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 200 len: 1653 microversion: 2.20 time: 0.862535 Aug 25 13:15:04.133032 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2460/4865] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:03 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 1653 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:04.165980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:04.167104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5e35515f-2174-40a1-b6f6-2a2858d829bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:04.227270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.237069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.241300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.250955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.254109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.270182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.396481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb HTTP/1.1 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5e35515f-2174-40a1-b6f6-2a2858d829bb'} Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:04.414543 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5e35515f-2174-40a1-b6f6-2a2858d829bb could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b22bec3-9daa-49ae-b848-09d560d31cb6 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb" status: 404 len: 111 microversion: 2.1 time: 0.286052 Aug 25 13:15:04.430852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2461/4866] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:04 2022] GET /compute/v2.1/servers/5e35515f-2174-40a1-b6f6-2a2858d829bb => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:04.460651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b2d44b-7481-4d0f-8d89-1e2227155420", "name": "network-vif-deleted", "tag": "745da371-fcda-4c07-b3d4-2e24e91dc2c6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:04.519671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.520965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.522583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.594316 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] Creating event network-vif-deleted:745da371-fcda-4c07-b3d4-2e24e91dc2c6 for instance 71b2d44b-7481-4d0f-8d89-1e2227155420 on n-h1-850468-18 Aug 25 13:15:04.622095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2240dffa-1db0-4a74-8c3f-782263add28d req-2b55cf25-5c31-4bbe-95de-9a091d68e447 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182592 Aug 25 13:15:04.635704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2462/4867] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:04.641589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:04.692151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:04.697935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:04.769014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.775435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.778126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:04.783153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:04.803848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:04.808576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.489254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:05.554290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5bea3597-4eb2-4a20-be43-42021d9df472 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.781685 Aug 25 13:15:05.588437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2406/4868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:03 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:05.635527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:05.642736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:05.667913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.674298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.675666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.684710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.688744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.690724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.784495 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 HTTP/1.1 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '71b2d44b-7481-4d0f-8d89-1e2227155420'} Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:05.797812 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:05.816630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b795c247-523d-4cf7-b9fc-4c3eb81a8176 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 404 len: 111 microversion: 2.20 time: 0.222759 Aug 25 13:15:05.821491 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2407/4869] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:05 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:15:05.835022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:05.838060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:05.852690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.854312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.855827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:05.857784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:05.859067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:05.860671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:06.837257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:06.869223 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1560463-6782-466d-9611-269ec3c47bd8 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 2.227472 Aug 25 13:15:06.870546 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2463/4870] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:04 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:06.901196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ae11928-3733-4eda-8088-ddf43dbca69a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '.version_select at 0x7fc6c17c1dc0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:06.981704 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ae11928-3733-4eda-8088-ddf43dbca69a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593200906" status: 204 len: 0 microversion: 2.20 time: 0.102865 Aug 25 13:15:06.982824 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2464/4871] 10.222.0.60 () {60 vars in 1259 bytes} [Thu Aug 25 13:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593200906 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:15:07.853514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:07.902375 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25f2b606-577a-480d-8913-38d1982b1f5e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.072862 Aug 25 13:15:07.913548 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2408/4872] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:05 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:07.924341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:07.926426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:07.963211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:07.970815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:07.972506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:07.975837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:07.985476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:07.987471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1491808015"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:07.988891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:07.993667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:08.045825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:08.049389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:08.051114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:08.054908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:08.059677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:08.072834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:09.224924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f61ad7e-9b63-42f1-bf5d-f2845c95f173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 1.262396 Aug 25 13:15:09.286470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2409/4873] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:15:07 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 25 13:15:10.012764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:10.056488 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-51d8b16b-2d24-4faf-978c-7003c64e9c4d tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 2.146292 Aug 25 13:15:10.061935 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2465/4874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:07 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:10.392298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c7541ed-541d-4de0-8661-1df1cb9308b4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: .version_select at 0x7fc6c1c3e9d0>, body: {"keypair": {"name": "tempest-keypair-350251063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9Q+n3+scNtZIn+vMDRlOl/q9641zbDT81kyz/u36Wuosq45mLhL8DJr+MkSINiDeQtfNbERNEcRGCjWrBBzrluN0bvmYo2gbdJfeNy7u+H2+Se6vaaA0jQXf4Zo4NWhw=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:10.483957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c7541ed-541d-4de0-8661-1df1cb9308b4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for project 022896ed488444869702ebfc14d206ba. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:15:10.497973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2c7541ed-541d-4de0-8661-1df1cb9308b4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for user b10100bafac8484095f6348ca67abc7c and project 022896ed488444869702ebfc14d206ba. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:15:10.580528 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c7541ed-541d-4de0-8661-1df1cb9308b4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.197965 Aug 25 13:15:10.582470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2410/4875] 10.222.0.60 () {62 vars in 1200 bytes} [Thu Aug 25 13:15:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 13:15:11.114169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:11.125237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:11.230566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:11.232026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:11.243424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:11.248334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:11.249198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:11.250117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:11.424522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cdc33b-507b-4f44-a952-a121221060b1", "tag": "f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:11.467548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:11.469447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:11.474476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:11.544820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] Creating event network-changed:f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6 for instance b1cdc33b-507b-4f44-a952-a121221060b1 on n-h1-850468-18 Aug 25 13:15:11.564435 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-150a2cb0-af0f-4a50-8d58-afdd11fb6365 req-01583f91-07af-48ee-9fe0-a30147d910e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172915 Aug 25 13:15:11.566606 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2411/4876] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:15:13.320600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:13.361271 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd31fb6b-f462-4c48-8736-f337ba4e4142 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 2.258209 Aug 25 13:15:13.363075 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2466/4877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:11 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:14.413288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:14.416036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:14.443323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:14.444410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:14.445402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:14.446752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:14.448235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:14.451209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:14.910618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:14.930982 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52037805-7fef-4b91-98a2-e88abc47ea30 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 0.530920 Aug 25 13:15:14.933859 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2412/4878] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:14 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:15.992067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:15.996490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:16.047604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:16.054865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:16.056035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:16.061324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:16.066516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:16.068809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:16.074823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:16.626157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:16.677156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1727e03c-f872-4b7c-b110-3037f9cdf615 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 0.699448 Aug 25 13:15:16.678246 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2467/4879] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:15 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:17.441905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:17.444041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:17.481974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:17.494797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.497646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.500462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.504615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.507883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.511886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.558414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce HTTP/1.1 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4e11534e-e7d6-4476-97ba-107c7b14e4ce'} Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:17.566692 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.580229 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.592268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:17.597959 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd31fe18-6494-4691-ab4a-cc71f328b8f9 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 404 len: 111 microversion: 2.1 time: 0.165281 Aug 25 13:15:17.626367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2413/4880] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:17 2022] DELETE /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:17.629480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:17.631997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 4e11534e-e7d6-4476-97ba-107c7b14e4ce] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:17.650364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.651761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.652914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.657496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.659237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.660535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.717646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:17.728452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:17.754181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.755665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.757172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.762169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:17.764090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:17.767464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:17.780206 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce HTTP/1.1 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '4e11534e-e7d6-4476-97ba-107c7b14e4ce'} Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:17.786745 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. Aug 25 13:15:17.801627 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:17.805356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 4e11534e-e7d6-4476-97ba-107c7b14e4ce could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:17.807460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-797133af-c3cb-449a-9a31-03ea35994312 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce" status: 404 len: 111 microversion: 2.1 time: 0.192035 Aug 25 13:15:17.809634 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2468/4881] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:17 2022] GET /compute/v2.1/servers/4e11534e-e7d6-4476-97ba-107c7b14e4ce => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:17.822813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-678560868", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab57234e-c504-4e90-9f0d-8a5ae81fc5d3"}], "security_groups": [{"name": "tempest-securitygroup--1112971626"}], "key_name": "tempest-keypair-350251063", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:18.565665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] validate_networks() for [('ab57234e-c504-4e90-9f0d-8a5ae81fc5d3', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:15:19.287594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:19.333325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0bc1714d-9c73-45bc-b2d5-1e6351b249eb tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 1.623980 Aug 25 13:15:19.354422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2414/4882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:17 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:19.385450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:19.387442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:19.415965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.419514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.421452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.425664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.430738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.434561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.542362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 HTTP/1.1 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a916a149-bce9-4430-984d-765d5fee3298'} Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:19.555415 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.574267 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.580673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:19.588215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c234c407-9b22-412e-82d8-fb622d09c5eb tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 404 len: 111 microversion: 2.1 time: 0.228424 Aug 25 13:15:19.592831 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2415/4883] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:19 2022] DELETE /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:19.626090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:19.628154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: a916a149-bce9-4430-984d-765d5fee3298] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:19.655810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.662705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.664074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.668556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:19.671712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:19.672796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:19.738814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 HTTP/1.1 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a916a149-bce9-4430-984d-765d5fee3298'} Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:19.743016 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:19.755389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance a916a149-bce9-4430-984d-765d5fee3298 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:19.758859 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-62345322-3f1c-4faf-a3b3-70258c8b5a30 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298" status: 404 len: 111 microversion: 2.1 time: 0.159861 Aug 25 13:15:19.761955 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2416/4884] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:19 2022] GET /compute/v2.1/servers/a916a149-bce9-4430-984d-765d5fee3298 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:20.411157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:20.443180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:20.489773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:20.491734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:20.498986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:20.502384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:20.523591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:20.528247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:20.535715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:21.557660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:21.604076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed1edff1-105f-4979-8cea-a336af9d01e3 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 1.204819 Aug 25 13:15:21.621380 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2417/4885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:20 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:21.665216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-plugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:21.707680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:21.708923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:21.710216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:21.754636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] Creating event network-vif-plugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:15:21.769562 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6b500164-7c24-4a6b-a93f-b9f475100368 req-51b52a52-332d-4126-a14b-60950cedd739 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116777 Aug 25 13:15:21.771869 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2418/4886] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:22.156828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:15:22.157781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:15:22.158863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:15:22.161436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:15:22.163137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:15:22.219546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.225599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.231572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.235182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.238000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.244086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.346272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for project 022896ed488444869702ebfc14d206ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:15:22.373752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Getting quotas for user b10100bafac8484095f6348ca67abc7c and project 022896ed488444869702ebfc14d206ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:15:22.415794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:15:22.421536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:15:22.553413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6d34014-a1d8-433e-8245-5d91fa1dd4b0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.741171 Aug 25 13:15:22.555850 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2469/4887] 10.222.0.60 () {62 vars in 1188 bytes} [Thu Aug 25 13:15:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 4745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 13:15:22.578848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:22.580260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:22.650984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:22.659166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:22.697945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.698779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.699605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.700946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:22.701669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:22.713221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:22.744143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:22.762726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:22.770355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:22.776254 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fea2ef66-1531-4c89-a09a-ef973de0c581 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1280 microversion: 2.20 time: 0.205636 Aug 25 13:15:22.786263 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2419/4888] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:22 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:23.227498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:23.258744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4733a72f-0864-49d0-95d0-41ee975e94a6 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 0.613768 Aug 25 13:15:23.259712 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2470/4889] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:22 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:23.850113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:23.857938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:23.975813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cdc33b-507b-4f44-a952-a121221060b1", "name": "network-vif-plugged", "status": "completed", "tag": "f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:24.042926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:24.051900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:24.055061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:24.138266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:24.149345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] Creating event network-vif-plugged:f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6 for instance b1cdc33b-507b-4f44-a952-a121221060b1 on n-h1-850468-18 Aug 25 13:15:24.187741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3f729dda-2413-4f64-ba98-2717b05d48fb req-5d4c0a07-cce2-4976-a8c9-3ef282ef8db6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218355 Aug 25 13:15:24.196143 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2471/4890] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:24.203888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:24.243184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:24.256480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8883ba85-aff2-4004-9982-6f6937d05bfc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1280 microversion: 2.20 time: 0.421031 Aug 25 13:15:24.294679 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2420/4891] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:23 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1280 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:24.313143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:24.316367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:24.342629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:24.352085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:24.363765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:24.368583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:24.370051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:24.373106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:25.186545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:25.235781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de737156-761f-464a-84f4-c42997f07bb9 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 0.929280 Aug 25 13:15:25.244959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2472/4892] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:24 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:25.346488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:25.351604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:25.384862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:25.387045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:25.388323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:25.391183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:25.393297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:25.394652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:25.588755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:25.620846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:25.630681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:25.633685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-264c88b7-9d11-4269-ace4-f049653aa445 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1332 microversion: 2.20 time: 0.300777 Aug 25 13:15:25.641225 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2421/4893] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:25 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1332 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:15:26.286140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:26.292588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:26.333740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:26.335371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:26.339101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:26.362627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:26.378011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:26.381335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:26.591773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=83 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:26.727195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:26.739049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:26.800381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:26.808135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:26.809806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:26.826985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:26.830196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:26.852173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:26.991825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:27.695460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:27.745770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:27.756253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:27.759040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f9db93f-ad1c-428f-aa43-1c29e1ea0c8d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1332 microversion: 2.20 time: 1.075400 Aug 25 13:15:27.762007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2422/4894] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:26 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1332 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:27.797610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:27.824843 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b474ef9-46e0-48e0-a5ff-0507670d0d32 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1314 microversion: 2.1 time: 1.547857 Aug 25 13:15:27.832394 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2473/4895] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:26 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1314 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:28.813851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:28.818829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:28.886354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:28.892136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:28.901461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:28.913691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.914214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:28.916719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:28.921077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.929198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:28.941578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:28.946721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.950144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:28.952016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:28.960442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:28.964363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:29.382326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:29.428879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:29.440901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:29.446319 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b040a853-8a3f-4ae6-8a85-8ea086acbaa8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1338 microversion: 2.20 time: 0.641187 Aug 25 13:15:29.451537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2423/4896] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:28 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1338 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:29.949244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:29.994678 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f903883-0869-4016-b7b6-cf385c555fa2 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1497 microversion: 2.1 time: 1.121343 Aug 25 13:15:29.998979 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2474/4897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:28 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1497 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:30.508518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:30.510874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:30.557322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:30.560306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:30.571437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:30.573853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:30.577182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:30.581203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:31.078816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:31.122305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:31.133119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:31.139937 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2fc4d37f-e6e1-42fa-b640-5a5c06ee189b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1338 microversion: 2.20 time: 0.645306 Aug 25 13:15:31.143497 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2424/4898] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:30 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1338 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:15:31.997880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:31.998762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:32.075184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.079376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.080911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.084333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.088929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.094991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.143200 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 HTTP/1.1 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5cb7ef98-982d-48b7-8a79-dde08ea77ee7'} Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:32.149941 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.157878 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.171535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:32.191548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:32.196049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:32.205347 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9341fae-3cb6-48fe-a9c6-cf9a23608c8c tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 404 len: 111 microversion: 2.1 time: 0.236943 Aug 25 13:15:32.207349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2475/4899] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:31 2022] DELETE /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:32.225323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:32.226687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] [instance: 5cb7ef98-982d-48b7-8a79-dde08ea77ee7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:32.244738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.248219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.249852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.254978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.258661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.260325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.310993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.328675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.329984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.332251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.332759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:32.333898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.336461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.337194 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] HTTP exception thrown: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Request method failure captured: Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 HTTP/1.1 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3K0ZQFfIfLtKX431g6VqvryE00N56HPRtXvN2C-TzIJ_e93MvMxJh2pPPURYT8R8IRySrrLH84L-ce5DbgOaCiaRYjTjwhcv5zCZoGE-CC-BprtKCGi1tyDJhHsl3rN60m4-piJDbUP6sRCGU7SqW4oeqaUO9tKwtfVj-d8BKZKPjw Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b0aae972b1104fe1b08c1cfa13f5ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b0aae972b1104fe1b08c1cfa13f5ac99 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1637816364 Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 916a9effd2334a1b909f03a6c7d0997a Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeNegativeTest-1637816364-project Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '5cb7ef98-982d-48b7-8a79-dde08ea77ee7'} Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:32.344486 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. Aug 25 13:15:32.354166 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:15:32.359855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] Returning 404 to user: Instance 5cb7ef98-982d-48b7-8a79-dde08ea77ee7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:32.376697 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbaa86f8-8a22-4ce2-9cad-6aefc9d09c58 tempest-AttachVolumeNegativeTest-1637816364 tempest-AttachVolumeNegativeTest-1637816364-project] 10.222.0.60 "GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7" status: 404 len: 111 microversion: 2.1 time: 0.155212 Aug 25 13:15:32.386976 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2476/4900] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:32 2022] GET /compute/v2.1/servers/5cb7ef98-982d-48b7-8a79-dde08ea77ee7 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:32.888298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:32.889725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:32.898681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:32.973079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.981687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:32.983678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:32.989881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:32.997440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.002771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.241930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:15:33.746302 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2c0e96d8-7da2-4f55-a3d7-1408f9c6fd84 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 204 len: 0 microversion: 2.1 time: 0.867935 Aug 25 13:15:33.750390 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2477/4901] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:15:32 2022] DELETE /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:15:33.776836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:33.785358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:33.815236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.820744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.821963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.823886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:33.827443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:33.831853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:33.877103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:33.952475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:33.965187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:33.970854 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a1024ab-439f-4499-9089-01ef562c5f2a tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 1.786728 Aug 25 13:15:33.979020 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2425/4902] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:32 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:35.046016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:35.054334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:35.085427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:35.104058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.108096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.111788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:35.114688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:35.120243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:35.122072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:36.397186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.450196 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50a41b34-2af3-4852-ac44-4533a2f17056 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1503 microversion: 2.1 time: 2.687462 Aug 25 13:15:36.464239 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2478/4903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:33 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1503 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:36.809716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.845940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.849374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:36.851822 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9518e68-d906-4734-8c5e-745e3be31019 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 1.820513 Aug 25 13:15:36.852989 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2426/4904] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:35 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:37.498303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:37.505556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:37.556854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:37.567103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:37.568652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:37.570747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:37.574528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:37.575972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:37.922367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:37.923557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:37.955307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:37.961543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:37.962834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:37.965819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:37.974127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:37.975427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:39.963158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:40.038474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-faac7443-c60b-40af-9e9d-da812797601a tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1503 microversion: 2.1 time: 2.550962 Aug 25 13:15:40.048552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2479/4905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:37 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1503 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:15:40.085040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:40.117201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:40.138776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:40.144507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:40.147322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:40.174317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:40.182144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:40.195389 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f85448be-82ec-4cd0-ba25-c5cb7d0dce50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 2.276758 Aug 25 13:15:40.200755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2427/4906] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:37 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:40.256107 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] Creating event network-changed:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:15:40.268962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1c8d5730-b037-4b37-a83c-39fc8f5e13ab req-a75afa5c-12ab-4c82-9279-c40dfe842c0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217649 Aug 25 13:15:40.279230 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2480/4907] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:41.127026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:41.132889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:41.210185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:41.212461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:41.219006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:41.224091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:41.225716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:41.227546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:41.253592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:41.259817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:41.330524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:41.331184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:41.337583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:41.346780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:41.349935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:41.353631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:43.946489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8dff9d749e044e98a4e93c81b8f65d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbf1358a205453f843ed96473be65f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:43.976562 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c146a0d-ebe2-4971-9843-77bfb8059dd4 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 200 len: 1299 microversion: 2.1 time: 2.887792 Aug 25 13:15:43.990838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2428/4908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:41 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 1299 bytes in 2902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:15:44.024281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cdc33b-507b-4f44-a952-a121221060b1", "name": "network-vif-deleted", "tag": "f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:44.080060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:44.081672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:44.082931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:44.113224 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] Creating event network-vif-deleted:f8485cf7-2b8a-4c0d-9c12-b53b2701e6f6 for instance b1cdc33b-507b-4f44-a952-a121221060b1 on n-h1-850468-18 Aug 25 13:15:44.126577 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bfdc7c48-025f-49e4-8183-771401dc4ef2 req-bb5a85f5-15f0-43ff-bc60-aaf9735a0e15 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131784 Aug 25 13:15:44.128737 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2429/4909] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:15:44.482398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:44.525370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:44.545176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:44.554656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4fa509c8-348c-4c8c-be30-2a86e54b95a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 3.304813 Aug 25 13:15:44.555840 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2481/4910] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:41 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 3314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:15:45.029998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:45.045700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] [instance: b1cdc33b-507b-4f44-a952-a121221060b1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:45.083941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.084897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.085703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:45.086977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.087814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.088636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:45.157653 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] HTTP exception thrown: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Request method failure captured: Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 HTTP/1.1 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Whrh78dUuqP3tAgLkI3JMeWhPEvdhDIocghpiUAl8MYtXKsws7JHoMwqg80SZxoYhCoNJAUXcyrKlHD9eUnOxRruqh-eFikxOJSzqagVj7Pd4l-9DUdYCBJCHv8MG0cFmQyWLEDdIx0sZ32I6EQwG3UaMWdqgfrpDCia3UY79_dTw Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: adbf1358a205453f843ed96473be65f3 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesActionsTest-1728792897 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_adbf1358a205453f843ed96473be65f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/adbf1358a205453f843ed96473be65f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adbf1358a205453f843ed96473be65f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/adbf1358a205453f843ed96473be65f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesActionsTest-1728792897 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: adbf1358a205453f843ed96473be65f3 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesActionsTest-1728792897 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesActionsTest-1728792897-project Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: f8dff9d749e044e98a4e93c81b8f65d0 Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesActionsTest-1728792897-project Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'b1cdc33b-507b-4f44-a952-a121221060b1'} Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:15:45.161364 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] Returning 404 to user: Instance b1cdc33b-507b-4f44-a952-a121221060b1 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78812b6b-dad9-44fc-adb2-c29ffd688f97 tempest-VolumesActionsTest-1728792897 tempest-VolumesActionsTest-1728792897-project] 10.222.0.60 "GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1" status: 404 len: 111 microversion: 2.1 time: 0.151035 Aug 25 13:15:45.185663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2430/4911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:15:45 2022] GET /compute/v2.1/servers/b1cdc33b-507b-4f44-a952-a121221060b1 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:15:45.627316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:45.639021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:45.697027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.702494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.714635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:45.716524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:45.719386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:45.727490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:46.592542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:46.657813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:46.672761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:46.698219 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a763cbac-9dc8-46a2-bdfe-9742d2d44bee tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 1.096502 Aug 25 13:15:46.708066 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2482/4912] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:45 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:47.758132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:47.771849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:47.801723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:47.829105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:47.830059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:47.831104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:47.866797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:47.869568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:47.873616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:48.806970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:48.829639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:48.835159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:48.840062 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b3f44ec-8497-4a2d-b51d-aace3ad3da42 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 1.088871 Aug 25 13:15:48.842310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2431/4913] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:47 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:49.897255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:49.903944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:49.934174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:49.951174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:49.953211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:49.958880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:49.966513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:49.969600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:49.973542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:50.727288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:50.767964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:50.771803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:50.794588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb9768b8-6e4a-4022-97d2-e00c46885cc2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 0.907636 Aug 25 13:15:50.817216 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2483/4914] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:49 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:51.847782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:51.849014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:51.893588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:51.894897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:51.901094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:51.903377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:51.904698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:51.906358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:53.062547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:53.113043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:53.118827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:53.123227 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1c5107f-e370-46a7-b71b-a727f3be5213 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 1.282670 Aug 25 13:15:53.127588 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2432/4915] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:51 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:54.200192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:54.211802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:54.345952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:54.347458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:54.357326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:54.367507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:54.373054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:54.374906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:54.494977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-plugged", "status": "completed", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:15:54.570783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:54.574657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:54.579834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:54.662214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] Creating event network-vif-plugged:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:15:54.675133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3ba73f68-45e6-4a6b-9e93-f5b61f029fc3 req-6246b4fa-73dc-4080-b13c-fd5b88928070 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186678 Aug 25 13:15:54.677344 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2433/4916] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:15:56.496984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:56.522295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:56.529412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:56.534408 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c13a90e5-6b7c-4b29-a19b-71d997f1f9f0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1406 microversion: 2.20 time: 2.365192 Aug 25 13:15:56.537017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2484/4917] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:54 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1406 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:57.606297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:57.614554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:57.653216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.655257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.656677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.661521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:57.663305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:57.664812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:57.686132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=60 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:58.818396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:58.874000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:58.877765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:15:58.906718 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-43d97236-f99a-4f2a-ae32-d73e0de5fa70 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1597 microversion: 2.20 time: 1.298609 Aug 25 13:15:58.911688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2434/4918] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:15:57 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1597 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:15:58.982013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:15:58.985715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:15:59.031414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:59.033434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:59.041230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:59.045953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:15:59.050500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:15:59.054544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:15:59.151405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:15:59.467621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8faecd7f-9596-4b38-8522-ec62285cf3c9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.505602 Aug 25 13:15:59.469742 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2485/4919] 10.222.0.60 () {60 vars in 1316 bytes} [Thu Aug 25 13:15:58 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-interface => generated 284 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:16:06.314793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:06.378425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:06.379274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:06.380051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:06.462704 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] Creating event network-changed:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:16:06.499755 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-139df5cc-99be-4738-9365-45981f59fd41 req-c9274ad9-8427-44ea-9cd4-2a3495413df4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200795 Aug 25 13:16:06.501275 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2435/4920] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:07.950307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:07.951668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:08.045414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:08.046396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:08.047369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:08.048593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:08.050911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:08.051708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:11.347197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:11.416743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6bdba7d3-af58-4394-abda-4889587a0c94 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 3.475491 Aug 25 13:16:11.419527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2486/4921] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:07 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 3479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:12.153873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-unplugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:12.278046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.282249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.286667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.396537 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] Creating event network-vif-unplugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:16:12.455040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b8adf3e2-5e70-48f5-ace0-417f657b9838 req-576bc0f6-6c60-4ef6-8c5d-15e92065e341 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.308043 Aug 25 13:16:12.463787 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2436/4922] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:16:12.474960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:16:12.484566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:12.541017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.541840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.542992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:12.546795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:12.551671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:12.556136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.473800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:16:13.530076 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e8237f2-8f3c-4056-9f8d-61d3af9bcdc0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.075682 Aug 25 13:16:13.539166 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2487/4923] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:16:12 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:16:13.591737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-961021635"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:13.642498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:16:13.717133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.718837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.721617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:13.763722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:13.789098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.065s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:13.790057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:14.710642 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12ecc71e-10e3-46a4-bf99-9068e4db2753 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 1.130623 Aug 25 13:16:14.712341 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2437/4924] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:16:13 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 25 13:16:27.053827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-plugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:16:27.083261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=9 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:27.085339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=15 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:16:27.101376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:16:27.102840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:16:27.103958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:16:27.162975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] Creating event network-vif-plugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:16:27.181298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8d95fc2d-a878-4118-8c1a-651ed9b1f3fa req-7099476b-d3c8-414f-9095-8cafd72c2a35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136053 Aug 25 13:16:27.183296 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2488/4925] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:04.755332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:04.766303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:04.789589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=13 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:04.793713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:04.819391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:04.820176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:04.829179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:04.830635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:04.831917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:04.832861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:06.188487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:06.210082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5fc1cbef-83b9-4c22-93fc-c99f33570f6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.502922 Aug 25 13:17:06.211844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2438/4926] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:04 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:07.263137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:07.271613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:07.290698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:07.302837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:07.354988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.362917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.372149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:07.383218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:07.386893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:07.390728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:08.225401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:08.250421 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3cb2aca9-f07b-4698-a196-29aad30e4d86 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.004487 Aug 25 13:17:08.252706 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2489/4927] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:07 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:08.295882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1655595091"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:08.322172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:08.375128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:08.375974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:08.376789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:08.378040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:08.378856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:08.379744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.013000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-unplugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:09.069825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.070948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.075431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.138030 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] Creating event network-vif-unplugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:17:09.156245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-86a410f4-365a-491a-b031-d5f2f793a614 req-b81bc384-8c08-4d45-beb1-6445d411daf0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151884 Aug 25 13:17:09.163586 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2490/4928] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:17:09.398968 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d61727e7-9344-46a7-bdc2-0e18630a822f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 1.109595 Aug 25 13:17:09.408929 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2439/4929] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:17:08 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 25 13:17:09.425819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:09.426793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:09.459383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.459768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.465304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:09.472932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:09.474185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:09.475242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:10.488154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:10.542450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70283bac-aafa-4835-864d-7483c26fea92 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.130033 Aug 25 13:17:10.544767 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2491/4930] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:09 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:11.597905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:11.602724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:11.643653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:11.648087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:11.651306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:11.654317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:11.656083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:11.657468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:12.736577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:12.771288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de98ba52-141a-4056-b70f-b599d3fc8904 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.189137 Aug 25 13:17:12.772944 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2440/4931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:11 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:13.831661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:13.834291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:13.887088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:13.888788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:13.907329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:13.909057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:13.914853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:13.915993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:17.639279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:17.708164 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62608c3a-4a2d-4a83-a48a-8eaf7e029971 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1688 microversion: 2.1 time: 3.893756 Aug 25 13:17:17.724158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2492/4932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:13 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1688 bytes in 3905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:18.763478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:18.764843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:18.799227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:18.800726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:18.803238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:18.806337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:18.808058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:18.809476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:19.492599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-plugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:19.538831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:19.551247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:19.577233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:19.652447 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] Creating event network-vif-plugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:17:19.675756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-95d36955-0402-421c-946b-02034a0d0d85 req-dd2cd582-3ad9-4e04-a813-89f84175ac4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191382 Aug 25 13:17:19.679279 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2493/4933] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:19.909127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:19.942388 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a028e137-2cbf-4b4b-878e-c5b4480042c7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1688 microversion: 2.1 time: 1.186154 Aug 25 13:17:19.957210 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2441/4934] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:18 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1688 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:20.245231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:20.246267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:20.284938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:20.285808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:20.286583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:20.287880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:20.301342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:20.302233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:20.406150 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43f1250a-7239-4d10-a44d-93ebb068ef9e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/ips" status: 200 len: 150 microversion: 2.20 time: 0.171813 Aug 25 13:17:20.409107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2494/4935] 10.222.0.60 () {60 vars in 1289 bytes} [Thu Aug 25 13:17:20 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/ips => generated 150 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:17:20.993314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:20.998638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:21.046473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.057968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.057968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:21.064460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:21.077435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:21.079694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:22.069031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:22.092181 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6f612ee-bda4-4c85-9bdd-64a31554edfc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.107904 Aug 25 13:17:22.094037 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2442/4936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:20 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:23.139552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:23.151405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:23.190326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:23.191560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:23.192497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:23.200601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:23.202045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:23.221634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:23.881799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:23.978576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bde4f20-5d24-4f23-b551-b8c79a479664 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.847314 Aug 25 13:17:23.990810 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2495/4937] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:23 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:25.039116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:25.041469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:25.080668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.090647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.100672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:25.102741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:25.108877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:25.113583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:25.993989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:25.997442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:26.029331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:26.030535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:26.031114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:26.050777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:26.051806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:26.052658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:26.096611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:26.141508 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-705043df-bd44-4d62-a778-29bb7a71c78c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.091543 Aug 25 13:17:26.157262 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2443/4938] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:25 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:26.157461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lazy-loading 'flavor' on Instance uuid 62217323-bf2d-4a70-8803-cfa09ee063bc {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:17:27.114133 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a175ede8-d11c-4dfb-bea8-88127edc801b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/action" status: 202 len: 0 microversion: 2.20 time: 1.126164 Aug 25 13:17:27.126243 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2496/4939] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 13:17:25 2022] POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:17:27.144826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:27.146147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:27.188502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:27.190089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:27.192679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.199196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.200525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.203038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.209072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.210586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.244471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.253398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.254697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:27.258808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:27.273264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:27.275393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:28.443415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:28.510358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:28.536418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:28.549874 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40a24b30-ce31-45f9-b528-f9cad4187206 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.409377 Aug 25 13:17:28.559748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2444/4940] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:27 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:28.648735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:28.691994 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e215170-503f-4e25-ba71-ed7a7fbb5fb5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.508239 Aug 25 13:17:28.698082 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2497/4941] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:29.619371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:29.620647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:29.670190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.689729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.690795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:29.696046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.698757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.702750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:29.757452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:29.761234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:29.806362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.807706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.809380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:29.812385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:29.816939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:29.820524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:30.617369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:30.667866 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-24fa9175-9c85-44df-95ac-30410dd72c2f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.927132 Aug 25 13:17:30.700880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2498/4942] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:29 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:17:31.004967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:31.079868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:31.098277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:31.114303 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b533473-356a-48b3-853c-423dea34ed15 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.502629 Aug 25 13:17:31.127170 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2445/4943] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:29 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:17:31.737859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:31.742243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:31.780709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:31.786148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:31.787575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:31.789683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:31.792617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:31.793807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.190527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:32.191666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:32.244778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.245791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.246599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.248666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:32.270245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:32.271113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:32.715749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:32.765311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-361ca58f-9f92-4a88-9225-ad691e05e50a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.040453 Aug 25 13:17:32.781575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2499/4944] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:31 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:33.598080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:33.644334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:33.650053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:33.654291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6f9c628d-3819-4f2c-acd8-f8d20ecd38dd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.483865 Aug 25 13:17:33.661101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2446/4945] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:32 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:17:33.826036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:33.832000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:33.886902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:33.887808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:33.889246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:33.890548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:33.891374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:33.894708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.709443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:34.717431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:34.719852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:34.764977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.767857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.773598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.778071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5449de6-f731-4fb6-bd25-f490876660a1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.959215 Aug 25 13:17:34.783725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:34.784808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:34.793300 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2500/4946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:33 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:34.794604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:34.922906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:35.535215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:35.572248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:35.579107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:35.581711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-749f058c-5f06-4a0a-b410-bacd63100302 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 0.880583 Aug 25 13:17:35.582576 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2447/4947] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:34 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:17:35.841485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:35.852016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:35.905492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:35.907222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:35.912087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:35.920844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:35.925533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:35.928100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.660739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:36.674138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:36.688431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=21 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:36.721619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.734757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.754360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:36.756525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:36.760096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:36.766671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:37.433728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:37.438614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:37.482101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-524957d7-c9a6-4dfc-8933-c94f8af1cce5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.659718 Aug 25 13:17:37.504682 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2501/4948] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:35 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:37.824045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:37.891912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:37.895158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:37.901737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e68c5db6-ef7a-403d-bcf2-151223ed8db6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.264607 Aug 25 13:17:37.909176 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2448/4949] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:36 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:38.550843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:38.558906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:38.610006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=27 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:17:38.617154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.621456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.628423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.631932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:38.633472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:38.639282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:38.988465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:38.989896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:39.042829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.043625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.044517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.052653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:39.053545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:39.054339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:39.594019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:39.656903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e43bf346-8f00-4fa1-8beb-e4053eee0502 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.122293 Aug 25 13:17:39.671476 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2502/4950] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:38 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:40.027678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:40.067504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:40.081047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:40.085696 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64c318c2-a0b8-4377-be7e-2a1fd149f13b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1742 microversion: 2.20 time: 1.116746 Aug 25 13:17:40.094200 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2449/4951] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:38 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1742 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:40.722878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:40.730743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:40.781161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.802618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.818382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:40.820683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:40.823369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:40.829293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.168729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:41.177835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:41.250106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.251395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.255606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:41.259487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:41.271181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:41.275859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:42.111474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:42.153477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-abe4b98c-95cf-4da4-9dd3-833a224d89fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.446037 Aug 25 13:17:42.156185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2503/4952] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:40 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:42.780657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:42.845121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:42.859711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:42.878166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1de8e50a-076f-44ec-98fd-b5e95ca4af79 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1742 microversion: 2.20 time: 1.702084 Aug 25 13:17:42.879373 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2450/4953] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:41 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1742 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:17:43.203494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:43.210892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:43.264025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:43.266306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:43.275909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:43.278125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:43.281312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:43.285237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:43.948277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:43.954290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:43.984813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:44.000761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:44.002102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:44.003764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:44.007946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:44.010501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:46.558164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.589064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.614173 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fddba690-b6ad-4707-a089-373777abce52 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 3.418594 Aug 25 13:17:46.617142 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2504/4954] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:43 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 3423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:46.627932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-plugged", "status": "completed", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:17:46.651858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:46.653518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:46.657236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:46.660556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.679725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:46.688580 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7435ad67-dcf0-4298-a748-01c99329c9d3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1742 microversion: 2.20 time: 2.754303 Aug 25 13:17:46.690402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] Creating event network-vif-plugged:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:17:46.692424 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2451/4955] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:43 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1742 bytes in 2773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:46.705695 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cdf64ca6-5f93-45d0-a1c5-ad1b6bae6fb2 req-4a60b57e-809a-4aaf-88d6-de81220ef891 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085283 Aug 25 13:17:46.709421 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2505/4956] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:17:47.662515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:47.667951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:47.708636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.712973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.718045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.723634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.726673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.735444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.742122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:47.751529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:47.817307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.819072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.825153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:47.831209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:47.833802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:47.838812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:49.267195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:49.274640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:49.328187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:49.335102 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9fc09c75-bc6e-4f44-b411-e727742be7d5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.680306 Aug 25 13:17:49.339471 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2452/4957] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:47 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:49.356016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:49.360463 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-597479c6-364d-472e-93b6-701cd7440458 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.628259 Aug 25 13:17:49.374921 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2506/4958] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:47 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:50.383439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:50.386227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:50.436630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:50.442672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:50.483522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.486131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.492590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:50.502974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.505324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.510782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.513406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:50.514838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.516063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:50.520889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:50.524906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:50.528589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:51.711724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:51.746625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:51.755032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:51.761930 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9452a55f-e3ea-41f4-b677-e808f3169c50 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.347239 Aug 25 13:17:51.788955 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2507/4959] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:50 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:17:51.861215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:51.900532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-778e9524-b2eb-4efa-aff3-89aa20a009f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.530269 Aug 25 13:17:51.912726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2453/4960] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:50 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:52.835291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:52.838967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:52.869572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:52.875204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:52.876792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:52.878272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:52.881124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:52.883243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:52.960707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:52.963496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:52.994633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:52.996755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:52.999529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:53.002541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:53.003820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:53.004942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:53.773677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:53.819738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:53.820932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:53.830630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:53.840052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6fbe8307-41f1-4483-b8bf-a6193a1d1383 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.016977 Aug 25 13:17:53.846374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2508/4961] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:52 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:53.851570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c92f8bc0-d1ad-496f-be7a-c2c7d891e48d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.908208 Aug 25 13:17:53.861954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2454/4962] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:52 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:54.899812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:54.919232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:54.971093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:54.974939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:54.981410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:54.983677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:54.986024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:54.989562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:55.700923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:55.737273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c25856ab-719d-4dc9-be5d-94ea765a8fec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.848591 Aug 25 13:17:55.744017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2509/4963] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:54 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:56.175433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:56.181728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:56.260755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:56.261602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:56.262261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:56.271599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:56.272662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:56.273310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:56.863746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:56.899176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:56.906591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:56.910741 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b424b502-c058-4aac-ad60-75ffb371cd5d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 2.024185 Aug 25 13:17:56.917877 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2455/4964] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:54 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:57.933303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:57.934964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:57.978490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:57.986859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:17:58.014974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:58.018055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:58.022195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:58.026258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:58.031143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:58.032101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:58.040167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:58.044523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:58.047313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:58.058577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:17:58.061829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:17:58.062766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:17:58.898656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:58.942364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5a16a5a-5cc8-44a6-9b81-0c49a675b723 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 2.153276 Aug 25 13:17:58.945538 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2510/4965] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:56 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:17:59.046573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:59.132508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:59.145186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:17:59.149612 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-23a87c7e-6ba5-4ed6-8298-885eee4dadb8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.188019 Aug 25 13:17:59.152420 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2456/4966] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:17:57 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:17:59.989809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:17:59.990985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:00.082779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.083875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.084730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.086070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.086949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.087732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.203108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:00.204626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:00.277641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.281048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.283353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:00.285550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:00.286876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:00.287935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:01.080793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:01.187215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-003c18e1-b6b3-4417-93f4-28e1c83b78e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.205352 Aug 25 13:18:01.204396 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2511/4967] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:17:59 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:01.285406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:01.317081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:01.321510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:01.325113 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2df56f3a-a7bb-4751-8480-c88e424638e3 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.129552 Aug 25 13:18:01.346242 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2457/4968] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:00 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:02.250375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:02.263821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:02.309419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.312785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.314185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:02.317866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.321323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.322631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:02.397579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:02.398908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:02.445298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.458007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.469428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:02.473390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:02.479927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:02.481096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:03.199469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:03.280728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf7e3fb4-b097-42d9-9e5a-e9966c061599 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.032058 Aug 25 13:18:03.310399 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2512/4969] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:02 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:03.337628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:03.364982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:03.376604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:03.381762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-901c4009-01ff-4df0-8fa4-8de7aa670db7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 0.994301 Aug 25 13:18:03.389768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2458/4970] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:02 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:04.339244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:04.342489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:04.370580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.372677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.376066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:04.379399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.380869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.382661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:04.450554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:04.453771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:04.476655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.479451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.481383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:04.486122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:04.492602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:04.496886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:05.317764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:05.343694 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-75b5f147-3cf4-4dc8-b80f-b654add42181 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 1.017231 Aug 25 13:18:05.361200 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2513/4971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:04 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:05.478628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:05.509872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=73 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:05.527275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:05.536646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:05.541444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74b80825-48ed-4231-976b-c487b5449560 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.099445 Aug 25 13:18:05.545728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2459/4972] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:04 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:06.410496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:06.411528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:06.445420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.446401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.447196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:06.454925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.455872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.456794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:06.599797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:06.600760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:06.630968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.631830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.632645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:06.634112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:06.634790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:06.635606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:07.190368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:07.225750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-302a31c3-63cc-4deb-a0d7-3007b518972a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1683 microversion: 2.1 time: 0.842980 Aug 25 13:18:07.226653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2514/4973] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:06 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1683 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:07.659633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:07.683779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:07.693780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:07.696751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7da9f42-9ff0-44f2-a02b-9204156e578d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.105614 Aug 25 13:18:07.698288 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2460/4974] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:06 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:08.273449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:08.274636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:08.315169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.317912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.320161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:08.322786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.324230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.326428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:08.761251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:08.770651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:08.805271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:08.813758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.815172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.818344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:08.825796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:08.831506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:08.831506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:09.218177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:09.234347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=80 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:09.282460 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81be8f61-3008-4583-9e8f-ebbd679443bf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.006718 Aug 25 13:18:09.285874 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2515/4975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:08 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:10.026282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:10.080337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:10.109056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:10.126903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e87c4bd-ad4f-49f9-8f8c-9603a49b92a6 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.367393 Aug 25 13:18:10.132370 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2461/4976] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:08 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:11.206112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:11.211726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:11.260646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=28 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:11.267602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:11.270966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:11.272582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:11.294163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:11.297596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:11.299008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:11.451608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-unplugged", "status": "completed", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:11.507482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:11.523446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:11.533709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:11.609835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] Creating event network-vif-unplugged:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:18:11.633984 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1b74927c-5a4f-44ae-83d2-dcdb538f8856 req-b7c0b7d6-ab60-4aab-9df8-0c0787a7fc81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201651 Aug 25 13:18:11.646166 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2462/4977] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:13.115875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:13.164343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:13.174277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:13.184159 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6e22a3c-31f8-4fe5-a798-254064557b94 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.996628 Aug 25 13:18:13.187940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2516/4978] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:11 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:13.189902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:13.198495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:13.270370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:13.271538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:13.274518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:13.279092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:13.282227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:13.285883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.252600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:14.259119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:14.325932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.326882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.327723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.342376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:14.343613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:14.351689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:14.741686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:14.852694 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a47a3fb6-3442-41d0-8b0b-eb3332f637a5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.673306 Aug 25 13:18:14.875443 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2463/4979] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:13 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:15.090290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:15.142310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:15.155864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:15.158799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8a00863-ea69-44d8-ae08-f43883a5ae96 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 0.915312 Aug 25 13:18:15.174720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2517/4980] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:14 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:16.237886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:16.244963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:16.298466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:16.299302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:16.300153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:16.315214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:16.315949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:16.316673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:17.450466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:17.500703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:17.511177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:17.522945 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eca9fd72-7228-412b-8b9b-0dbccafd41be tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.290982 Aug 25 13:18:17.567496 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2464/4981] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:16 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:18.576276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:18.585276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:18.651260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:18.653090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:18.654306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:18.656386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:18.742740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:18.742740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:19.320335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:19.348501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:19.352038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:19.360843 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68162229-7cd7-48f7-a40f-305cc07c3089 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 0.786801 Aug 25 13:18:19.364612 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2518/4982] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:18 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:20.419809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:20.424493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:20.486095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:20.489689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:20.490646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:20.493650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:20.499116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:20.500017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:21.193192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:21.220606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:21.225198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:21.228460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd707cbc-05b3-4518-a101-fc4955c7706b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 0.820698 Aug 25 13:18:21.229892 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2465/4983] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:20 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:21.801507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:21.806055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:21.875142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:21.876434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:21.877146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:21.878354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:21.896194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:21.900981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:22.306572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:22.311130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:22.381205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:22.381856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:22.382402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:22.383315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:22.393804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:22.399141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.543880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:23.580458 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a8d2b08-f2fc-4a56-8028-b5e610d03923 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.788610 Aug 25 13:18:23.587000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2519/4984] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:21 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:23.613308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:23.630637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:23.632253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:23.651444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:23.664685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:23.669245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.676087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:23.677445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:23.678633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:23.691307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:23.714164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:23.733013 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a143d6a7-9ea6-40de-a42f-409f19ca1f80 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.444720 Aug 25 13:18:23.740473 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2466/4985] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:22 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:24.802824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:24.808062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:24.854380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:24.861902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:24.869078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:24.880292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:24.885400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:24.889418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:24.941700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:24.989112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41b7d8ed-86cf-41f7-b45f-afdbce2d5c78 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.366641 Aug 25 13:18:24.997859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2520/4986] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:23 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:25.050057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:25.051791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:25.069138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:25.070486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:25.071494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:25.073338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:25.076164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:25.078649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:26.357401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:26.401655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:26.409236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:26.418781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9cd60f7e-36cc-460d-9fcc-5f9f85700268 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.629386 Aug 25 13:18:26.423023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2467/4987] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:24 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:26.585402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:26.628967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf8dba4a-2a84-4bec-9667-47269cfef9b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.593466 Aug 25 13:18:26.633199 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2521/4988] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:25 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:26.697968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:26.711888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:26.764718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:26.770117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:26.771622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:26.776290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:26.785750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:26.788809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:27.143231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d010c85d-115c-4551-bf66-0cd32c48a480 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.460033 Aug 25 13:18:27.180642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:27.185635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:27.197724 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2468/4989] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:26 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:18:27.240013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:27.241921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:27.243803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:27.246346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:27.248815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:27.251545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:27.493339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:27.497924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:27.524649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:27.531268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:27.532672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:27.534683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:27.541574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:27.542863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:28.567968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:28.602777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18cbae91-286f-45bb-8d14-ab98fccb5c9a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 1.440072 Aug 25 13:18:28.624552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2522/4990] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:28.860332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:28.883748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:28.889316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:28.891901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebcb580d-9176-4869-a166-2ebe0a927b65 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.416812 Aug 25 13:18:28.901433 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2469/4991] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:27 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:29.662419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:29.663583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:29.695101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:29.697268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:29.709309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:29.711083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:29.713234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:29.713988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:29.949029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:29.950167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:30.002506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:30.003463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:30.008934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:30.011266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:30.015011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:30.019283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:31.946077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:31.981349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a32f1f31-d8e1-4d38-89fb-ef1955329b03 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 2.333984 Aug 25 13:18:31.989458 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2523/4992] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:29 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:32.202927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:32.239547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:32.251002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:32.263667 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b942e52-934a-4655-bcff-c42d6c5c6262 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 2.314106 Aug 25 13:18:32.265716 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2470/4993] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:29 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:33.046100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:33.059005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:33.086704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:33.090179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:33.099370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:33.101987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:33.103229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:33.104642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:33.329629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:33.335734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:33.373896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:33.386478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:33.387800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:33.389631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:33.390761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:33.391770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:34.666166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:34.716495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:34.786640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:34.795292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:34.805513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09f6a3ef-7ae7-4d33-b69f-f6392fb52355 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 1.768688 Aug 25 13:18:34.824934 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e5ec6e0d-95b2-4c45-98d8-719523354bb1 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.509099 Aug 25 13:18:34.859347 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2524/4994] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:33 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:34.875868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2471/4995] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:33 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:35.871584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:35.881598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:35.929040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:35.930159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:35.968824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:35.979684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:35.987935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:35.989155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:35.990766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:35.991708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:35.992424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:35.999029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:36.000450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:36.002059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:36.005678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:36.018172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.026798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:37.065373 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cdc6cd4a-fc34-49d2-a022-b0d398a9d32c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.201291 Aug 25 13:18:37.096213 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2525/4996] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:35 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:37.147650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:37.154877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:37.165207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:37.225879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:37.228937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.244774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.249849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.255526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.256652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.257499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.280828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:37.286710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:37.290243 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9eba51d6-52cc-4f72-bf97-d8d74eb73a49 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.367367 Aug 25 13:18:37.301243 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2472/4997] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:35 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:18:37.483272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-981510de-85c2-4781-ad7d-b1f7540db560 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 200 len: 324 microversion: 2.1 time: 0.344648 Aug 25 13:18:37.511940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2526/4998] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:18:37 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:37.525358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:37.529997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:37.580959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.586321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.589536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:37.595615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:37.598512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:37.602380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:38.347285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:38.349722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:38.380724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.385670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.391336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:38.395022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.396270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.399485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:38.432228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:38.480880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-586aebbc-f244-49fa-aa79-27dc532669dd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.969215 Aug 25 13:18:38.483426 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2473/4999] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:37 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:38.572142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:38.576685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:38.644743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.646094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.651225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:38.658886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:38.662223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:38.665786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:39.626055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:39.631134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=70 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:39.670925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:39.676091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:39.678952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5225e5e8-8a1f-4040-8194-106ec7f57dae tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.345658 Aug 25 13:18:39.680946 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2527/5000] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:38 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:40.488953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:40.552897 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-694a1575-cda6-4ecb-86b5-67f96d2acdf0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.979905 Aug 25 13:18:40.554780 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2474/5001] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:38 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:40.618769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:40.625007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:40.641468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.643490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.644864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:40.649447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.654951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.658141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:40.769068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:40.770603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:40.788097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=28 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:40.793300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.796370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.797548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:40.798901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:40.799959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:40.800991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:42.095809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.131366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-886af697-c14e-4154-9435-e51b9b5ff5cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.525547 Aug 25 13:18:42.142306 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2528/5002] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:40 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:42.189024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:42.191785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:42.219074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=26 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:42.222773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.224146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:42.225419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:42.226836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:42.235639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:42.236820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:42.237869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:42.268213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.276154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.279040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c18229a3-f9be-4578-90fb-8785671f96b7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.527580 Aug 25 13:18:42.294589 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2475/5003] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:40 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:42.751034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:42.772672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95331f14-a779-47ca-a8c9-3559cd1779ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.595005 Aug 25 13:18:42.774490 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2529/5004] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:42 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:43.187298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1206480034", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "723617c5-71c1-48f0-b95e-eb7a1111c402"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:43.348690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:43.359390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:43.424042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:43.429806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:43.432397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.441640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:43.443065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:43.455446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:43.494386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] validate_networks() for [('723617c5-71c1-48f0-b95e-eb7a1111c402', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:18:44.598913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:44.626488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:44.633553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:44.635877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e9e2775-727d-433a-8cfd-9777cda64252 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.301911 Aug 25 13:18:44.642517 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2530/5005] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:43 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:45.691979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:45.700556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:45.735691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:45.736662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:45.737411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:45.740504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:45.741361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:45.742069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:46.654703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:46.695324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:46.696716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:18:46.697535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:18:46.699430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:18:46.701530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:18:46.702209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:46.702721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:18:46.706799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-439f1952-90af-4e74-94cd-225ff7085578 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.026317 Aug 25 13:18:46.709085 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2531/5006] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:45 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:46.756343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:46.757271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:46.758067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:46.760222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:46.777639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:46.782231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:46.878195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:18:46.908484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:18:46.982521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:18:46.996319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:18:47.254286 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d354f129-8d19-433b-96f4-af4c07da157d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.074320 Aug 25 13:18:47.291620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-036fe792-3cbd-4a21-90a2-6e267d0dcbb9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:47.297978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-036fe792-3cbd-4a21-90a2-6e267d0dcbb9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:47.298703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2476/5007] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:18:47.727651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-036fe792-3cbd-4a21-90a2-6e267d0dcbb9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:47.749648 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-036fe792-3cbd-4a21-90a2-6e267d0dcbb9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1215 microversion: 2.1 time: 0.480307 Aug 25 13:18:47.763422 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2532/5008] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:47 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1215 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:47.772849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:47.821583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:48.517026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:48.556054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:48.563666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:48.570711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea6c9221-783c-494d-aa56-de8c16a5b871 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 0.800422 Aug 25 13:18:48.589356 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2477/5009] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:47 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:48.800376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a0f3437-807e-43f7-916d-8f8351b7a157 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:48.803685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a0f3437-807e-43f7-916d-8f8351b7a157 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:48.971854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0a0f3437-807e-43f7-916d-8f8351b7a157 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:49.001534 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a0f3437-807e-43f7-916d-8f8351b7a157 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1215 microversion: 2.1 time: 0.209900 Aug 25 13:18:49.003699 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2533/5010] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:48 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:49.625632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:49.629711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:49.667646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.698762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.699909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:49.701254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:49.711206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:49.712044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:50.037824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8faa5aed-91fa-4424-b9c5-adb98587f74c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:50.039031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8faa5aed-91fa-4424-b9c5-adb98587f74c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:50.602932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.641037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.660332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8faa5aed-91fa-4424-b9c5-adb98587f74c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.668740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:50.677535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9fb0c37-18fa-40c3-b348-751d714b4ff2 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.058585 Aug 25 13:18:50.687325 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2478/5011] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:49 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:50.710172 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8faa5aed-91fa-4424-b9c5-adb98587f74c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1215 microversion: 2.1 time: 0.680354 Aug 25 13:18:50.729134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2534/5012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:50 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1215 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:51.720013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:51.729339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:51.765034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:51.771276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:51.788892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.789720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.790488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:51.813840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.819704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.820634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.821450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:51.822739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:51.823430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.823604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:51.824688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:51.841274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:52.152560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:52.194059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92be4f16-0504-4d70-b3c6-f9f0f325b705 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1219 microversion: 2.1 time: 0.447608 Aug 25 13:18:52.199102 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2535/5013] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:51 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1219 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:53.063082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:53.111521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:53.124576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:53.143970 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47524514-33cd-4509-9aa8-443baf06d25c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1737 microversion: 2.20 time: 1.415145 Aug 25 13:18:53.149449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2479/5014] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:51 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1737 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:53.244016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:53.245346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:53.315772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:53.317022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:53.323430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:53.331414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:53.335264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:53.336895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:53.937032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:53.981721 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f49c576-410c-409b-a225-de8507e0b0f2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1275 microversion: 2.1 time: 0.739451 Aug 25 13:18:53.986066 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2536/5015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:53 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1275 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:54.205828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:54.214954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:54.229944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:54.231269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:54.233947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:54.238688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:54.240786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:54.242259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.030838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:55.031956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:55.068743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.073735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.077827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.083048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:55.084348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:55.090467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:55.915766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:55.953368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fda0abb4-6ebc-4a1e-9aa9-aa44769ddc29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1273 microversion: 2.1 time: 0.930758 Aug 25 13:18:55.955081 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2537/5016] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:55 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1273 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:18:56.369602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:56.398119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:56.405301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:56.409412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9441b5d5-755f-4151-a9e7-d966545311a9 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1719 microversion: 2.20 time: 2.218452 Aug 25 13:18:56.411308 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2480/5017] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:54 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1719 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:56.997697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:56.998787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:57.027672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.031104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.036219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.038036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.038927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.040695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.475908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:57.478958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:57.498155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:57.501156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:18:57.509199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.510523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.515939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.517252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:57.518015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:57.527177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:57.538486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:57.584926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6bfc9970-f7b1-4869-bc43-09e6ae5d6bc6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1273 microversion: 2.1 time: 0.597862 Aug 25 13:18:57.593092 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2538/5018] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:56 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1273 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:58.428338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:58.466201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:58.470816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:58.473931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9609f2d-6db2-4ad6-825c-d45f985a911d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1719 microversion: 2.20 time: 1.018557 Aug 25 13:18:58.475414 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2481/5019] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:57 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1719 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:18:58.636382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:58.637510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:58.668897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.669754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.670555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.671888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.687595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.688508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.760686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-unplugged", "status": "completed", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:18:58.814442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:58.815773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:58.816940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:58.893167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] Creating event network-vif-unplugged:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:18:58.917363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c120edc8-21b4-4f48-9f63-6904e5e782d4 req-94713740-cd7c-4c88-ac24-555a65e90755 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.046120 Aug 25 13:18:58.921360 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2539/5020] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:18:59.531191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:18:59.537636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:18:59.542853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:18:59.554540 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3d598d3-8eb1-4074-800d-b92f3f2d8ca5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 0.925205 Aug 25 13:18:59.557266 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2482/5021] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:18:58 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:18:59.591662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.596314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.602102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:18:59.607446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:18:59.610438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:18:59.613053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:00.468668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:00.548066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:00.571704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:00.614614 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70abbd2d-6ebb-4ea1-b8f1-c8c571c52918 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1719 microversion: 2.20 time: 1.057731 Aug 25 13:19:00.640371 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2540/5022] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:18:59 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1719 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:00.644854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:00.651233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:00.717883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:00.724181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:00.725062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:00.734140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:00.735577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:00.736810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:01.709342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:01.713222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:01.749199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:01.766233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:01.770700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:01.774994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:01.785494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:01.788847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:01.795491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:02.810503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:02.811586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:02.914844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:02.921404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:02.929430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1df61dfa-e78e-4f3c-8c4f-c6ffa1de7de4 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1662 microversion: 2.20 time: 1.236026 Aug 25 13:19:02.933220 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2541/5023] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:01 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1662 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:19:02.938950 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f78dea0-9934-4192-8515-86d3e15f9463 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 2.334825 Aug 25 13:19:02.941094 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2483/5024] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:00 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:03.050426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "794f06f2-a1d9-49bb-992d-b58b6b9ab001"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:03.078165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:03.118852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:03.127473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:03.134230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:03.136811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:03.142376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:03.147891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:04.002703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:04.005254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:04.104928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:04.115465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:04.127535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:04.131699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:04.132413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:04.148014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:05.224615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-147df6d9-c2c9-4892-827a-c541c6cc5d8b tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.211684 Aug 25 13:19:05.225921 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2542/5025] 10.222.0.60 () {62 vars in 1364 bytes} [Thu Aug 25 13:19:03 2022] POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments => generated 188 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:19:05.488275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:05.568623 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95b5881c-e4ec-47f9-8b06-0dc2663eba7e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 1.581065 Aug 25 13:19:05.578988 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2484/5026] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:03 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:05.845670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:05.858327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:05.933898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:05.933898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:05.950987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:05.967702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:05.971494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:05.971494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.015072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805cca72-e665-4604-9611-f03da19df693", "tag": "63d1f987-cf7e-42bc-bfdb-67d86e3bfccd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:07.104873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:07.106986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:07.108317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.190823 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] Creating event network-changed:63d1f987-cf7e-42bc-bfdb-67d86e3bfccd for instance 805cca72-e665-4604-9611-f03da19df693 on n-h1-850468-18 Aug 25 13:19:07.242295 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9a4402f8-6df3-45d7-8726-c1e7c09289c2 req-f2a60d8f-8d07-4927-ae84-55ed341a825e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.606776 Aug 25 13:19:07.246276 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2543/5027] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:07.288813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:07.307576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:07.329024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:07.336156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:07.342097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.348746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:07.349485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:07.351228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:07.782807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:07.853446 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-809809f5-b77b-408b-983c-57b4ed2e868f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments/794f06f2-a1d9-49bb-992d-b58b6b9ab001" status: 202 len: 0 microversion: 2.20 time: 2.022223 Aug 25 13:19:07.860802 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2485/5028] 10.222.0.60 () {60 vars in 1457 bytes} [Thu Aug 25 13:19:05 2022] DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments/794f06f2-a1d9-49bb-992d-b58b6b9ab001 => generated 0 bytes in 2033 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:19:08.243552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:08.244795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:08.279232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.280845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.283838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.289873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:08.291086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:08.292174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:08.479202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:08.541225 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27a04c07-4254-481a-9bbf-87b577bcaa83 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 1.280086 Aug 25 13:19:08.580374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2544/5029] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:07 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:08.615548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122700) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 13:19:08.941538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f38b1d34-6f1c-4bd8-8a38-af9cf261c3ba tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/action" status: 202 len: 0 microversion: 2.20 time: 0.712763 Aug 25 13:19:08.945558 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2486/5030] 10.222.0.60 () {62 vars in 1319 bytes} [Thu Aug 25 13:19:08 2022] POST /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:19:08.970468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:08.975903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:09.066123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.078262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.079075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.080684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.081327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.081946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.635452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:09.638823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:09.661308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.663337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.671636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.674804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:09.675880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:09.680313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:09.869116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:09.880378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:09.975355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:09.986225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:09.996001 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7105f24d-232f-4b24-9eae-a08fcd78fd29 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1670 microversion: 2.20 time: 1.041934 Aug 25 13:19:10.018066 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2545/5031] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:08 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1670 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:10.679737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:10.703685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfd35219-1736-40c4-9a05-7acc5013ac3b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 1.108871 Aug 25 13:19:10.728879 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2487/5032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:09 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:11.079328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:11.088262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:11.136469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:11.146268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:11.149756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:11.152197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:11.154796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:11.156827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:11.759909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:11.769692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:11.797070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:11.801494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:11.804005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:11.807466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:11.812891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:11.814298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:11.821518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:13.095764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:13.226256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:13.251379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:13.303210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a39dafdb-1772-4349-a2fb-ceda68a768a7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1670 microversion: 2.20 time: 2.194759 Aug 25 13:19:13.313129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2546/5033] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:11 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1670 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:14.379460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:14.408280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:14.446696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=42 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:14.453771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:14.455202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:14.456986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:14.461095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:14.469802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:14.474081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:14.480516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:14.489822 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9909087-3ef8-430c-a61c-60ce0e5db30a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 2.744319 Aug 25 13:19:14.500952 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2488/5034] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:11 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:15.570781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:15.576189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:15.649343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:15.654503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:15.658920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:15.662580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:15.664828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:15.668081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:16.060614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:16.126696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:16.143461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:16.161548 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4641da59-d666-4ed5-825e-77b6d4f5c6ec tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1670 microversion: 2.20 time: 1.791546 Aug 25 13:19:16.168062 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2547/5035] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:14 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1670 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:16.706180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:16.745460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7558fd8-de5d-4bf6-8e76-0544ef266418 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 1.193095 Aug 25 13:19:16.747992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2489/5036] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:15 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:17.271972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:17.280234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:17.373379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.380059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.385064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:17.386980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.393459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.396324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:17.804889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:17.806210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:17.855586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.876479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.877861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:17.884192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:17.885404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:17.886415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:20.167241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.210753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.219159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.222554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48722b89-a09c-4aed-a6ce-d8ea57380bfd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 2.983706 Aug 25 13:19:20.224740 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2548/5037] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:17 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 2987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:20.235780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805cca72-e665-4604-9611-f03da19df693", "name": "network-vif-plugged", "status": "completed", "tag": "63d1f987-cf7e-42bc-bfdb-67d86e3bfccd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:20.275875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:20.277546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:20.279233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:20.313516 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] Creating event network-vif-plugged:63d1f987-cf7e-42bc-bfdb-67d86e3bfccd for instance 805cca72-e665-4604-9611-f03da19df693 on n-h1-850468-18 Aug 25 13:19:20.326318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-15de5a40-8de5-4d40-b153-6894ab6b4769 req-f4fa143a-7e03-4a8b-92cf-09c6b753c07d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098196 Aug 25 13:19:20.328080 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2549/5038] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:20.347844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:20.396231 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6bf1021-89a9-48ab-b780-0d3d4528be53 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 2.593495 Aug 25 13:19:20.398934 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2490/5039] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:17 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:21.280725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:21.282135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:21.308713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.310349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.311364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:21.312585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.313443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.314288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:21.487061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:21.488377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:21.527591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.535297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.536549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:21.538204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:21.539319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:21.540712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:23.528952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:23.587624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:23.591746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:23.613680 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cfc10818-3d49-4470-96dd-84fed5bb72ff tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 2.341389 Aug 25 13:19:23.630653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2550/5040] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:21 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:23.728324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:23.773903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b984ec5e-2e3b-4d71-a892-f0dbde633890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1315 microversion: 2.1 time: 2.298157 Aug 25 13:19:23.781757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2491/5041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:21 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1315 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:24.683163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:24.695528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:24.729415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.730338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.731684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.756549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.757464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.779994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.830604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:24.835784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:24.875560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.877281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.881858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:24.885568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:24.891436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:24.892772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:26.348840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:26.392195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:26.401215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:26.410905 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-472208bf-0570-4e71-8877-4710b4134bdf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.742531 Aug 25 13:19:26.439677 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2551/5042] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:24 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:26.989364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:27.042158 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-013aac67-5d9b-489d-bff7-5f18c58c5d2d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1501 microversion: 2.1 time: 2.218416 Aug 25 13:19:27.048482 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2492/5043] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:24 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1501 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:27.120216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:27.145367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.145714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.150181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.307891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:19:27.472639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:27.473991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:27.535415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.540070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.546468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.557146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.558787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.566311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.589111 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8576739d-1168-4186-b83f-3a602a4638a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693/action" status: 202 len: 0 microversion: 2.1 time: 0.496374 Aug 25 13:19:27.591888 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2552/5044] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:19:27 2022] POST /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:19:27.613012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:27.615022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:27.631848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.636316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.637667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:27.641180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:27.648505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:27.651082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:28.757271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:28.816041 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0bdca3fa-ff6f-473b-af7b-f2cd92a8d437 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 1.214090 Aug 25 13:19:28.830812 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2553/5045] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:27 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:29.040882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:29.107418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:29.117650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:29.122893 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79ad4846-f95c-45fb-9873-fade0846a19d tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.663068 Aug 25 13:19:29.146278 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2493/5046] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:27 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:19:29.877060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:29.885010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:29.922559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:29.923262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:29.923772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:29.924589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:29.925104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:29.938438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:30.197795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:30.214462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:30.302451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.303413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.317319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:30.318801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:30.319712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:30.320818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:31.874260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:31.923790 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-74aecd04-a185-43b5-b5de-e0f342edee98 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 2.052448 Aug 25 13:19:31.950768 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2554/5047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:29 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:32.488860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:32.552220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:32.568420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:32.593456 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a8ed528-3374-4c9f-ba37-7ecbc77d2fcd tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 2.425444 Aug 25 13:19:32.598033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2494/5048] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:30 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:32.980212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:32.993821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:33.031887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.033120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.033992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.035408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.041443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.042503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.673384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:33.674323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:33.675310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:33.691348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54c9a0c6-dda0-4597-82e1-ebf2f54a399d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 0.719271 Aug 25 13:19:33.708955 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2555/5049] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:32 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:33.716102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.717025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.717876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:33.733248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:33.736593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:33.757371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:34.567162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:34.614815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:34.636008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:34.639297 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c9e868b6-1f09-40cb-a0ba-7171928719c5 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.972587 Aug 25 13:19:34.655156 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2495/5050] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:33 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:34.737272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:34.744335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:34.766109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:34.767502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:34.769518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:34.771165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:34.772335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:34.773371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:35.714297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:35.715653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:35.815960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:35.817075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:35.833497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:35.846899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:35.848265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:35.849484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:36.247861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:36.288164 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a29fd17-264f-41e5-b106-a1ec8fdb990a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 1.558112 Aug 25 13:19:36.296901 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2556/5051] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:34 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:37.339538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:37.345568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:37.433429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:37.446385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:37.447276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:37.456825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:37.463788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:37.466612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:38.825504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:38.894106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:38.916107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:38.940425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:38.946171 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-44dee253-b8d4-4dea-b3d2-246fb7e8730f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 3.239567 Aug 25 13:19:38.959296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2496/5052] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:35 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 3254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:40.060544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:40.066926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:40.142437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:40.169623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.170724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.182537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.184629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:40.188383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:40.193206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:40.201975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-413f2832-0ebf-4429-b339-feb181b176b0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 2.874738 Aug 25 13:19:40.207386 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2557/5053] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:37 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:40.211334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:40.954513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:41.022558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:41.036490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:41.039412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3070583-b9e7-4c74-9b6d-57db238ae5c0 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.015408 Aug 25 13:19:41.041434 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2497/5054] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:40 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:41.263654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:41.265404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:41.314506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:41.316485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:41.317774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:41.322146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:41.327368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:41.330230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:42.094166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:42.101699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:42.161138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=20 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:42.167020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:42.171694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:42.175012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:42.182707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:42.184873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:42.186196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:43.991546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:44.045426 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a25fd637-b2e7-49a8-a4fe-472de9c1ae4d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 2.790326 Aug 25 13:19:44.047524 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2558/5055] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:41 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 2801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:44.429041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:44.458570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:44.467254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:44.472841 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c971b96-87ca-434b-905d-7eb7f4a34754 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 2.387760 Aug 25 13:19:44.482779 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2498/5056] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:42 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:19:45.094808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:45.098058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:45.127393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=24 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:19:45.134926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.138952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.141737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:45.145692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.149719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.154724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:45.545711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:45.552605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:45.592502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.597371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.601629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:45.603688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:45.610955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:45.612555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:47.349427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:47.451107 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c120f0f7-6588-4ea5-906b-73babaf0e544 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 2.366190 Aug 25 13:19:47.479792 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2559/5057] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:45 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:48.424296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:48.481088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:48.496498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:48.502243 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7332f8d3-95f5-4560-b99d-f17c8b1ae39c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 2.978822 Aug 25 13:19:48.508863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:48.510106 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2499/5058] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:45 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 2988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:48.510275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:48.600026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:48.601653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:48.613526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:48.615575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:48.629488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:48.632776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:49.561785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:49.562941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:49.661379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:49.662938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:49.664065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:49.667796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:49.669350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:49.670195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:50.753147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:50.789269 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63bbff00-d906-43d4-8ca9-02ac85ee169e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 2.288969 Aug 25 13:19:50.793985 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2560/5059] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:48 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:51.189656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:51.224232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:51.229544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:51.233452 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0bbc12f2-0d7a-4fad-bcc8-106000ec405e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.681263 Aug 25 13:19:51.249385 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2500/5060] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:49 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:51.865611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:51.866846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:51.900236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:51.901276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:51.902159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:51.904478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:51.905538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:51.906354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:52.297445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:52.312436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:52.348167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:52.350724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:52.351977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:52.356173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:52.357958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:52.360253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:52.533721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:52.624623 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0084c469-ce77-4927-b255-aa522f008d68 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 0.762075 Aug 25 13:19:52.627125 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2561/5061] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:51 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:53.061892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:53.104098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:53.117952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:53.122438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52842e6e-d79b-4b01-8c7a-50f1244b78e8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.838722 Aug 25 13:19:53.129462 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2501/5062] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:52 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:53.672930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:53.675223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:53.721064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.722770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.728564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:53.730393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:53.731664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:53.732875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.195060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:54.201868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:54.220778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.221657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.222192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.223329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:54.224037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:54.224857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:54.642739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.676358 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a12325c-ea55-4340-bad2-e558f11efd9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1511 microversion: 2.1 time: 1.019051 Aug 25 13:19:54.682157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2562/5063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:53 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1511 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:54.737166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.787098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.792347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:54.805590 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4266621-ff90-4544-a4fd-329f9a6c89ef tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.628519 Aug 25 13:19:54.807814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2502/5064] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:54 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:19:55.728658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:55.741943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:55.784408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.785679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.787133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.789691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.794427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.798262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.854034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:55.861975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:55.936630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.937374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.938207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:55.939600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:55.951963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:55.960319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:56.630092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:56.660543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b3eef4f9-d13b-4b61-9ac1-0cab0d5e4324 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1488 microversion: 2.1 time: 0.941955 Aug 25 13:19:56.662079 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2563/5065] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:55 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1488 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:19:56.750454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:19:56.767170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:56.791523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:56.814665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:56.818826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:56.821077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:56.821928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:56.822687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:56.822858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a03f363c-bcef-4517-9b00-89a42b9d1656 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.979102 Aug 25 13:19:56.823954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:56.841898 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2503/5066] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:55 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:56.846187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:56.849223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.009985 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-697bfcb4-fcd2-480b-9aed-bd48f8cb611b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 200 len: 155 microversion: 2.1 time: 0.279719 Aug 25 13:19:57.013007 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2564/5067] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:19:56 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 155 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:19:57.033055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:57.037820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:57.070542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.071660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.079243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.087344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.088563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.089586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.705815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:57.735768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c99265b8-bfeb-4825-99f1-8b0d3616a3e8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.710531 Aug 25 13:19:57.741187 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2504/5068] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:57 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:57.811943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:57.820364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:57.853644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.861814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.873456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:57.875198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:57.880039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.883688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.885864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.887749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.915779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.919648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.920836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:57.925226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:57.926844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:57.932678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.620560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:58.671380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d80d016e-97fb-44ab-93cb-07f6936b15d8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.868635 Aug 25 13:19:58.681294 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2565/5069] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:57 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:58.725628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:58.733747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:58.770688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:58.776622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:58.782548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.784780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:58.785813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:58.786862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:58.809959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:58.853500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:58.857860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:58.860883 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9246b593-0cb7-44b1-a462-b17eadba3e10 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.996263 Aug 25 13:19:58.876750 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2505/5070] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:57 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:19:59.622000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:19:59.686632 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68f47806-8506-45c3-b68d-72244ea49acd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.970037 Aug 25 13:19:59.689536 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2566/5071] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:58 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:19:59.729003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:59.731457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:59.762987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.769053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.770582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:59.779069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.780840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.783006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:59.910136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:19:59.920783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:19:59.963387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.969318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.970512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:19:59.985755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:19:59.987233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:19:59.995919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:00.701510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:00.722600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-049a8e07-21c3-4e46-bec7-926d15579afd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.003074 Aug 25 13:20:00.732925 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2506/5072] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:19:59 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:20:00.750085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-plugged", "status": "completed", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:00.811517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:00.824467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:00.826683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:00.907250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:00.922274 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] Creating event network-vif-plugged:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:20:00.966283 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4c357b82-dbba-406a-a543-ee69da967aba req-23de9c73-c0ad-41c5-a0e3-170d9bb825f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230042 Aug 25 13:20:00.967815 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2507/5073] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:00.978493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:00.993518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:00.998857 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e08e237e-7532-4b9a-a2fc-35d8b983dbbf tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.099411 Aug 25 13:20:01.006365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2567/5074] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:19:59 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:20:01.119316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1390093371", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "723617c5-71c1-48f0-b95e-eb7a1111c402"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:01.368336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] validate_networks() for [('723617c5-71c1-48f0-b95e-eb7a1111c402', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:20:02.080176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:02.081617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:02.130997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:02.131964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:02.133258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:02.135374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:02.145464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:02.146326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:03.427802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:03.481091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:03.482665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:03.488748 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-53a01474-5f20-4ac0-bb14-1027f0edd39e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.438248 Aug 25 13:20:03.490211 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2568/5075] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:20:02 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:20:03.642002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:20:03.643381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:20:03.644385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:20:03.645358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:20:03.654794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:20:03.678749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:03.679784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:03.681492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:03.682460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:03.683130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:03.685046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:03.740860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:20:03.756587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:20:03.802020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:20:03.817581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:20:04.134275 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cefbc240-3aa1-4f26-bd84-57bdbf076ceb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.030323 Aug 25 13:20:04.137772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2508/5076] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:20:04.175644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae21235c-ecdc-4813-afd7-1e67e79b0d13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:04.177491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae21235c-ecdc-4813-afd7-1e67e79b0d13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:04.586385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae21235c-ecdc-4813-afd7-1e67e79b0d13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:04.589227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:04.599465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:04.607926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae21235c-ecdc-4813-afd7-1e67e79b0d13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1215 microversion: 2.1 time: 0.440930 Aug 25 13:20:04.616814 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2569/5077] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:04 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1215 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:04.656023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:04.660701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:04.664298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:04.669308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:04.671829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:04.673591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:05.214483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:05.251660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:05.253665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:05.255175 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-55346a82-6b6d-41ff-b906-e2ef12875775 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 0.708227 Aug 25 13:20:05.256826 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2509/5078] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:20:04 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:20:05.686612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a041ec1d-80e7-4afe-9a7f-f7f6feac4fd4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:05.692156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a041ec1d-80e7-4afe-9a7f-f7f6feac4fd4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:06.078306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a041ec1d-80e7-4afe-9a7f-f7f6feac4fd4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:06.150590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a041ec1d-80e7-4afe-9a7f-f7f6feac4fd4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1215 microversion: 2.1 time: 0.473835 Aug 25 13:20:06.159657 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2570/5079] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:05 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1215 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:06.323295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:06.332659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:06.430878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:06.437189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:06.441447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:06.448169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:06.451992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:06.453790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.222988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:07.235081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:07.314460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.323290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.329906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.334492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:07.359250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:07.359933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:07.926491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:07.976485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:07.986164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:08.003443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:08.014144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bc0a35c3-51cc-4e59-be39-e4aaad255915 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1728 microversion: 2.20 time: 1.679000 Aug 25 13:20:08.019039 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2510/5080] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:20:06 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1728 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:20:08.043912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f6c6d24-ce75-4823-b056-273273353fb1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1267 microversion: 2.1 time: 0.830505 Aug 25 13:20:08.046205 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2571/5081] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:07 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1267 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:09.096744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:09.102450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:09.105114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:09.106948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:09.151903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:09.155088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:09.156211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:09.157643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:09.159320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:09.161977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:09.163656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:09.164399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:09.165297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:09.167621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:09.174237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:09.176457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:09.991348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:10.046108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcd315a9-a41d-4b5f-a66e-2818417f08e3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1273 microversion: 2.1 time: 0.961752 Aug 25 13:20:10.078097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2572/5082] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:09 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1273 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:20:10.934964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:10.939471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=82 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:11.008838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.020091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.035596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d3f4146-1ae7-4228-844c-f39df7ff281c tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1715 microversion: 2.20 time: 1.955276 Aug 25 13:20:11.052169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2511/5083] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:20:09 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1715 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:20:11.114235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:11.116832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:11.155720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.159541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.179105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.185957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:11.188346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:11.189432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:11.697359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:11.728296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=82 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:11.745626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-697c641f-2c32-4893-9daf-6c7746d99f45 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1273 microversion: 2.1 time: 0.640556 Aug 25 13:20:11.751209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2573/5084] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:11 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1273 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:12.797469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:12.802572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:12.841504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:12.846253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.849642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.853376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:12.855978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:12.857306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:12.859022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:13.713497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:13.775451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:14.169524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:14.203736 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e7bb7227-d082-45d0-a681-ab3d305fc9de tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1273 microversion: 2.1 time: 1.416273 Aug 25 13:20:14.211669 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2512/5085] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:12 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1273 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:15.257851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:15.262425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:15.291401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:15.300241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:15.307789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:15.309855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:15.314376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:15.317715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:15.324381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:16.089875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:16.646090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:16.679407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb99f7b8-8153-4419-8f4c-7637221c0388 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.435234 Aug 25 13:20:16.688165 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2574/5086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:15 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:17.722844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:17.726571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:17.758815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:17.760371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:17.762643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:17.764739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:17.766124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:17.767272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:18.348077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:18.382134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-515a590c-903a-43a6-8aee-6bb6c5c284cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 0.664447 Aug 25 13:20:18.389028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2513/5087] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:17 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:19.438019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:19.439201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:19.486523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:19.487384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:19.491301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:19.495091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:19.504554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:19.508589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.014674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030802ec-1e33-4984-a893-eaca086a2e36", "tag": "8b2294e0-0dd9-4130-907e-8e087dfccd23"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:20.097392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:20.098881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:20.101954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:20.172393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] Creating event network-changed:8b2294e0-0dd9-4130-907e-8e087dfccd23 for instance 030802ec-1e33-4984-a893-eaca086a2e36 on n-h1-850468-18 Aug 25 13:20:20.224158 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5b925364-ebe9-4693-9f21-6abd8c291bfa req-a07ffa5b-be74-44b3-bbcc-b68c9234009d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208266 Aug 25 13:20:20.224158 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2514/5088] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:20:20.779331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:20.809690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40397c63-6b79-49de-996b-1374ad8b6173 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.379434 Aug 25 13:20:20.810895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2575/5089] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:19 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:21.924281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:21.924281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:21.953086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:21.957907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:21.958851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:21.966077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:21.970266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:21.975349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:24.162139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:24.217547 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27be44fb-78c8-4894-a671-b6a962c1a9da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 2.346631 Aug 25 13:20:24.225168 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2515/5090] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:21 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 2362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:25.271372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:25.276302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:25.322272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:25.329880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:25.337157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:25.338904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:25.343527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:25.347629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:26.978588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:26.999967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5346f620-ffe8-4db1-80c5-b862416c7a5f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.738106 Aug 25 13:20:27.044864 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2576/5091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:25 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:28.089228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:28.090734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:28.129837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.130860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.141553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:28.143542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:28.144512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:28.145378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:30.423493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:30.462814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dfccdf2c-7a8d-4485-94a3-aba77862065f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 2.393540 Aug 25 13:20:30.466726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2516/5092] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:28 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:31.508452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:31.513206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:31.541678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.543153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.544965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:31.550685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:31.553422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:31.557650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:33.299944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:33.357097 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-527a0fb3-9c56-480d-bcda-d33d5e6e58ac tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.850130 Aug 25 13:20:33.361566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2577/5093] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:31 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:34.413480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:34.415929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:34.474301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:34.477272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:34.480575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:34.485393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:34.491064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:34.497372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:35.471508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:35.507429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3d40c3c-c389-4b0c-afc3-a6c1bd2a4501 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.107962 Aug 25 13:20:35.534786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2517/5094] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:34 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:36.565432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:36.568329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:36.611795 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:20:36.616342 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 (ip 10.222.0.60) !!! Aug 25 13:20:36.629068 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:20:36.634594 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 (ip 10.222.0.60) !!! Aug 25 13:20:36.638858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:36.641761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:36.642362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:36.643615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:36.649898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:36.653996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:37.741745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:37.843672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e331aa9-6034-448d-a0f9-25ecdf66a5c6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.280412 Aug 25 13:20:37.848224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2578/5095] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:36 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:38.900383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:38.901575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:38.952873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:38.953771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:38.954584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:38.959815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:38.972392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:38.973257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:39.393492 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:20:39.394081 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 (ip 10.222.0.60) !!! Aug 25 13:20:39.804057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030802ec-1e33-4984-a893-eaca086a2e36", "name": "network-vif-plugged", "status": "completed", "tag": "8b2294e0-0dd9-4130-907e-8e087dfccd23"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:39.841715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:39.843053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:39.850565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:39.882479 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] Creating event network-vif-plugged:8b2294e0-0dd9-4130-907e-8e087dfccd23 for instance 030802ec-1e33-4984-a893-eaca086a2e36 on n-h1-850468-18 Aug 25 13:20:39.899740 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-47dd26f8-4b4e-470e-af37-408f73aa885d req-bb37883d-3e77-4849-9a93-7cabc95fc8f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104143 Aug 25 13:20:39.906216 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2579/5096] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:20:40.711054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:40.734517 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-48d46d25-539b-4da6-b23a-3c9bead6ff28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.850232 Aug 25 13:20:40.777726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2518/5097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:38 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:41.811974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:41.814915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:41.843250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.845807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.847337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:41.850538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:41.853479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:41.857432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:43.643075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:43.692523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b54de14-92a3-4213-9390-05097594b686 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1315 microversion: 2.1 time: 1.887926 Aug 25 13:20:43.697414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2580/5098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:41 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1315 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:44.749133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:44.752294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:44.758439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:44.816979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:44.817885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:44.818686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:44.820008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:44.820951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:44.822005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:44.860375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:45.849003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:45.903850 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ba4be56a-1fd8-4fdf-9c3a-166aafb6e377 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1502 microversion: 2.1 time: 1.165595 Aug 25 13:20:45.905033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2519/5099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:44 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1502 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:45.957798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:45.973707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:46.032476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:46.055202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:46.057436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:46.068707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:46.071127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:46.072992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:46.075887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:46.149340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=40 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:20:46.334832 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca174509-5a34-4468-87cc-40920c8d1f1e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.383403 Aug 25 13:20:46.337227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2581/5100] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:45 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:47.355490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:47.359531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:47.390423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:47.391290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:47.392051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:47.393407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:47.394219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:47.395235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:47.594951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4e69b95-baf5-4e11-b3d0-0d44e3d60f4c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.245984 Aug 25 13:20:47.613629 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2520/5101] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:47 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:20:48.632972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:48.647930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:48.688613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:48.694149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:48.695618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:48.697610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:48.704964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:48.706033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:48.962151 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6475d4cf-ba03-4cd2-9a3c-f1a8067c6462 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.343801 Aug 25 13:20:48.963773 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2582/5102] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:48 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 13:20:50.014540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:50.019027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:50.088332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:50.090346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:50.091503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:50.094439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:50.096897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:50.100312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:50.343530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36f24293-ba93-43f8-b688-18c3febcd09b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.367726 Aug 25 13:20:50.344786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2521/5103] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:49 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:51.367032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:51.374350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:51.406152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:51.413971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.415224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.416939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:51.421066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:51.422441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:51.611115 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82d70aa6-98f5-46f6-b20f-c84b19d065e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.253200 Aug 25 13:20:51.613265 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2583/5104] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:51 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:52.639112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:52.651484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:52.695385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:52.701905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:52.702830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:52.704645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:52.705806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:52.714710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:52.947689 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a83e6b8b-8f25-4431-8bfb-429bcf46b029 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.321355 Aug 25 13:20:52.956619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2522/5105] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:52 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:53.981700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:53.989678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:54.020979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.028215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.029498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:54.031202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:54.032424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:54.033530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:54.178214 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e83b34b-90a5-41c5-91d7-8e6d39abe51a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 14 microversion: 2.1 time: 0.209876 Aug 25 13:20:54.179704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2584/5106] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:53 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:20:55.226538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:20:55.239511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:55.286628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.291086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.293886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.295905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.297204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.298341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.411163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7480f832-56d2-47c4-b7a8-099ed01c2c84 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action" status: 200 len: 8208 microversion: 2.1 time: 0.219978 Aug 25 13:20:55.413011 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2523/5107] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:20:55 2022] POST /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36/action => generated 8208 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:55.429656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:55.431893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:55.447654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.450699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.452244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:55.454257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:55.455625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:55.456930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:56.944686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:56.965751 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72d83b4f-f3d4-4a68-ba2a-4cba8337da01 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.541616 Aug 25 13:20:56.967904 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2585/5108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:55 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:20:57.034739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:57.037499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:57.059194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:57.060040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.061286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:57.063967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:57.065424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.067857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:57.845210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:57.929632 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88506242-d3a7-470a-9087-ce819671fed5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.910299 Aug 25 13:20:57.944531 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2524/5109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:57 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:57.969411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:57.971967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:57.987194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:57.988502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.989548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:57.991842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:57.993215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:57.994397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:58.958084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:58.982800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-baf92ded-ebd9-485f-9bef-f079522b74ee tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.021082 Aug 25 13:20:59.003093 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2586/5110] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:57 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:20:59.027464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:20:59.033657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:20:59.088041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:59.090335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:59.091247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:59.093028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:20:59.094563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:20:59.095745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:20:59.959767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:20:59.996645 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-01bde7d3-169f-4a77-933b-209a15ab8a9c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.976447 Aug 25 13:21:00.016091 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2525/5111] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:20:59 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:00.050127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:00.052386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:00.067031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.068689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.070335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:00.072458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.073753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.074943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:00.249652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Locking {{(pid=122701) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 25 13:21:00.519777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1a60e5dc-363e-4d43-b8e5-a1f75f912d6a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.477693 Aug 25 13:21:00.526592 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2587/5112] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:00 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:00.538415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:00.545432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:00.569801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.585392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.593020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:00.599317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:00.600418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:00.601263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:02.864514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:02.907882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ca3f1fe-9e66-4257-8d3a-769ec77ae879 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.378580 Aug 25 13:21:02.923299 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2526/5113] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:00 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:02.982830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:03.064478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.065878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.067447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.241960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action HTTP/1.1 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 15 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: {"os-stop": {}} Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '75c053c9-b1a8-41a1-a5b3-d7354938e85c', 'body': {'os-stop': {}}} Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked Aug 25 13:21:03.246799 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:03.265374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 409 to user: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c is locked {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:03.265374 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c5145d9-69f8-4ba1-9a54-20d567b8cd64 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 409 len: 107 microversion: 2.1 time: 0.278836 Aug 25 13:21:03.265374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2588/5114] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:02 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 107 bytes in 282 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 25 13:21:03.282291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:03.283045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:03.318744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.319256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.319705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.320509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:03.320984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:03.321517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:03.599195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Unlocking {{(pid=122700) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 25 13:21:03.942514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b65011b-e00f-437a-bd67-d8a4150b8dbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.681383 Aug 25 13:21:03.945765 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2527/5115] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:03 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:03.966416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:04.047828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.048764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.065580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.180570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:21:04.413273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18df4fff-f920-41ae-8462-4d2f8c8b8d43 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.444019 Aug 25 13:21:04.416001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2589/5116] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:03 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:04.460608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:04.462092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:04.497419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.511777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.516623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:04.518206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:04.519162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:04.523850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:05.888699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:05.911633 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6492261b-9e47-42fc-82b9-4556e2dba699 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.486269 Aug 25 13:21:05.920183 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2528/5117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:04 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:06.877703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:06.892945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:06.906391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.907708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.909090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.910755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:06.912384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:06.913471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:06.970808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:06.976240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:06.990741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c6c3d0d-86ca-4c75-9ba5-21ca1e2e646e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.125385 Aug 25 13:21:07.003279 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2590/5118] 10.222.0.60 () {60 vars in 1343 bytes} [Thu Aug 25 13:21:06 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:07.011460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.023281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.024873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.026829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.028203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.029156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.240812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:07.241734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:07.255236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.256297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.257288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.258833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.260069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.262207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.342151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:21:07.579741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c2f8f05-45fa-4255-a2fa-7c687373f893 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 204 len: 0 microversion: 2.20 time: 0.347358 Aug 25 13:21:07.580929 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2591/5119] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:21:07 2022] DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 13:21:07.603556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:07.607503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:07.634777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.635744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.639456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:07.643111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:07.644153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:07.644974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:08.442622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:08.471343 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7146fdbc-734e-4a0d-a250-f442456d238c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.514617 Aug 25 13:21:08.486702 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2529/5120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:06 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:08.781342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:08.815838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:08.821366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:08.825254 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e199d065-ecee-4136-b04e-a902a4572179 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.236418 Aug 25 13:21:08.830252 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2592/5121] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:07 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:21:09.518961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:09.528096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:09.562456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.564446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.565365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.566876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.567924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.568751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.877109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:09.878424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:09.903145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.905210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.907028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:09.907416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:09.908496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:09.909315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:10.953831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:10.987554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:10.990983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:10.993557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-325f7e8c-77f0-4ae4-a208-cd1f1c69d340 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.123228 Aug 25 13:21:11.008100 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2593/5122] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:09 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:11.247497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:11.286064 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-45e96f0c-333a-4ab1-9174-e7389534164f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.774248 Aug 25 13:21:11.298133 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2530/5123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:09 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:12.052579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:12.053664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:12.088504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.091119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.093443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.095851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.096840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.098732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.110551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:12.338873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:12.345099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:12.409711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.410848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.413368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:12.420935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:12.421987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:12.440940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:13.037713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:13.055178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:13.059033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:13.063581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8f1bfe94-5854-4102-98b3-ddad973aae54 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.020760 Aug 25 13:21:13.064778 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2594/5124] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:12 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:13.668649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-unplugged", "status": "completed", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:13.718474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:13.726946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:13.728510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:13.771463 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] Creating event network-vif-unplugged:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:21:13.799413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-099611d0-3a9c-47c6-bc5f-19e5ab626f67 req-21cec95d-fef6-4541-8444-7c5ede33f1f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148229 Aug 25 13:21:13.801543 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2595/5125] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:14.120676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:14.122163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:14.158325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:14.159185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:14.168821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:14.170482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:14.171432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:14.176529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:14.244403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:14.285174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73c1fadc-6591-4aa2-9dff-b080febff5e2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.954098 Aug 25 13:21:14.300705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2531/5126] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:12 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:15.165617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:15.218892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:15.229118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:15.236481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3efe0efd-45f4-4d36-87c0-6f93dc77f2cc tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1721 microversion: 2.20 time: 1.125216 Aug 25 13:21:15.246112 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2596/5127] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:14 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1721 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 13:21:15.326598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:15.334481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:15.366315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:15.369476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.370825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.373290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.378363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:15.379726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:15.380819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:15.390348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:16.302760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:16.305492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:16.311911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:16.326328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:16.327838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:16.329370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:16.332423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:16.333844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:16.335441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.331992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:17.351076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d53e2928-cfda-406d-911a-7e874d9ef21e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1657 microversion: 2.1 time: 2.034260 Aug 25 13:21:17.353219 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2532/5128] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:15 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1657 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:17.395209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:17.409528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.411026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.412176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.473818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Going to try to start instance {{(pid=122700) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:21:17.638654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:17.672473 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32d0e166-1a89-4542-b7bf-785db843047e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.283284 Aug 25 13:21:17.679626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:17.686588 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2533/5129] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:17 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:21:17.692651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:17.702794 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f1c907f-d943-4884-ab60-3736488d12aa tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1653 microversion: 2.20 time: 1.403863 Aug 25 13:21:17.721535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:17.725561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:17.726786 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2597/5130] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:16 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1653 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:17.762806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.764254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.765975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:17.767586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:17.768685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:17.769634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.783882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:18.789165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:18.824669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.836691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.840503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:18.847717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:18.850311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:18.857050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:19.777238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:19.795518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:19.800070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:19.803410 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d622d61-2951-47ae-967c-869dec27f497 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1653 microversion: 2.20 time: 1.043499 Aug 25 13:21:19.807094 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2598/5131] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:18 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1653 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:20.244504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:20.293190 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25beb538-f9d0-4cc5-8bb6-9ada1958104a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1666 microversion: 2.1 time: 2.597638 Aug 25 13:21:20.307918 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2534/5132] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:17 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1666 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:20.857416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:20.862470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:20.902570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:20.904164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:20.905480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:20.908553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:20.912714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:20.915276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.352639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:21.355553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:21.391416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:21.392857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:21.393915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.399336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:21.400687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:21.403372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.547646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:21.580891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:21.587765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:21.600577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c8169bf-2775-451e-b3ca-b4badae879c7 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1653 microversion: 2.20 time: 0.746041 Aug 25 13:21:21.602559 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2599/5133] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:20 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1653 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:21.637522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62217323-bf2d-4a70-8803-cfa09ee063bc", "name": "network-vif-deleted", "tag": "8b5011d6-546a-42c9-a132-3babb7c0d179"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:21.679628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:21.688896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:21.689773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:21.751522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] Creating event network-vif-deleted:8b5011d6-546a-42c9-a132-3babb7c0d179 for instance 62217323-bf2d-4a70-8803-cfa09ee063bc on n-h1-850468-18 Aug 25 13:21:21.771407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a5d54b85-f12a-4f9d-badd-6666bf858724 req-fa1a6096-d187-4f51-844e-928cec6ddf44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145810 Aug 25 13:21:21.773074 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2600/5134] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:21:22.680838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:22.700140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:22.722225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.724459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.725525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.727378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.728853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.731747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.989075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:22.990752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:22.996528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:22.998176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lazy-loading 'fault' on Instance uuid 62217323-bf2d-4a70-8803-cfa09ee063bc {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:21:23.393747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.440048 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-de7e5765-1f2f-4c96-8fdc-e317074de192 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.097449 Aug 25 13:21:23.442178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.471801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.475837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b10100bafac8484095f6348ca67abc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022896ed488444869702ebfc14d206ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:23.480988 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aefbe3f5-c982-438c-96ed-8e695a4a4c2e tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 200 len: 1370 microversion: 2.20 time: 0.815167 Aug 25 13:21:23.485942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2535/5135] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:21 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:23.486653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2601/5136] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:22 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 1370 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 13:21:23.531677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:23.541248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:23.593629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.596059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.601859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:23.613451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:23.614678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:23.621295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.479829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:24.531362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c8dc70b-1361-4101-97e4-ee6ae889b321 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.040760 Aug 25 13:21:24.533280 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2536/5137] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:23 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:24.547436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:24.548653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:24.590832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:24.591857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:24.608239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.609896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.611670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.612090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.615651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.616097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.616097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.616097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.624070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.630202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:24.631773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:24.632985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:24.745287 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc HTTP/1.1 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '62217323-bf2d-4a70-8803-cfa09ee063bc'} Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:24.761259 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:24.774990 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:24.783596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:24.789840 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-39d6889d-976a-4b57-87f3-efaad043ee3f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 404 len: 111 microversion: 2.20 time: 0.257147 Aug 25 13:21:24.796328 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2602/5138] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:24 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:21:24.802537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Unlocking {{(pid=122700) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 25 13:21:24.831303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-251e9665-8682-45b0-abc7-8760e7373c85 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '.version_select at 0x7fc6c1dbf040>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:24.920222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-251e9665-8682-45b0-abc7-8760e7373c85 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350251063" status: 204 len: 0 microversion: 2.20 time: 0.113238 Aug 25 13:21:24.922069 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2603/5139] 10.222.0.60 () {60 vars in 1259 bytes} [Thu Aug 25 13:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350251063 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 13:21:25.121502 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5319e0c-645d-4c51-98f5-94050434acce tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.534436 Aug 25 13:21:25.141017 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2537/5140] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:24 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:21:25.161380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:25.164430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:25.217666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:25.218575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:25.219366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:25.227355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:25.228390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:25.230056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:26.737617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:26.784857 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ff815f3-81cc-4ae1-94cb-3735bc422663 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.634181 Aug 25 13:21:26.791806 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2604/5141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:25 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:26.842831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:26.845980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:26.914324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.918996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.928353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:26.933041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:26.938248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:26.943147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.832726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:27.870755 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a44bd3c3-9d8f-4f8b-bea2-d89541d143d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.035810 Aug 25 13:21:27.885790 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2538/5142] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:26 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:27.912597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:27.913787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:27.957618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:27.958828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:27.959687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:27.961173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:27.962114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:27.962433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.554513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:28.579111 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af0e4971-35f1-4e30-92da-fb69f9f8945b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.674402 Aug 25 13:21:28.591905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2605/5143] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:28.644377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:28.658093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:28.678172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.684478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.685798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.698964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.700541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:28.701737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:28.951220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f92c2f8-8ed4-4076-9d1d-006c6762d12d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.312739 Aug 25 13:21:28.954208 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2539/5144] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:28 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:28.968437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:28.969769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:28.996008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:28.998517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:29.013494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:29.018340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:29.021564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:29.023822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:30.620105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:30.688251 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6087ec4f-77a0-4c51-8ecb-4d671059434b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1675 microversion: 2.1 time: 1.728161 Aug 25 13:21:30.731198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2606/5145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:28 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1675 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:31.743676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:31.751482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:31.803354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.805895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.810052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:31.816215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:31.819316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:31.825390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:32.841417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:32.883595 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5588d5c-dcd2-49f3-a1a4-8a6636daf6fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1655 microversion: 2.1 time: 1.149142 Aug 25 13:21:32.886889 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2540/5146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:31 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1655 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:32.965269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:21:32.966213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:32.988021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:32.993722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:32.994556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:32.996037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:33.001970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:33.002546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:33.389586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6ea9ea43-d651-4e7f-8b20-1c7ce48540df tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.451335 Aug 25 13:21:33.399573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2607/5147] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:21:32 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:21:33.429514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:33.436908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:33.483733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:33.489523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:33.492507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:33.516381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:33.519625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:33.523168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:35.051250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:35.111666 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22a67d4d-2683-4835-8f04-cc0a838f30bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1662 microversion: 2.1 time: 1.712253 Aug 25 13:21:35.126532 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2541/5148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:33 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1662 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:36.178061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:36.179341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:36.208097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:36.209018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:36.216209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:36.218385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:36.224585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:36.225957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:36.898950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:36.933081 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9628e856-eb54-4859-8e24-313b9eb6db6e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.763616 Aug 25 13:21:36.937205 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2608/5149] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:36 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:36.984395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:36.992266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:37.063327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:37.065144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:37.066035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:37.076328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:37.077392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:37.081823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.260826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:38.299525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d26b47ba-010f-4bca-be76-dcd0e739840a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.325233 Aug 25 13:21:38.305834 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2542/5150] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:36 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:38.367461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:38.370711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:38.419515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:38.421282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:38.424047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.429213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:38.430800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:38.433995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.769916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:38.774528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:38.801376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:38.805238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:38.809667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.810998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:38.829797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:38.834817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:38.927647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc HTTP/1.1 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '62217323-bf2d-4a70-8803-cfa09ee063bc'} Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:38.934868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:38.944863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:38.952260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6731377-51e3-4379-ac2e-5d38ca08538f tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 404 len: 111 microversion: 2.20 time: 0.181662 Aug 25 13:21:38.959566 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2543/5151] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:21:38 2022] DELETE /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:21:38.993366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:38.994825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 62217323-bf2d-4a70-8803-cfa09ee063bc] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:39.031960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:39.058285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:39.078767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:39.083736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:39.085728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:39.094493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:39.204858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc HTTP/1.1 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '62217323-bf2d-4a70-8803-cfa09ee063bc'} Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:39.214190 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:39.221014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 62217323-bf2d-4a70-8803-cfa09ee063bc could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:39.226293 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-04ca1b8f-0148-402f-8d20-05d19cf12afe tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc" status: 404 len: 111 microversion: 2.20 time: 0.255563 Aug 25 13:21:39.234924 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2544/5152] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:38 2022] GET /compute/v2.1/servers/62217323-bf2d-4a70-8803-cfa09ee063bc => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:21:40.870183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:40.936235 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7e9e6a85-b7ed-40ab-aafd-d715be861bef tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.588895 Aug 25 13:21:40.939570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2609/5153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:38 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:41.019327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:41.023662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:41.074310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.086654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.086654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.086654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.087713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.089005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.229740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:41.726274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:41.762531 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-feb30431-792d-444b-86fe-2d5eb7aa72c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.781510 Aug 25 13:21:41.764789 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2545/5154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:40 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:41.814189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:41.815760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:41.849662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.851231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.852492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:41.855095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:41.855927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:41.858340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:43.931169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:43.937154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:43.970031 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-673ac139-a0aa-417c-883f-e368933715c5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.170644 Aug 25 13:21:43.971044 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2610/5155] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:41 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:21:44.015973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:44.022089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:44.038483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:44.039237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:44.040558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:44.042383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:44.043846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:44.045029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:44.876922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:21:44.910146 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-42ffaef3-047c-4632-aea4-d648836c763b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.902611 Aug 25 13:21:44.915285 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2546/5156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:21:44 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:21:48.193349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:48.194646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:48.238838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:48.247953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.249054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.249987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.251448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.252397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.253712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.300989 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 HTTP/1.1 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '71b2d44b-7481-4d0f-8d89-1e2227155420'} Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:48.305209 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e1e22f6-6afa-4a53-9ec3-abf088806ac8 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 404 len: 111 microversion: 2.20 time: 0.138141 Aug 25 13:21:48.314981 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2611/5157] 10.222.0.60 () {60 vars in 1280 bytes} [Thu Aug 25 13:21:48 2022] DELETE /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 13:21:48.326788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:21:48.328045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] [instance: 71b2d44b-7481-4d0f-8d89-1e2227155420] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:21:48.357165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=30 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:21:48.360907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.374612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.375808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.378764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:21:48.409214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:21:48.411905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:21:48.462555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] HTTP exception thrown: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Request method failure captured: Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 HTTP/1.1 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3Qm7DtBHt07j4nch9aS-mCcZcO1ro0MvhwcmYLHmh21NEwKiL5LFjkhx12QyfoKnMh169nSH4ozwggzTj2T1Lv23LeHI1mnRVPIJ1MklUknypQCszezmlK54PWfsmVAxpKBOooEppYt9UkybE0GEwxISEKiYjP6ezOFZlE9OSWVuAM Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_022896ed488444869702ebfc14d206ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/022896ed488444869702ebfc14d206ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/022896ed488444869702ebfc14d206ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 022896ed488444869702ebfc14d206ba Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1602904027 Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: b10100bafac8484095f6348ca67abc7c Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1602904027-project Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '71b2d44b-7481-4d0f-8d89-1e2227155420'} Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.466862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. Aug 25 13:21:48.474758 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:21:48.478772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] Returning 404 to user: Instance 71b2d44b-7481-4d0f-8d89-1e2227155420 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:21:48.481828 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7182086-127c-4bb1-9c97-36d83cee1517 tempest-AttachVolumeShelveTestJSON-1602904027 tempest-AttachVolumeShelveTestJSON-1602904027-project] 10.222.0.60 "GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420" status: 404 len: 111 microversion: 2.20 time: 0.164234 Aug 25 13:21:48.483940 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2547/5158] 10.222.0.60 () {60 vars in 1277 bytes} [Thu Aug 25 13:21:48 2022] GET /compute/v2.1/servers/71b2d44b-7481-4d0f-8d89-1e2227155420 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:12.160229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:12.162296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:12.476079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54470fca-0afc-446e-99ba-e22ffc0b6387 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Action: 'create', calling method: .version_select at 0x7fc6c196c0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1611181508", "metadata": {"Type": "work"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54470fca-0afc-446e-99ba-e22ffc0b6387 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 122 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1611181508", "metadata": {"Type": "work"}}} Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1611181508', 'metadata': {'Type': 'work'}}}} Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '#$%' Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:22:12.502238 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54470fca-0afc-446e-99ba-e22ffc0b6387 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:12.514148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54470fca-0afc-446e-99ba-e22ffc0b6387 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.351572 Aug 25 13:22:12.517782 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2612/5159] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 25 13:22:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:12.524801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b7c584-d6c0-4d26-a719-f5458928af4a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Action: 'create', calling method: .version_select at 0x7fc6c10d45e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154109266", "metadata": {"Type": "work"}}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b7c584-d6c0-4d26-a719-f5458928af4a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 119 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154109266", "metadata": {"Type": "work"}}} Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-154109266', 'metadata': {'Type': 'work'}}}} Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi '0' Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:22:12.533699 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14b7c584-d6c0-4d26-a719-f5458928af4a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14b7c584-d6c0-4d26-a719-f5458928af4a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020467 Aug 25 13:22:12.543086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2548/5160] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 25 13:22:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:12.561858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c3ccf5a-6ae6-4aa3-833a-3a9593709057 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Action: 'create', calling method: .version_select at 0x7fc6c6ad8940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-106939728", "metadata": {"Type": "work"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c3ccf5a-6ae6-4aa3-833a-3a9593709057 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 118 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-106939728", "metadata": {"Type": "work"}}} Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-106939728', 'metadata': {'Type': 'work'}}}} Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '' Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 13:22:12.570583 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c3ccf5a-6ae6-4aa3-833a-3a9593709057 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c3ccf5a-6ae6-4aa3-833a-3a9593709057 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024006 Aug 25 13:22:12.580651 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2613/5161] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 25 13:22:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 13:22:12.587696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:12.589725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:12.596370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9093877-b858-4af6-a67d-fa877126727e tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Calling method '.version_select at 0x7fc6c1089d30>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:12.973174 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a9093877-b858-4af6-a67d-fa877126727e tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] HTTP exception thrown: Volume tempest-invalid-1227527738 could not be found. Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9093877-b858-4af6-a67d-fa877126727e tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1227527738 HTTP/1.1 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume tempest-invalid-1227527738 could not be found. Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'tempest-invalid-1227527738'} Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1227527738 could not be found. (HTTP 404) (Request-ID: req-9b2387c3-3c74-46d4-b329-fc7d2e454f19) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:22:13.000511 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1227527738 could not be found. Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1227527738 could not be found. Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1227527738 could not be found. Aug 25 13:22:13.009256 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.020020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9093877-b858-4af6-a67d-fa877126727e tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 404 to user: Volume tempest-invalid-1227527738 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:13.020020 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9093877-b858-4af6-a67d-fa877126727e tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1227527738" status: 404 len: 99 microversion: 2.1 time: 0.429301 Aug 25 13:22:13.021777 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2549/5162] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:22:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1227527738 => generated 99 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:22:13.042851 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57802bcc-0f76-439f-a2e0-eda5209a6b4d tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009418 Aug 25 13:22:13.044526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2614/5163] 10.222.0.60 () {58 vars in 1140 bytes} [Thu Aug 25 13:22:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 13:22:13.077998 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e3f13d7-c3f4-4c55-b192-cead0f61eab4 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024473 Aug 25 13:22:13.081125 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2550/5164] 10.222.0.60 () {58 vars in 1137 bytes} [Thu Aug 25 13:22:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 13:22:13.102034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c65d055-aedb-4ceb-a6c1-3d0004fab6c8 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Calling method '.version_select at 0x7fc6c1fc5ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:13.172226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-8c65d055-aedb-4ceb-a6c1-3d0004fab6c8 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] HTTP exception thrown: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c65d055-aedb-4ceb-a6c1-3d0004fab6c8 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/os-volumes/63e84628-fcd4-44be-8f42-4c1eacf8e2db HTTP/1.1 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: method: Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: exception: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '63e84628-fcd4-44be-8f42-4c1eacf8e2db'} Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. (HTTP 404) (Request-ID: req-b3f3e587-7ed0-47ea-a0c7-568675f2da1c) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:22:13.175629 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c65d055-aedb-4ceb-a6c1-3d0004fab6c8 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 404 to user: Volume 63e84628-fcd4-44be-8f42-4c1eacf8e2db could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:13.187721 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c65d055-aedb-4ceb-a6c1-3d0004fab6c8 tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/63e84628-fcd4-44be-8f42-4c1eacf8e2db" status: 404 len: 109 microversion: 2.1 time: 0.089216 Aug 25 13:22:13.195987 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2615/5165] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:22:13 2022] DELETE /compute/v2.1/os-volumes/63e84628-fcd4-44be-8f42-4c1eacf8e2db => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:22:13.197180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-854405a2-066b-40da-b93f-3551b264dc5a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Calling method '.version_select at 0x7fc6c11289d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:13.316482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-854405a2-066b-40da-b93f-3551b264dc5a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] HTTP exception thrown: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-854405a2-066b-40da-b93f-3551b264dc5a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Request method failure captured: Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-volumes/7e50da0c-7c0f-41d9-bccc-12b02f82453c HTTP/1.1 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eDUDPJ37ZELd02ZQcPK9plbGAZNvqxa68_7jlZntG1bnbUk4At8FkylgW9Pt_dm7G6FQvyiNeC_y8IBBKoTLysF3s4pCCfU58rzNEWN9oYTrSFvHPjw7vmgjpPilU-1CYpth3GBnqEG0gFI6ricztt34frx28lkLavaJySegN9cm0 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e2679fd212074434b1f7fa04b13b5ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: e2679fd212074434b1f7fa04b13b5ad8 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesNegativeTest-2075203903 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: be08d858ad5f421782c6e313ac1cc6b5 Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesNegativeTest-2075203903-project Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7e50da0c-7c0f-41d9-bccc-12b02f82453c'} Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. (HTTP 404) (Request-ID: req-8bd15c0d-767e-4db7-8c76-9e6474e15f3f) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:22:13.321777 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-854405a2-066b-40da-b93f-3551b264dc5a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] Returning 404 to user: Volume 7e50da0c-7c0f-41d9-bccc-12b02f82453c could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-854405a2-066b-40da-b93f-3551b264dc5a tempest-VolumesNegativeTest-2075203903 tempest-VolumesNegativeTest-2075203903-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/7e50da0c-7c0f-41d9-bccc-12b02f82453c" status: 404 len: 109 microversion: 2.1 time: 0.135334 Aug 25 13:22:13.331528 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2551/5166] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:22:13 2022] GET /compute/v2.1/os-volumes/7e50da0c-7c0f-41d9-bccc-12b02f82453c => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:22:23.982515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:23.992382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:24.027167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:24.035462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:24.036579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:24.046267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:24.047436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:24.050352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:24.463236 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5c890bf0-a510-4d73-8479-ac83812387f6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.502915 Aug 25 13:22:24.470701 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2616/5167] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:22:23 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:22:24.560974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:24.563046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:24.607530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:24.608731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:24.610213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:24.612879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:24.614514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:24.617364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:26.040609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:26.069493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8f8d166a-0696-4d4e-8d78-fbfc9df05d79 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 1.592502 Aug 25 13:22:26.071317 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2552/5168] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:24 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:27.123868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:27.142183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:27.165236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:27.166655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:27.167862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:27.169925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:27.172284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:27.173468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:28.697014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:28.724943 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9fac3848-96ab-4750-b830-d5df9d5468d1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 1.615732 Aug 25 13:22:28.726052 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2617/5169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:29.777359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:29.782450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:29.835314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.839284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.841483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:29.848805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:29.850144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:29.866034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:30.573804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:30.603255 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97206693-6a65-4ce6-88e3-f987c6aa5aab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1672 microversion: 2.1 time: 0.837798 Aug 25 13:22:30.616148 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2553/5170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:29 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1672 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:22:31.657567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:22:31.658417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:22:31.708858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:31.710434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:31.715254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:31.719193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:22:31.720673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:22:31.722361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:22:32.251495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:22:32.299079 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56154a73-5e45-40fe-9e70-aacbc0d741bb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.647824 Aug 25 13:22:32.301603 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2618/5171] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:22:31 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:22:59.694039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-176363187", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "532d430d-c1f2-4f1b-abd7-037f0a58c1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:22:59.760521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:59.765103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:22:59.982425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:23:01.589068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:23:01.589068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:23:01.590231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:23:01.590231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:23:01.591944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:23:01.641681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:01.650824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:01.651663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:01.654235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:01.656587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:01.658348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:01.780324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:23:01.831523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:23:02.248007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:23:02.254804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='532d430d-c1f2-4f1b-abd7-037f0a58c1ec',volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:23:03.090587 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-82a58cb2-5818-4ecb-93b6-7d9a76318c1e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.404355 Aug 25 13:23:03.095768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2554/5172] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:23:03.115607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d355d7f1-5ed3-4bb4-ab95-83aed7209b54 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:03.116772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d355d7f1-5ed3-4bb4-ab95-83aed7209b54 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:03.149374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:03.150627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:03.578535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d355d7f1-5ed3-4bb4-ab95-83aed7209b54 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:03.618582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d355d7f1-5ed3-4bb4-ab95-83aed7209b54 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1056 microversion: 2.1 time: 0.508367 Aug 25 13:23:03.633140 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2619/5173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:03 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1056 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:04.689237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed4a593c-6d1e-4b30-9235-7a3c71fd9ef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:04.693740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed4a593c-6d1e-4b30-9235-7a3c71fd9ef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:04.941849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed4a593c-6d1e-4b30-9235-7a3c71fd9ef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:04.983682 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed4a593c-6d1e-4b30-9235-7a3c71fd9ef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1056 microversion: 2.1 time: 0.309216 Aug 25 13:23:04.987534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2555/5174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:04 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1056 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:06.038347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:06.045083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:06.075439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:06.076869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:06.078233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:06.081180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:06.099864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:06.102228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:06.448509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:06.490688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c971ed90-54e2-4c69-a0d5-953098b92f4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1154 microversion: 2.1 time: 0.464303 Aug 25 13:23:06.504435 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2620/5175] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:06 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1154 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:07.559269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:07.571079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:07.633239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:07.652439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:07.669745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:07.678192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:07.679571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:07.682959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:08.213108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:08.248012 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79a787d2-393e-445c-a109-003c79e6e0c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1172 microversion: 2.1 time: 0.699278 Aug 25 13:23:08.257253 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2556/5176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:07 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1172 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:09.308322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:09.310561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:09.345443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:09.350556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:09.357491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:09.363664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:09.367167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:09.373354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:09.952709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:09.991090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fc3f9706-6e23-43ed-aa81-4cbe08fa18ca tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1172 microversion: 2.1 time: 0.694707 Aug 25 13:23:09.997487 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2621/5177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:09 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1172 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:11.045494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:11.046979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:11.067080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:11.067911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:11.068782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:11.070143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:11.071025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:11.076656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:11.461538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:11.503206 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c445c19-cd5f-4365-967d-d54245ea2fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1172 microversion: 2.1 time: 0.471856 Aug 25 13:23:11.509929 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2557/5178] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:11 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1172 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:12.565754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:12.566980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:12.607788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:12.608623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:12.609404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:12.610698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:12.614512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:12.631504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:13.596595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:14.323526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:14.376795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd94892b-70f9-4326-88f9-2621586f68be tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 1.828049 Aug 25 13:23:14.401703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2622/5179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:12 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:15.426514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:15.434354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:15.448962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:15.463454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:15.496703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:15.498425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:15.499544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:15.501262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:15.502445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:15.503235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:16.963433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:16.987263 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3606f80b-8c83-49c6-98a1-0aa4246641b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 1.574410 Aug 25 13:23:16.991528 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2558/5180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:15 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:18.064804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:18.069003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:18.111282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:18.112262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:18.113330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:18.114975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:18.119827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:18.123180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:19.401382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:19.401382 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68cf0858-a54f-46a9-9db3-1399acd906de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 0.887054 Aug 25 13:23:19.401382 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2623/5181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:18 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:20.427423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:20.440880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:20.468507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fd5af9-6851-43b5-bf96-a6b31755147d", "tag": "0155754b-f9c4-450a-ac4c-318510551226"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:20.481678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:20.482556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:20.483610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:20.484975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:20.485829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:20.486611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:20.521687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:20.521687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:20.521687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:20.608187 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] Creating event network-changed:0155754b-f9c4-450a-ac4c-318510551226 for instance 38fd5af9-6851-43b5-bf96-a6b31755147d on n-h1-850468-18 Aug 25 13:23:20.648742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5e428b1b-033c-48d2-87b5-f5b133736fb2 req-77f3dce8-3734-4ab2-b07c-8c8162d53d90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190198 Aug 25 13:23:20.653568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2624/5182] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:23:21.667000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:21.700341 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f156b6f7-e2c2-4c20-8abc-0317537a824a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 1.279616 Aug 25 13:23:21.711458 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2559/5183] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:20 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:22.760055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:22.763486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:22.810351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:22.820916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:22.822761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:22.827578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:22.832356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:22.833627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:24.165338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:24.211305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9a91542-d186-49af-ad1e-e1b366a582cd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 1.468117 Aug 25 13:23:24.214154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2625/5184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:22 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:25.255980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:25.258063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:25.317990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:25.319675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:25.330356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:25.358791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:25.361314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:25.362511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:25.837609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:25.863859 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34a65896-5821-4933-af9b-872245f0767d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 0.617424 Aug 25 13:23:25.880268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2560/5185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:25 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:26.917696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:26.923962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:26.956778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:26.963406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:26.964871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:26.971429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:26.973294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:26.986060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:27.915396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:27.961029 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd77bced-a847-4c51-94dc-63028e238149 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 1.041214 Aug 25 13:23:27.964674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2626/5186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:26 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:29.005729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:29.010688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:29.080455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:29.082390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:29.087547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:29.091095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:29.096366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:29.100562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:32.019641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:32.023756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=37 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:32.077524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93eaef3e-eaed-489e-b79d-286093cc3ddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1214 microversion: 2.1 time: 3.056256 Aug 25 13:23:32.079270 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2561/5187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:28 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1214 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:33.145582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:33.154913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:33.221364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:33.222760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:33.224693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:33.234648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:33.236269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:33.237456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:33.380303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=39 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:34.577140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:34.605289 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba58f6c7-de04-4835-8dbd-4e7d713ea487 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 1.484630 Aug 25 13:23:34.606772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2627/5188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:33 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:35.657096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:35.658654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:35.696271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=21 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:35.750441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:35.755080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:35.765404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:35.768862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:35.770806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:35.781921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:36.427486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:36.432385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:36.441346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:36.469639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:36.472971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:36.476617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:36.478591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:36.483580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:36.485185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:37.253171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:37.294397 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f8a4c13-1768-43b0-8f28-6bdfe35c2c7a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 1.649773 Aug 25 13:23:37.305277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2628/5189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:35 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:37.582216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:37.609028 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-511d736d-daeb-4186-b98c-4cddb7a7c9c2 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.055213 Aug 25 13:23:37.620688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2562/5190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:35 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:37.674940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:37.676071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:37.725019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:37.725935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:37.726750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:37.740667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:37.745733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:37.747422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:38.354306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:38.355384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:38.397873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:38.399168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:38.402141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:38.403757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:38.405036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:38.407142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:39.986147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:40.027923 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6ba5aee7-e0c7-4509-810f-84da4cbf993d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.359455 Aug 25 13:23:40.035581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2629/5191] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:37 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:40.084008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:40.087491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:40.102184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:40.104387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:40.106175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:40.108019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:40.109348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:40.110542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:40.340829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:40.367105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ab0aea4-a3c6-4737-a875-004d21a4b27a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 2.032760 Aug 25 13:23:40.370295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2563/5192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:38 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:41.423325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:41.424827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:41.457582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.459080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.460620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:41.466052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.469374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.480686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:41.595591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:41.623639 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db10bb0e-4eff-4736-9a2a-7bdf7ed1b99b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.550225 Aug 25 13:23:41.625164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2630/5193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:40 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:41.673159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:41.675618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:41.708656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.710138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.715500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:41.717591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:41.721711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:41.732760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:44.382823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:44.451328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-87c8cb6d-7f9a-49ad-93de-287e3d3697fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 3.038098 Aug 25 13:23:44.454348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2564/5194] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:41 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:44.729081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:44.756249 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3191769-18ea-4353-8daa-38e0548e4890 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 3.093004 Aug 25 13:23:44.758672 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2631/5195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:41 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 3098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:45.177621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1673558398", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "723617c5-71c1-48f0-b95e-eb7a1111c402"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:45.412516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] validate_networks() for [('723617c5-71c1-48f0-b95e-eb7a1111c402', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:23:45.498265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:45.499513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:45.525411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:45.529319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:45.530486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:45.536178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:45.539031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:45.540820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:47.094029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:47.142314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5b863bf-f933-4ab3-bdd3-22a6ae9d18d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 1.658873 Aug 25 13:23:47.146540 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2632/5196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:45 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:47.168185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fd5af9-6851-43b5-bf96-a6b31755147d", "name": "network-vif-plugged", "status": "completed", "tag": "0155754b-f9c4-450a-ac4c-318510551226"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:23:47.205348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:47.206348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:47.207168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:47.250698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] Creating event network-vif-plugged:0155754b-f9c4-450a-ac4c-318510551226 for instance 38fd5af9-6851-43b5-bf96-a6b31755147d on n-h1-850468-18 Aug 25 13:23:47.264170 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-186888cc-5d5f-48a4-b92d-ced1f2d632f2 req-af433fed-5c04-4d37-be39-d4abf583760e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114500 Aug 25 13:23:47.266157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2633/5197] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:23:48.194874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:48.198896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:48.224055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:48.235373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:48.236848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:48.238772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:48.240067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:48.241337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:49.318828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:49.339992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d7e8b7de-8005-4829-90db-42544f81e7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 1.158000 Aug 25 13:23:49.357665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2634/5198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:48 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:49.627726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:23:49.630923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:23:49.632331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:23:49.635427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:23:49.636741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:23:49.674055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:49.674799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:49.675449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:49.690624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:49.692019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:49.692938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:49.738043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:23:49.758236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:23:49.798818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:23:49.807226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:23:50.024043 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22154590-707b-41f4-bc2f-97866f46f5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.855545 Aug 25 13:23:50.027928 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2565/5199] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:23:50.047712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7194db9d-d4a6-4a2b-a8e7-6693caf337f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:50.049502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7194db9d-d4a6-4a2b-a8e7-6693caf337f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:50.393742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:50.406143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:50.420474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7194db9d-d4a6-4a2b-a8e7-6693caf337f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:50.476235 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7194db9d-d4a6-4a2b-a8e7-6693caf337f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1215 microversion: 2.1 time: 0.436530 Aug 25 13:23:50.486828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:50.489071 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2635/5200] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:50 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1215 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:50.516471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:50.516471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:50.516471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:50.516962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:50.517623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:51.547755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-922ddab8-ea6c-4eb1-a9b0-050b75de57ec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:51.550663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-922ddab8-ea6c-4eb1-a9b0-050b75de57ec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:51.999959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-922ddab8-ea6c-4eb1-a9b0-050b75de57ec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:52.039339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-922ddab8-ea6c-4eb1-a9b0-050b75de57ec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1215 microversion: 2.1 time: 0.507472 Aug 25 13:23:52.043293 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2636/5201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:51 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1215 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:52.336151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:52.386803 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d58c13b-d051-460e-855d-b2b8a3a93678 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1202 microversion: 2.1 time: 2.003637 Aug 25 13:23:52.389510 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2566/5202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:50 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1202 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:53.100102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:53.121648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:53.161418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:53.162353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:53.163172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:53.187989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:53.204713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:53.205795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:53.443318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:53.447934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:53.470545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:53.471903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:53.473501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:53.475673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:53.479512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:53.481709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:54.021940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:54.057524 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-194af1ea-9335-49c8-bc85-e61a103266da tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1267 microversion: 2.1 time: 0.969928 Aug 25 13:23:54.061601 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2637/5203] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:53 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1267 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:55.116870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:55.118919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:55.142680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.144086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.146450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.148391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.149557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.150339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.389258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:55.419261 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc254547-db91-4c31-8479-48967f4a66b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1390 microversion: 2.1 time: 1.989898 Aug 25 13:23:55.420939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2567/5204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:53 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1390 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:55.487074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:55.493841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:55.520161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.529448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.530866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.532852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:55.534118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:55.535244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:55.785751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:55.815814 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a16c5c5-f4b2-4e8a-ae46-922c8eb97cd9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1273 microversion: 2.1 time: 0.719064 Aug 25 13:23:55.817444 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2638/5205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:55 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1273 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:56.296886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:56.312636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32e8ea77-0f77-4da0-ae10-c5212337f126 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1390 microversion: 2.1 time: 0.832741 Aug 25 13:23:56.314093 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2568/5206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:55 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1390 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:56.355816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:56.371073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:56.390533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.392488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.393708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:56.395407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.396661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.397797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:56.874960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:56.877554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:56.909859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:56.920082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.921616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.928934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:56.935045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:56.936358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:56.937501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:56.946801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e78ae276-7e80-403e-9f93-079c0042bbe6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1390 microversion: 2.1 time: 0.600658 Aug 25 13:23:56.951601 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2639/5207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:56 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1390 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:56.995282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:57.000678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:57.041285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:57.042042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:57.042899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:57.044296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:57.051990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:57.053235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:57.222248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:23:57.426296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:57.446526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5e227c8-815f-4892-b099-3b20982c1122 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 204 len: 0 microversion: 2.1 time: 0.458904 Aug 25 13:23:57.452213 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2640/5208] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:23:56 2022] DELETE /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:23:57.469690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9c887f4-0c24-4cc2-a5df-ff43987a6d69 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1273 microversion: 2.1 time: 0.604291 Aug 25 13:23:57.473769 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2569/5209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:56 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1273 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:23:57.484718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:57.490301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:57.509762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:57.511450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:57.512655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:57.514467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:57.515427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:57.516495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:58.349656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:23:58.396570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb4f89ed-b9ad-4411-9869-16cdfcca93b8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1396 microversion: 2.1 time: 0.937101 Aug 25 13:23:58.412660 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2641/5210] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:57 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1396 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:23:58.519297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:58.525226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:58.558895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:58.563241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:58.565912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:58.574999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:58.577321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:58.578737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:59.439325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:23:59.441807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:23:59.487185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:59.488523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:59.490673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:59.498651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:23:59.501350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:23:59.505056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:23:59.716820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:23:59.781553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:00.924150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:00.970792 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-edfa5f76-022d-422b-8775-fecffd90d2f7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 2.458818 Aug 25 13:24:00.976044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2570/5211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:58 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:01.311879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:01.346423 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2632f52f-4393-4abe-a8b3-1d9be55a64e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1396 microversion: 2.1 time: 1.913462 Aug 25 13:24:01.349118 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2642/5212] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:23:59 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1396 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:02.019973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:02.022013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:02.045735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.053436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.054643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:02.056901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.061610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.069807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:02.091663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=52 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:02.393978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:02.401383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:02.446187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:02.451677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.457062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.458472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:02.464401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:02.470401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:02.472599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:03.150943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:03.187063 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f67cb68-a207-4058-96ec-171a55e6c092 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1354 microversion: 2.1 time: 0.806062 Aug 25 13:24:03.204173 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2643/5213] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:02 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1354 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:03.207933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fd5af9-6851-43b5-bf96-a6b31755147d", "name": "network-vif-deleted", "tag": "0155754b-f9c4-450a-ac4c-318510551226"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:03.241309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:03.265600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:03.266880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:03.352802 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] Creating event network-vif-deleted:0155754b-f9c4-450a-ac4c-318510551226 for instance 38fd5af9-6851-43b5-bf96-a6b31755147d on n-h1-850468-18 Aug 25 13:24:03.380101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9946cab3-4816-4849-a011-9e019b8bf41f req-147e776f-efcd-456a-803a-ef168d15b3ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179031 Aug 25 13:24:03.382283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2644/5214] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:04.235206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:04.250644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:04.257450 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:24:04.267943 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:24:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d (ip 10.222.0.60) !!! Aug 25 13:24:04.283153 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:24:04.283762 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:24:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d (ip 10.222.0.60) !!! Aug 25 13:24:04.288752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:04.312965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.323693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.324989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.326785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:04.327851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:04.328844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:04.345839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c78c2e8-66b0-4e15-9232-ff5253681c7c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 2.324880 Aug 25 13:24:04.347653 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2571/5215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:02 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:04.474064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:04.810752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:04.842847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5fba0110-76f2-40bf-80b8-1110db946da9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.616015 Aug 25 13:24:04.845466 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2645/5216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:04 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:05.405692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:05.412469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:05.424544 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:24:05.424544 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 (ip 10.222.0.60) !!! Aug 25 13:24:05.445377 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:24:05.445642 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 (ip 10.222.0.60) !!! Aug 25 13:24:05.479728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53372d70-b9ad-4ee2-9907-fa3b6e886006", "tag": "206496ee-cd77-49bf-a04c-2aea8576d3ef"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:05.506466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.507564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.508795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:05.510249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.511157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.529693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:05.618675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.622279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.624370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:05.693461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] Creating event network-changed:206496ee-cd77-49bf-a04c-2aea8576d3ef for instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 on n-h1-850468-18 Aug 25 13:24:05.719032 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f96240c9-2b46-4938-8580-71a9abfd6b74 req-17862f11-c7aa-4603-b3df-e2815529f108 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236372 Aug 25 13:24:05.724152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2646/5217] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:24:05.893235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:05.895831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:05.909378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:05.935285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.945370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.946976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:05.948692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:05.949844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:05.950683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:06.329651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:06.354634 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c055643-3497-4e64-ade3-dfbdbb65a476 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 0.977726 Aug 25 13:24:06.366985 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2572/5218] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:05 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:06.413218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:06.441245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3383eecb-d017-4d91-9f9b-238b3be69806 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.561821 Aug 25 13:24:06.449522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2647/5219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:05 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:07.416174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:07.418752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:07.453317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:07.457824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.459388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.460992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.463731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.465664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.469369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.506207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:07.515055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:07.547442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.549008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.557003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.559179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:07.561267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:07.562664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:07.901087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:07.933527 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22af3d82-a050-40bc-ae4b-5273ac070d3e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.437652 Aug 25 13:24:07.950082 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2648/5220] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:07 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:08.114254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:08.160035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b92a77c7-28b9-4f2c-b2ae-a6417116fd04 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 0.753842 Aug 25 13:24:08.161569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2573/5221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:07 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:08.978331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:08.979494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:09.026837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.027647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.028473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:09.029843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.030682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.031450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:09.206764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:09.210429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:09.260767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.261812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.263258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:09.267528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:09.288131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:09.290090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:09.293404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:09.321338 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a090fd01-1a1f-4bc0-bb01-eec4a9ab12b4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.345914 Aug 25 13:24:09.324653 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2649/5222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:08 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:10.315809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:10.354265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-759fdeb2-f1ab-4dbf-994c-a99b882b422d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 1.158241 Aug 25 13:24:10.355959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2574/5223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:09 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:10.374384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:10.376539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:10.395906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:10.418549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:10.419930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:10.421997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:10.423338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:10.432584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:11.025140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:11.052544 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a565a052-75b3-4451-935d-2482a3ecae80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.689657 Aug 25 13:24:11.056182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2650/5224] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:10 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:11.397716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:11.402825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:11.445807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.450144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.454522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:11.460535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:11.464309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:11.469679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:12.105745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:12.109386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:12.136235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:12.145058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:12.146135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:12.151869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:12.152902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:12.153817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:13.116516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.151045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec5bafb7-99c8-43ad-8a53-c7fd86ca0f1a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 1.055381 Aug 25 13:24:13.165286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2651/5225] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:12 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:13.388428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:13.434268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e2538879-a63a-4ad1-b3af-08f0bd952b81 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 2.044278 Aug 25 13:24:13.456162 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2575/5226] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:11 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:14.199880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:14.202474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:14.248427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.251401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.253238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.254846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.255356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.256545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.496470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:14.503138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:14.537584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.540509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.545648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.547957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:14.552798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:14.557093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:14.771864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:14.797780 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f497cdb6-0a7f-4879-8504-69e6ed775e55 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.606145 Aug 25 13:24:14.812752 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2652/5227] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:14 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:15.871655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:15.897946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:15.940279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:15.951074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:15.960559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:15.964868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:15.967584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:15.968764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:16.022276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:16.070330 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-80d67ea1-1511-48b0-9c49-6b676b4971eb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 1.579636 Aug 25 13:24:16.076415 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2576/5228] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:14 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:16.251341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:16.293416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08fca1fd-35ea-4fb4-b1a5-ea6b34c79280 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 200 len: 1187 microversion: 2.1 time: 0.450043 Aug 25 13:24:16.310235 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2653/5229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:15 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 1187 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:17.120190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:17.123084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:17.169543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.170580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.174216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.178248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.181536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.183808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.355049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:17.357490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 38fd5af9-6851-43b5-bf96-a6b31755147d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:17.391188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.395863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.402212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.407870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:17.415788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:17.419500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:17.462869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d HTTP/1.1 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '38fd5af9-6851-43b5-bf96-a6b31755147d'} Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:24:17.467797 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. Aug 25 13:24:17.476263 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:24:17.480037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 38fd5af9-6851-43b5-bf96-a6b31755147d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:24:17.481938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8a0e74f-4f65-4ab3-b50d-2142f22fb9fe tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d" status: 404 len: 111 microversion: 2.1 time: 0.136345 Aug 25 13:24:17.483766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2654/5230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:17 2022] GET /compute/v2.1/servers/38fd5af9-6851-43b5-bf96-a6b31755147d => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:24:18.314851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53372d70-b9ad-4ee2-9907-fa3b6e886006", "name": "network-vif-plugged", "status": "completed", "tag": "206496ee-cd77-49bf-a04c-2aea8576d3ef"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:18.376557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:18.382751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:18.384886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:18.451263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] Creating event network-vif-plugged:206496ee-cd77-49bf-a04c-2aea8576d3ef for instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 on n-h1-850468-18 Aug 25 13:24:18.483266 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-701e91b2-7b51-4498-91aa-55ab02feed07 req-17dd55f9-0cba-4173-9113-e827d6dbbf48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.950686 Aug 25 13:24:18.488630 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2655/5231] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:20.104059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:20.164427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebba3616-9cf1-4de1-b648-a2ad79facb22 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 3.051315 Aug 25 13:24:20.166486 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2577/5232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:17 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 3057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:21.224134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:21.229233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:21.254331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.255278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.256098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:21.280793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:21.282230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:21.290820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:22.439576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:22.488243 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45de6c9a-5731-436c-9c71-975b6ab5d80f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1315 microversion: 2.1 time: 1.274880 Aug 25 13:24:22.492501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2656/5233] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:21 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:23.537076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:23.539958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:23.588941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:23.605490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:23.607374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:23.609225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:23.613445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:23.614807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:24.817803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:24.857396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b3f134d-d91d-47c5-87a2-a9877b9f3ada tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1501 microversion: 2.1 time: 1.332202 Aug 25 13:24:24.866035 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2578/5234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:23 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1501 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:24.914838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:24.916380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:24.943928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:24.948315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:24.949624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:24.957446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:24.958396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:24.959222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:25.782419 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.network.security_group_api [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Removing security group 5dd30b00-a6fd-45e7-a803-c19c50d2bb35 from port 206496ee-cd77-49bf-a04c-2aea8576d3ef Aug 25 13:24:31.762466 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b123d27-028a-4c80-aa19-2542edc35cbc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006/action" status: 202 len: 0 microversion: 2.1 time: 6.855389 Aug 25 13:24:31.765445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2657/5235] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:24:24 2022] POST /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006/action => generated 0 bytes in 6859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:24:31.784174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:31.787957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:31.885053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.893291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.911390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:31.921637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:31.924797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:31.934308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:32.192675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=51 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:33.066321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53372d70-b9ad-4ee2-9907-fa3b6e886006", "tag": "206496ee-cd77-49bf-a04c-2aea8576d3ef"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:33.190618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:33.197406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:33.201581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:33.281533 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] Creating event network-changed:206496ee-cd77-49bf-a04c-2aea8576d3ef for instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 on n-h1-850468-18 Aug 25 13:24:33.324049 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3c7589e9-beb5-4065-bced-a47ad456fc89 req-05f4e868-f6a7-472a-9834-5bd3419f4a1e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.451267 Aug 25 13:24:33.336847 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2658/5236] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:24:34.532668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:34.578082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-555bc7e9-91f5-42a5-9a8d-81d0d86d0dca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1459 microversion: 2.1 time: 2.806121 Aug 25 13:24:34.584715 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2579/5237] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:31 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1459 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:34.660442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:34.662479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:34.707025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:34.708001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:34.708870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:34.710367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:34.711091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:34.712043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:34.797785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=66 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:35.701359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:35.729554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc505bda-ad62-4633-a035-4ac3d9ab64ab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.099008 Aug 25 13:24:35.742017 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2659/5238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:34 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:35.803012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:35.804408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:35.828911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:35.833838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:35.835290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:35.844448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:35.846034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:35.847351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:37.040766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2038218882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a16e5aa3-c975-401a-8aaf-e5a94c20cab8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:37.082017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=26 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:37.155180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:37.180511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf781c32-112e-4837-9b19-738ced78fc05 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.385604 Aug 25 13:24:37.189470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2580/5239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:35 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:37.233065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:37.235374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:37.257188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:24:37.257563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:37.259450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:37.260428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:37.261834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:37.263027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:37.263788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:38.931030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:38.955692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb5cd19a-aa68-472c-909b-9f60b431aed3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.731910 Aug 25 13:24:38.957638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2581/5240] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:37 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:39.025875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:39.031938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:39.045691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:39.075162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.090657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.104026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:39.108096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:39.113219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:39.114509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:40.059724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:40.134239 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b8ad93a-1e67-49f6-9b8c-9802b562c6e1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.102098 Aug 25 13:24:40.134239 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2582/5241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:39 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:40.469050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2080496448", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "723617c5-71c1-48f0-b95e-eb7a1111c402"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:24:40.672341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] validate_networks() for [('723617c5-71c1-48f0-b95e-eb7a1111c402', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:24:41.005258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:41.007419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:41.009347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:41.010360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:41.011113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:41.075642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.077833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.081009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.084502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:41.090749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:41.091523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:41.210426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:41.229027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:41.447995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:41.454512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a16e5aa3-c975-401a-8aaf-e5a94c20cab8',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:41.902344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef1ad0ff-7390-4684-9cb8-f2decdf6f730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.874381 Aug 25 13:24:41.903630 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2660/5242] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:24:41.958728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d7018f40-d1e7-4c8c-addf-f8ea623fda2f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:41.960292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d7018f40-d1e7-4c8c-addf-f8ea623fda2f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:42.703617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d7018f40-d1e7-4c8c-addf-f8ea623fda2f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:42.736588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d7018f40-d1e7-4c8c-addf-f8ea623fda2f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1057 microversion: 2.1 time: 0.819183 Aug 25 13:24:42.738666 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2661/5243] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:41 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1057 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:42.824623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:24:42.825816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:24:42.828274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:24:42.830292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:24:42.832662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:24:42.870091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:42.873752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:42.875341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:42.877136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:42.911325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:42.915200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:43.038611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:24:43.080929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Getting quotas for user 49037c20b4264d9ca4942a62c83f52b4 and project 3f741d0b090d4d60b0b1c9370abff9eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:24:43.142197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:24:43.155026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:24:43.388873 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3cdce00-1a97-408e-8a01-6e038d72d6f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.927382 Aug 25 13:24:43.390402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2583/5244] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:24:43.414749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f7d482d-27d3-45ef-8436-6855cec2054c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:43.417613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f7d482d-27d3-45ef-8436-6855cec2054c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:43.794434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c03f3db3-4763-4522-8b03-9e670bd738e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:43.795865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c03f3db3-4763-4522-8b03-9e670bd738e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:44.023206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f7d482d-27d3-45ef-8436-6855cec2054c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:44.059601 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f7d482d-27d3-45ef-8436-6855cec2054c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1215 microversion: 2.1 time: 0.654601 Aug 25 13:24:44.079266 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2662/5245] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:43 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1215 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:44.140515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c03f3db3-4763-4522-8b03-9e670bd738e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:44.245668 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c03f3db3-4763-4522-8b03-9e670bd738e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1057 microversion: 2.1 time: 0.472984 Aug 25 13:24:44.249757 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2584/5246] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:43 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1057 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:45.115652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-beb66d8c-377a-4554-a923-e3e874bffed1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:45.123724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-beb66d8c-377a-4554-a923-e3e874bffed1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:45.300719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:45.302687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:45.322293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.324329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.325972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:45.328235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:45.329398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:45.330412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:45.644399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:45.669347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d38eab33-9e4a-4c58-8382-529d7af8d929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1155 microversion: 2.1 time: 0.380887 Aug 25 13:24:45.670484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2585/5247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:45 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1155 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:45.681887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-beb66d8c-377a-4554-a923-e3e874bffed1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:45.719334 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-beb66d8c-377a-4554-a923-e3e874bffed1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1215 microversion: 2.1 time: 0.609729 Aug 25 13:24:45.722135 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2663/5248] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:45 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1215 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:46.713492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:46.733597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:46.761459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:46.767512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:46.768569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:46.770444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:46.775229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:46.778038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:46.786055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:46.787487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:46.817302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:46.824794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:46.825617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:46.827474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:46.834758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:46.835585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:47.717522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:47.765213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2533c153-5a92-4248-a7d8-fb827b6801f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1267 microversion: 2.1 time: 1.003957 Aug 25 13:24:47.769231 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2664/5249] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:46 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1267 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:48.193140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:48.229831 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1cd7d942-00ec-4752-a807-8f930a21b859 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1173 microversion: 2.1 time: 1.523805 Aug 25 13:24:48.249989 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2586/5250] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:46 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1173 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:48.813383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:48.816007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:48.836677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.845489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.846895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:48.848754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:48.861468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:48.862785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:49.293615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:49.299589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:49.329441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:49.333495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:49.335284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:49.339079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:49.344680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:49.345359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:49.539546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:49.585209 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1dafabaa-7474-4de0-adb4-cc874f461be5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1273 microversion: 2.1 time: 0.783214 Aug 25 13:24:49.587294 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2665/5251] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:48 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1273 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:49.684528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:49.735786 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9dc374a9-62bc-40f3-ad6e-a1765f94f7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1173 microversion: 2.1 time: 0.451050 Aug 25 13:24:49.764690 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2587/5252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:49 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1173 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:50.637943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:50.642121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:50.679381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.683591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.693334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:50.696722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.698465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.699464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:50.798527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:50.799767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:50.847575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.852196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.855078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:50.857534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:50.864412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:50.865592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:51.144817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:51.558498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:51.590185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a9a9099c-f6f7-48a7-a323-ed8d178bd9e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1273 microversion: 2.1 time: 0.967102 Aug 25 13:24:51.604805 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2666/5253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:50 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1273 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:51.636001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:51.666882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-06095e2a-9651-4452-9a70-2d98fd698428 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1173 microversion: 2.1 time: 0.873812 Aug 25 13:24:51.667969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2588/5254] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:50 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1173 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:52.643991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:52.654233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:52.675836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.679106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.684977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.686491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.687347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.688169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.711387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:52.729590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:52.757020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.758462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.765574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.767067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:52.767967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:52.785173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:52.965595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:53.278599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:53.299793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d2a3b26b-7b24-4cdb-944c-0fd11ff50ca1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1273 microversion: 2.1 time: 0.675299 Aug 25 13:24:53.327533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2667/5255] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:52 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1273 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:53.529693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:53.587132 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53d32ef3-5421-4b53-be21-616c278b1c9d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1173 microversion: 2.1 time: 0.877831 Aug 25 13:24:53.608491 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2589/5256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:52 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1173 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:54.370884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:54.373393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:54.388864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.400207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.401724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:54.403693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.405147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.406442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:54.643170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:54.667898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:54.669281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:54.713102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.714450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.715490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:54.717186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:54.725856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:54.726717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:55.702788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:24:55.824615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:55.902437 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ed4ef1d-ff4e-408e-b6e1-b231dbbc046d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1173 microversion: 2.1 time: 1.261427 Aug 25 13:24:55.904875 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2590/5257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:54 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1173 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:24:56.934734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:56.957772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:56.965322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:56.994399 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f0af08b9-292a-4d69-8cf4-aee0490b6e54 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 2.633563 Aug 25 13:24:57.017564 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2668/5258] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:54 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:24:57.024821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:57.025976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:57.026746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:57.034743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:57.035815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:57.043143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:58.045209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:24:58.047745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:24:58.089908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:58.091574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:58.094365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:58.099605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:24:58.102274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:24:58.105936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:24:59.037833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:24:59.081368 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a1e34650-8ead-46a2-a58d-12670eb6f0e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1215 microversion: 2.1 time: 2.132928 Aug 25 13:24:59.092410 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2591/5259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:56 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1215 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:00.131790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:00.140320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:00.174906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:00.182486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:00.186811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:00.191821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:00.196014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:00.200645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:01.998494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:02.056692 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9e79e9d-a0c3-4109-8e62-5ebb144ca6b6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 4.019241 Aug 25 13:25:02.075153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2669/5260] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:24:58 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 4039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:03.173942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:03.177135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:03.234456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.235603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.239158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:03.246322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:03.249468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:03.252166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:04.936635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:04.940556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=69 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:05.006679 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e3e2a12-05e3-48ed-86f1-94d6a99970d4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1215 microversion: 2.1 time: 4.881843 Aug 25 13:25:05.009229 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2592/5261] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:00 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1215 bytes in 4886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:06.050031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:06.051120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:06.095052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:06.100172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:06.101643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:06.105626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:06.112450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:06.114853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:06.194065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:06.218478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=48 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:06.229226 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-26cdc56d-6c69-4f08-b033-a1989f93da29 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 3.085451 Aug 25 13:25:06.233953 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2670/5262] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:03 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 3107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:07.284038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:07.285908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:07.294268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:07.341027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:07.343874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:07.360996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:07.364810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:07.365840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:07.368965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:09.791206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:09.829342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53a9de64-c86f-4480-b3e5-ae18b8f7f83d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1215 microversion: 2.1 time: 3.785001 Aug 25 13:25:09.845132 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2593/5263] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:06 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1215 bytes in 3802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:09.878618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a43f6a-4a73-4fb2-bf05-d4d766c052ab", "tag": "3caf6b33-732a-41fb-bf5a-5dd78f31a6ae"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:09.894833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:09.912473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:09.914663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:09.915964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:09.940744 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] Creating event network-changed:3caf6b33-732a-41fb-bf5a-5dd78f31a6ae for instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab on n-h1-850468-18 Aug 25 13:25:09.962249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b6538e22-3135-47ae-932b-acd9d81f0ccc req-5a742bd6-293d-4f6c-92bf-13d437729d3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113251 Aug 25 13:25:09.964306 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2594/5264] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:10.046959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:10.103690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1f026ed-a3b8-437a-9bc5-5c82453c18f4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 2.824827 Aug 25 13:25:10.105222 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2671/5265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:07 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 2830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:10.915913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:10.920212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:10.937446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:10.938439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:10.940301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:10.942515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:10.946784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:10.948069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:11.153593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:11.154710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:11.184771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.189608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.196164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:11.212806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:11.213836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:11.214590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:12.998397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:13.035816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ba1b62c-3ec0-4994-9b0b-d13df006df28 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 1.882432 Aug 25 13:25:13.037366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2672/5266] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:11 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:13.065085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6573baea-c037-401b-b1f7-558b1d783eff", "tag": "4e820e64-8d3f-4645-9d40-160af7bac125"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:13.111131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:13.113156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:13.114141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:13.136341 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] Creating event network-changed:4e820e64-8d3f-4645-9d40-160af7bac125 for instance 6573baea-c037-401b-b1f7-558b1d783eff on n-h1-850468-18 Aug 25 13:25:13.145388 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f300d006-35ed-4523-b3c7-e0253c83064d req-4b5ea82e-cf9c-4a86-999f-0d576a45a804 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100760 Aug 25 13:25:13.147586 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2673/5267] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:14.059708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:14.090835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:14.093398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:14.093645 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9fd3f58f-af19-4d96-b0a9-5afb1583b320 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 3.212126 Aug 25 13:25:14.095125 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2595/5268] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:10 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:14.123493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:14.128705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:14.129726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:14.131116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:14.132040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:14.141050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:14.984524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:15.013513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2d532c3-6333-418e-a4e5-7044ae4c0b8a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 0.948875 Aug 25 13:25:15.020923 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2674/5269] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:14 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:15.141374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:15.143886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:15.180938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.182332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.183352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:15.184987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:15.193516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:15.195933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:15.724477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:15.744915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f308231-b901-4232-8616-257831368a88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 0.613826 Aug 25 13:25:15.763436 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2596/5270] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:15 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:16.061280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:16.062547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:16.090435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.090791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.091516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.097655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.099766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.102210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.794091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:16.809742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:16.839142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.841275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.842516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.855947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:16.857168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:16.857988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:16.984294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:17.000492 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a2e02446-4ea1-4874-9e9c-52d8ed07e72e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 0.948320 Aug 25 13:25:17.027997 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2675/5271] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:16 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:17.856866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:17.909130 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-902e177d-7682-49fc-b684-490576df7cec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.124273 Aug 25 13:25:17.917323 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2597/5272] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:16 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:18.044749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:18.049563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:18.091266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:18.092274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:18.093136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:18.094526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:18.095402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:18.096250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:18.957848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:18.960414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:18.964890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:18.988009 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-489e3ad0-61aa-42ad-9508-1d198a7a8679 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 0.956575 Aug 25 13:25:18.991810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:19.003332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:19.004916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:19.006768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:19.009020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:19.017312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:19.017970 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2676/5273] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:18 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:20.044180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:20.046704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:20.062813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.064146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.065247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.066892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:20.068068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:20.071162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:20.246385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:20.284535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-adbcb9e8-8104-4098-ad5f-f84470e710ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.322544 Aug 25 13:25:20.285902 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2598/5274] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:18 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:21.327593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:21.329653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:21.331014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:21.353563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:21.365652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:21.365995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34ecc5b3-61e4-42ea-bf73-c1c567a00573 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 1.344091 Aug 25 13:25:21.368587 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2677/5275] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:20 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:21.369948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:21.372309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:21.372564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:21.373249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:22.414829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:22.422336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:22.463332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.467800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.469188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:22.477577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:22.479248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:22.480410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:23.071669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:23.118211 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8abe191d-b173-49ef-9200-ee57032b0202 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.798022 Aug 25 13:25:23.125269 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2599/5276] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:21 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:24.002932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:24.029937 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbdbca98-7e02-459e-a054-a0317451807b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 1.625029 Aug 25 13:25:24.032856 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2678/5277] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:22 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:24.186264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:24.187308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:24.222263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.223186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.224035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:24.239242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:24.240183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:24.241029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:25.079868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:25.087927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:25.111985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:25.113215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:25.114154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:25.116191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:25.117538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:25.118756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:25.212238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:25.271473 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ce80299-adad-456a-9b6b-a841cef72d10 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.109960 Aug 25 13:25:25.279755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2600/5278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:24 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:25.745814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:25.798153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-581d398b-723b-4b6e-8446-4834c1b9bcba tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 0.726712 Aug 25 13:25:25.802129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2679/5279] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:25 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:26.324036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:26.325272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:26.350216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.354701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.364730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.365897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.366796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.367682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.829285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:26.843952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:26.846174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:26.855453 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-219d68ef-8ecd-4eaa-9363-0872d486bd20 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 0.540180 Aug 25 13:25:26.856086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2601/5280] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:26 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:26.879137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.880268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.881237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:26.885976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:26.887465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:26.888453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:27.497657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:27.529956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf4c7f20-d271-41c1-bf5c-c82d2d3b474e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 0.694250 Aug 25 13:25:27.544161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2680/5281] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:26 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:27.899107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:27.904104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:27.932755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:27.934239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:27.936339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:27.938344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:27.940259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:27.941634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:28.591246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:28.592429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:28.641377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:28.645346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:28.648064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:28.652996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:28.660588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:28.661910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:28.947438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:28.979908 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-46d64f78-50aa-4722-9d40-430a5676728f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.089915 Aug 25 13:25:28.980970 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2602/5282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:27 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:28.996785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a43f6a-4a73-4fb2-bf05-d4d766c052ab", "name": "network-vif-plugged", "status": "completed", "tag": "3caf6b33-732a-41fb-bf5a-5dd78f31a6ae"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:29.020763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:29.021653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:29.022926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:29.065824 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] Creating event network-vif-plugged:3caf6b33-732a-41fb-bf5a-5dd78f31a6ae for instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab on n-h1-850468-18 Aug 25 13:25:29.089196 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-82039601-336b-4734-ab53-e20981e8924e req-94d6254e-e59b-4155-9048-4e54168eee7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105823 Aug 25 13:25:29.090850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2603/5283] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:30.028228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:30.044388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:30.079301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:30.080735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:30.095718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:30.097698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:30.098965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:30.100210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:30.938766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:30.983786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dfef23ea-d575-4ff7-8ca0-a5b3b04ed51c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 2.411137 Aug 25 13:25:30.986068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2681/5284] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:28 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:31.725463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:31.775078 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3393690f-aae7-4ec5-870e-8f6a6495f1ac tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.755718 Aug 25 13:25:31.778768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2604/5285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:30 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:32.035935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:32.040177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:32.097962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:32.104096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:32.110714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:32.118469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:32.124745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:32.130069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:32.817309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:32.822830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:32.885467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:32.890091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:32.892541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:32.894816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:32.897292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:32.898657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:33.637331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:33.668523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8640338f-c206-4e25-b74d-87e0eeb9ad15 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1315 microversion: 2.1 time: 1.642235 Aug 25 13:25:33.715622 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2682/5286] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:32 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1315 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:33.847877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:33.898867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64fcbd79-ad75-48fd-b40c-b44a8baef69c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.078756 Aug 25 13:25:33.919058 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2605/5287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:32 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:34.623516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6573baea-c037-401b-b1f7-558b1d783eff", "name": "network-vif-plugged", "status": "completed", "tag": "4e820e64-8d3f-4645-9d40-160af7bac125"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:34.699086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:34.703692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:34.704685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:34.729257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:34.731529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:34.759006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] Creating event network-vif-plugged:4e820e64-8d3f-4645-9d40-160af7bac125 for instance 6573baea-c037-401b-b1f7-558b1d783eff on n-h1-850468-18 Aug 25 13:25:34.763078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:34.763960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:34.764783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:34.766110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:34.766839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:34.767582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:34.770375 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-adf86055-3e8c-44a6-91f7-b5bf6bdf3f1b req-5b645254-e020-47b6-9e85-6d62c3e1a7b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157130 Aug 25 13:25:34.772317 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2683/5288] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:34.946219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:34.955888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:34.980368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:34.986706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:34.987758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:34.988992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:34.999479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:35.000834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.047362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:36.052466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=76 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:36.093454 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-186f0ce6-92e2-427a-8143-9f63f01a107e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1501 microversion: 2.1 time: 1.377202 Aug 25 13:25:36.116515 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2606/5289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:34 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1501 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:36.155734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:36.156856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:36.174675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.175686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.176362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.178261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.180053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.181282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.407038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:36.449184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b3df2f1c-aff9-471e-b328-0b9427f793b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1203 microversion: 2.1 time: 1.508775 Aug 25 13:25:36.450675 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2684/5290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:34 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1203 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:36.471034 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea2cf5b4-f8d2-4df7-a877-936c691673fd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab/action" status: 202 len: 0 microversion: 2.1 time: 0.335527 Aug 25 13:25:36.485606 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2607/5291] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:25:36 2022] POST /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:25:36.517853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:36.521554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:36.559447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.562223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.564966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:36.567429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:36.569402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:36.571418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:37.544731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:37.550817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:37.582281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:37.588276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:37.588276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:37.588276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:37.592363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:37.602980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:38.677153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:38.682095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=82 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:38.707778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7b1db3c3-51b2-40bb-8d10-859d180ebb85 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1506 microversion: 2.1 time: 2.200886 Aug 25 13:25:38.730941 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2685/5292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:36 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1506 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:39.603882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:39.669246 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73e48ac4-66ef-481f-a52a-8b7d3513fb92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1390 microversion: 2.1 time: 2.166406 Aug 25 13:25:39.673488 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2608/5293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:37 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1390 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:39.708004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:39.709362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:39.713791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:39.746726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:39.749822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:39.775716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.776012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.784945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.786394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.788813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.793303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.793585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.794123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.795325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:39.795535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:39.796361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:39.811657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:42.391436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:42.412730 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc508370-2a56-4d6d-b3e4-ccd71bd6d6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1390 microversion: 2.1 time: 2.710518 Aug 25 13:25:42.415341 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2686/5294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:39 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1390 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:42.472047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:42.473266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:42.487393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:42.501555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:42.502378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:42.504215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:42.505486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:42.506034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:42.506827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:42.510494 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c63a3b19-1d36-4635-afef-8d9174931e99 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1486 microversion: 2.1 time: 2.773814 Aug 25 13:25:42.516661 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2609/5295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:39 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1486 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:42.547401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:42.548103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:42.550882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=32 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:25:42.593378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:42.600488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:42.602243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:42.605262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:42.611521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:42.612187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:42.699340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lazy-loading 'flavor' on Instance uuid 80a43f6a-4a73-4fb2-bf05-d4d766c052ab {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:25:43.436412 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ba85b1c8-7d25-4032-a5b5-6204d77e36f9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab/action" status: 202 len: 0 microversion: 2.1 time: 0.889730 Aug 25 13:25:43.439614 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2610/5296] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:25:42 2022] POST /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab/action => generated 0 bytes in 900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:25:43.470364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:43.472426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:43.506379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.507741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.508392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.509371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.510126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.511358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.753263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:43.784360 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73ed188f-c259-4e92-8330-d524a8806223 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1390 microversion: 2.1 time: 1.330265 Aug 25 13:25:43.804925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2687/5297] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:42 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1390 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:43.841024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:43.842680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:43.865743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.869491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.876658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.878941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:43.880059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:43.881419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:43.994098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:25:44.277591 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b94b362-5a0d-4692-8637-1590a39f2370 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 204 len: 0 microversion: 2.1 time: 0.457541 Aug 25 13:25:44.280049 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2688/5298] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:25:43 2022] DELETE /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:25:44.299493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:44.301871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:44.321255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:44.322153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:44.322968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:44.324586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:44.325598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:44.329847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:45.209488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:45.285414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f56999df-ff8f-4e3d-8919-b7a4bcd467c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1492 microversion: 2.1 time: 1.828791 Aug 25 13:25:45.291808 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2611/5299] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:43 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1492 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:45.762743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:45.796831 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6047d3cf-8f6e-40ff-9707-9c6d3ca34ae1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1396 microversion: 2.1 time: 1.508095 Aug 25 13:25:45.797925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2689/5300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:44 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1396 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:46.337533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:46.338749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:46.381509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.382590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.384287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:46.385738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.393055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.394797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:46.846273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:46.850830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:46.885327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.886252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.887065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:46.888504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:46.889409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:46.897092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:48.802983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:48.821640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:48.846441 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b1c90c8-eb77-4bbd-8b65-0f12c47674e4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1396 microversion: 2.1 time: 2.003520 Aug 25 13:25:48.848944 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2690/5301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:46 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1396 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:48.890271 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f917153-ad9a-4a08-8e00-142be106610b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1513 microversion: 2.1 time: 2.563015 Aug 25 13:25:48.895003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2612/5302] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:46 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1513 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:49.043084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6573baea-c037-401b-b1f7-558b1d783eff", "name": "network-vif-deleted", "tag": "4e820e64-8d3f-4645-9d40-160af7bac125"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:25:49.076902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:49.079795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:49.081085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:49.144392 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] Creating event network-vif-deleted:4e820e64-8d3f-4645-9d40-160af7bac125 for instance 6573baea-c037-401b-b1f7-558b1d783eff on n-h1-850468-18 Aug 25 13:25:49.163416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a445138a-582e-4746-9601-fd983b627471 req-30b74703-87be-4147-a02f-44959c67e735 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126899 Aug 25 13:25:49.168594 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2691/5303] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:25:49.903523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:49.915901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:49.954922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:49.956427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:49.957984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:49.959100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:49.964395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:49.966402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:49.967963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:49.971635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:49.990969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:50.003335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:50.010181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:50.014392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:50.021729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:50.029189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:52.000476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:52.058692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-647a92cc-6e0d-4cb1-8fb0-07c2612e6a2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 2.165225 Aug 25 13:25:52.064939 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2613/5304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:49 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:52.677205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:52.732051 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5cc699c-898f-42f9-9a30-eb214794af13 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1513 microversion: 2.1 time: 2.798144 Aug 25 13:25:52.747892 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2692/5305] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:49 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1513 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:53.106491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:53.120909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:53.218545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.220091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.229998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.236912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.243597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.249032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.786674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:53.787881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:53.842509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.843578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.844370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.845810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:53.846734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:53.847515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:53.850110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:53.896066 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-442ab350-a624-45e8-b69d-1c99a58ab9ad tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.797852 Aug 25 13:25:53.901843 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2614/5306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:53 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:54.949730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:54.956231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:55.001477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:55.003051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:55.008645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:55.012473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:55.014713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:55.015855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:55.371382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:55.417139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:55.421569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a2370a0-538f-4dcd-8f94-c6115c947728 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.641860 Aug 25 13:25:55.438802 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2693/5307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:53 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:25:55.471327 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02ac6a3c-319f-4a88-b6d8-a4b1ca232e77 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.529490 Aug 25 13:25:55.476890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2615/5308] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:54 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:56.471556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:56.472353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:56.516492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.519655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.524150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.529403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:56.535364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:56.538873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.545293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.546690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.568618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.571710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.573598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.575030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:56.578503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:56.579307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:56.876780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:56.931785 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6bf6d75-7aa6-4d65-9885-8d9ee48ff730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.421833 Aug 25 13:25:56.954917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2616/5309] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:56 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:57.987030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:57.989386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:58.035384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:58.036734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:58.041905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:58.045504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:58.047220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:58.055358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:58.736934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:25:58.770408 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9c600b3-66e0-4dad-890a-3a0964a82aa4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.795515 Aug 25 13:25:58.788154 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2617/5310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:57 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:25:59.830027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:25:59.834939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:25:59.876537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:59.880470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:59.881105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:25:59.892420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:25:59.894745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:25:59.898996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:00.066904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:00.111061 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-588e0883-80ab-4dab-9d9e-e1a4eb3c16f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 3.644732 Aug 25 13:26:00.152724 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2694/5311] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:56 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 3687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:00.363829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:00.403217 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b27ceed6-8332-4b58-873a-73baa9c2ab56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.581753 Aug 25 13:26:00.420333 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2618/5312] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:25:59 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:00.730288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a43f6a-4a73-4fb2-bf05-d4d766c052ab", "name": "network-vif-plugged", "status": "completed", "tag": "3caf6b33-732a-41fb-bf5a-5dd78f31a6ae"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:00.792448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:00.793403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:00.794221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:00.927013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] Creating event network-vif-plugged:3caf6b33-732a-41fb-bf5a-5dd78f31a6ae for instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab on n-h1-850468-18 Aug 25 13:26:00.987763 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-03b11869-e2d0-4e5c-aa51-0d8c63ae2cd9 req-9d315b1f-6859-4637-96a3-d069b43f9ee5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265316 Aug 25 13:26:01.005656 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2695/5313] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:01.159461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:01.160704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:01.234535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.240302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.241676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.247206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.248525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.256937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.458173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:01.459519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:01.527720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.528816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.529594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:01.530374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:01.530859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:01.531305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:02.419755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:02.450281 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-242d0047-1b47-4696-856d-bb9fa3b98834 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 1.001414 Aug 25 13:26:02.452185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2696/5314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:01 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:03.492698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:03.493824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:03.534101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.535769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.536933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:03.539302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:03.540474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:03.544683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:04.692008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:04.734349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1458b98c-72a7-40e5-8e79-de596d47bc03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 1.248885 Aug 25 13:26:04.740515 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2697/5315] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:03 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:04.934950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:04.993455 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5327828c-f762-4a46-bbc0-92449365b5d6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 3.840796 Aug 25 13:26:04.996767 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2619/5316] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:01 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 3846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:05.780475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:05.785649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:05.825869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:05.840482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:05.846240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:05.853767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:05.865853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:05.867653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.056275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:06.058755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:06.109858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.114281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.121515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.128491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:06.134172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:06.138664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:06.250818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:06.481871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:06.517444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-33e8c63a-5275-4c7c-9d20-6f32f025e8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.743009 Aug 25 13:26:06.524947 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2698/5317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:05 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:07.091604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:07.142168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b262ba0c-6384-4384-83c1-de5a17c36e1b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.100596 Aug 25 13:26:07.145391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2620/5318] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:06 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:07.594747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:07.611829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:07.655997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:07.661793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:07.670810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:07.673370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:07.689555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:07.697106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:08.198254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:08.199538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:08.258149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:08.259018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:08.259829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:08.268435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:08.274859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:08.275974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:08.459719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:08.500711 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6152501-9264-4423-bd74-8e1e7f25eebf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.914021 Aug 25 13:26:08.503104 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2699/5319] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:07 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:09.554310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:09.555644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:09.666922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:09.668006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:09.684439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:09.686049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:09.686866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:09.687675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:09.703493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:09.714431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:09.767396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e4c35b1-ef86-4a5f-a1a2-f6c92b679b9b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.574852 Aug 25 13:26:09.774744 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2621/5320] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:08 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:10.137367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:10.186345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f4beed9-7302-42de-8029-eb32a549367c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1188 microversion: 2.1 time: 0.640659 Aug 25 13:26:10.227923 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2700/5321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:09 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1188 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:10.823861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:10.826913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:10.871330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:10.877217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:10.879136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:10.884891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:10.890105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:10.892683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:11.250529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:11.251700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:11.274713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:11.338523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:11.350084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:11.351048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:11.352421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:11.366464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:11.370778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:11.683090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:11.684817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:11.707195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:11.720620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lazy-loading 'fault' on Instance uuid 6573baea-c037-401b-b1f7-558b1d783eff {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:26:12.226978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:12.272022 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec5456cb-5f1a-4539-aa29-a4b1068ade60 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 200 len: 1147 microversion: 2.1 time: 1.030366 Aug 25 13:26:12.307326 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2701/5322] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:11 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 1147 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:13.009716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:13.065987 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a0282c9-ea6f-4b90-a876-3d19b6348327 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 2.247892 Aug 25 13:26:13.075954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2622/5323] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:10 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:13.319709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:13.322099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 6573baea-c037-401b-b1f7-558b1d783eff] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:13.365508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.375951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.377401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:13.379669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:13.383448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:13.385013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:13.477059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff HTTP/1.1 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6573baea-c037-401b-b1f7-558b1d783eff'} Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:26:13.489718 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 6573baea-c037-401b-b1f7-558b1d783eff could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:26:13.503679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c10b6e4-11e7-4cee-a4bb-b5fa9d9d048e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff" status: 404 len: 111 microversion: 2.1 time: 0.189532 Aug 25 13:26:13.510076 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2702/5324] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:13 2022] GET /compute/v2.1/servers/6573baea-c037-401b-b1f7-558b1d783eff => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:26:14.139353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:14.140719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:14.157640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:14.179416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:14.181792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:14.185926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:14.193588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:14.199448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:14.200788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:15.871284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:15.921487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a591903-907b-4d00-8c9c-d98724ac8ba4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.801338 Aug 25 13:26:15.934728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2623/5325] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:14 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:16.979397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:16.990696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:17.082560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:17.083564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:17.084715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:17.086260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:17.089688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:17.093083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:20.752646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:20.806197 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f0487b9-4aa9-4e60-bce0-01cb82ef06c8 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 3.834359 Aug 25 13:26:20.813012 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2703/5326] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:16 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 3843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:21.853807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:21.859419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:21.908744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.914123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.916750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:21.919184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:21.920779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:21.922235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:23.359446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:23.406785 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4565d3dc-3ac7-4538-92c6-6f3ea97b268c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.552684 Aug 25 13:26:23.407972 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2624/5327] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:21 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:24.460621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:24.461761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:24.514325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:24.521091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:24.525769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:24.531850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:24.536851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:24.538740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:27.142087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:27.185590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09b56774-e72a-4e06-affe-7aace51f3135 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 2.732783 Aug 25 13:26:27.191621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2704/5328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:24 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:28.242353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:28.245545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:28.289299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:28.289790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:28.297370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:28.304332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:28.312322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:28.314003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:29.443478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:29.517134 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a4d056a-c010-4660-9ff8-9f9b21abb76a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.280732 Aug 25 13:26:29.559861 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2625/5329] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:28 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:30.575206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:30.576606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:30.638244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:30.639623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:30.640553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:30.641931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:30.653609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:30.661629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:32.420246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:32.478389 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09b80eb4-2f1a-42dc-9e52-b8b42a639fb7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.912302 Aug 25 13:26:32.480385 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2705/5330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:30 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:33.535428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:33.538751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:33.570022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.580535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.584941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:33.588636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:33.602076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:33.604596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:35.962804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:36.003345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac12bb70-cad5-4e3b-a8cf-80206684b766 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 2.485244 Aug 25 13:26:36.016302 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2626/5331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:33 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:37.066470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:37.070983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:37.119109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.126057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.129078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:37.139318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:37.144037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:37.147393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:39.763447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:39.826401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f28788c6-e411-4c59-bc11-cfb6004a1a9d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 2.767737 Aug 25 13:26:39.842986 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2706/5332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:37 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:26:40.877655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:40.884355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:40.936230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:40.948962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:40.962910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:40.971516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:40.977317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:40.978067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:41.007755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=42 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:42.020944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:42.048771 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e380183-77ba-4063-9bb2-569ad6981fb6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.178298 Aug 25 13:26:42.057068 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2627/5333] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:40 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:43.100874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:43.104875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:43.139106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:43.165224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:43.166467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:43.167823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:43.169374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:43.170382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:43.171277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:43.311227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=40 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:44.974801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:45.019364 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b62880e4-bd5d-4da4-bfac-d84c394d7709 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.925707 Aug 25 13:26:45.030325 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2707/5334] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:43 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:46.067595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:46.071316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:46.121407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:26:46.132790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:46.141666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:46.142416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:46.158910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:46.159928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:46.160785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:47.335856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:47.473614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-537d8ec9-6a60-4435-ae59-5ce15d324111 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.413770 Aug 25 13:26:47.474670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2628/5335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:46 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:48.522564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:48.531199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:48.612143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:48.617250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:48.618442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:48.641427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:48.649017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:48.650313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:49.929990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:50.003464 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-968ba075-b616-4c4f-bacb-e7ec40ed59f1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 1.483032 Aug 25 13:26:50.011841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2708/5336] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:48 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:51.050304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:51.055449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:51.097710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:51.101774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:51.104452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:51.108540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:51.113019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:51.116259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:54.789129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:54.821861 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bed3fb71-e26c-4de5-bba8-50e46d030870 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1508 microversion: 2.1 time: 3.781633 Aug 25 13:26:54.835726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2629/5337] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:51 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1508 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:55.410522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a43f6a-4a73-4fb2-bf05-d4d766c052ab", "name": "network-vif-unplugged", "status": "completed", "tag": "3caf6b33-732a-41fb-bf5a-5dd78f31a6ae"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:26:55.515543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.516793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:55.522277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:55.578150 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] Creating event network-vif-unplugged:3caf6b33-732a-41fb-bf5a-5dd78f31a6ae for instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab on n-h1-850468-18 Aug 25 13:26:55.595437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-341d6aa7-2b2a-4496-b20d-5894a439d131 req-6052fefd-cf0b-4c9f-b24c-4c139b07292e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.215699 Aug 25 13:26:55.598692 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2709/5338] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:26:55.895281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:55.899469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:55.945242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.965210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:55.969458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:55.970893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:55.971789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:56.000839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:57.379105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:26:57.437869 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d434b1f-9957-4fe8-b656-1e599a17d23a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1505 microversion: 2.1 time: 1.560875 Aug 25 13:26:57.470603 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2630/5339] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:55 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1505 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:26:58.512623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:26:58.515516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:26:58.535165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:58.536627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:58.539784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:26:58.543553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:26:58.545319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:26:58.546487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:01.108845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:01.158243 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4804925-eaef-4ce6-9bbf-9ab4ddcf9368 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1505 microversion: 2.1 time: 2.670912 Aug 25 13:27:01.159357 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2710/5340] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:26:58 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1505 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:02.206383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:02.207481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:02.254155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:02.267882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.274410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:02.280036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:02.282810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:02.286968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:05.060489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:05.095982 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91c058aa-c649-4f17-88c0-68b76e1c82b5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1505 microversion: 2.1 time: 2.896810 Aug 25 13:27:05.103258 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2631/5341] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:02 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1505 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:06.148014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:06.159408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:06.205177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.213300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.214586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:06.216398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:06.217609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:06.232437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:08.355917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:08.400189 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-948b7a80-765e-4041-9d31-0d6836f71372 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 200 len: 1448 microversion: 2.1 time: 2.260175 Aug 25 13:27:08.406204 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2711/5342] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:06 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 1448 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:08.451303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:08.470005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:08.540446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.549099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.549942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:08.551387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:08.552335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:08.553887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.403787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:10.462244 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acdf8380-716c-4b69-8576-20c8649fefad tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.019855 Aug 25 13:27:10.468641 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2632/5343] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:08 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:10.559103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:10.575289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:10.627710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.641329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.653418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:10.655672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:10.660217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:10.681503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:13.000663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:13.060610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8eb297f2-1eb4-44c6-a1ae-e6a53d13da1f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.509472 Aug 25 13:27:13.078685 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2712/5344] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:10 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:13.106388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:13.107220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:13.165954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:13.185247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:13.186299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:13.186299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:13.188389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:13.201199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:13.399852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:15.367537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:15.398040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-227960f0-f6a2-4459-93a1-d31f7bc1ce2c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.299139 Aug 25 13:27:15.408393 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2633/5345] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:13 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:15.469330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:15.477526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:15.509403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:15.525369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.526453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.527296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.534762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:15.535682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:15.543500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:15.611687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:16.093002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:16.153567 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-69070e72-20b5-471a-923f-3fc1eacd11e9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.711180 Aug 25 13:27:16.166088 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2713/5346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:15 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:16.205759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:16.223972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:16.229136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:16.230735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:16.232094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:17.172034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Going to try to stop instance {{(pid=122700) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 13:27:17.379327 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d083cbf5-b4ff-471b-a8b9-8d6173eaf3d4 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 1.181413 Aug 25 13:27:17.388610 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2634/5347] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:16 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:27:17.406684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:17.414882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:17.447016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:17.452354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:17.453771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:17.458424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:17.464347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:17.468950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:19.676173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:19.751629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4eb1bf4d-c321-4b2d-bfab-3a255b484f1a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 2.352916 Aug 25 13:27:19.753353 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2714/5348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:17 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 2360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:20.808172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:20.815838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:20.868333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.872266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.876270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:20.878116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:20.886529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:20.889251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:21.386198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:21.403035 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d62b59f8-8a23-4491-942b-1842169f5155 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 0.609972 Aug 25 13:27:21.413959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2635/5349] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:20 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:22.471821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:22.477835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:22.525648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.532135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.535887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:22.540908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:22.543812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:22.545309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:23.289404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:23.330362 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-caf36c32-3fab-46e8-bdd7-a419bf9187ca tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 0.862736 Aug 25 13:27:23.332506 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2715/5350] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:22 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:24.387227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:24.400530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:24.438280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.439226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.440099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:24.441549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:24.442423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:24.443221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:26.370797 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:27:26.371744 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c (ip 10.222.0.60) !!! Aug 25 13:27:26.661619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:26.712469 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-607b1b97-be03-4354-9f00-555bed82e5f0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 2.336074 Aug 25 13:27:26.730093 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2636/5351] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:24 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:27.769137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:27.777095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:27.789401 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:27:27.804062 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c (ip 10.222.0.60) !!! Aug 25 13:27:27.807229 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:27:27.807479 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c (ip 10.222.0.60) !!! Aug 25 13:27:27.886122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:27.905116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:27.906030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:27.917204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:27.918228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:27.919115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:28.833314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:28.861234 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-75e4f9f5-1013-42fb-9851-7785f75a5984 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1680 microversion: 2.1 time: 1.108269 Aug 25 13:27:28.884318 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2716/5352] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:27 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1680 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:29.909664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:29.917133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:29.969957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.979542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.980558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:29.985090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:29.986279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:29.989595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.685120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:30.718931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fcf18b16-9f0c-400b-9d59-5a128bc1f02d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1657 microversion: 2.1 time: 0.817537 Aug 25 13:27:30.727414 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2637/5353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:29 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1657 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:30.780529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:30.821141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:30.822439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:30.823533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:30.912557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Going to try to start instance {{(pid=122701) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 13:27:31.090649 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8c44bf5-c04d-4e6a-93c7-3c50f797e8c9 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.319139 Aug 25 13:27:31.094503 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2717/5354] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:30 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:27:31.115963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:31.120531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:31.154059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.159961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.162070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:31.168012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:31.170004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:31.173659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:33.054543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:33.085784 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76851458-e305-4d49-8e90-663f574b473b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1666 microversion: 2.1 time: 1.984370 Aug 25 13:27:33.093284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2638/5355] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:31 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1666 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:34.157836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:34.166950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:34.223398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:34.225283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:34.225786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:34.242248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:34.243270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:34.244145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:35.074224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:35.106106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84a0d71b-bd14-4337-84a1-ed5e064cd11e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1666 microversion: 2.1 time: 0.973430 Aug 25 13:27:35.108152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2718/5356] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:34 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1666 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:36.155794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:36.168952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:36.215181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.216668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.223102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:36.241261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:36.243037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:36.244401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:38.601250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:38.653304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-40e073b8-6735-4073-9676-5ba6b3b09435 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.489644 Aug 25 13:27:38.656799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2639/5357] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:36 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:38.712593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:38.715213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:38.759436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:38.762665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:38.769036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:38.771202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:38.772519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:38.775995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:40.074244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:40.119545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65df16b9-2e6d-45ac-a5f9-31dd01e4789b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.422335 Aug 25 13:27:40.125122 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2719/5358] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:38 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:40.180046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:40.189796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:40.228501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:40.243797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:40.245023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:40.248072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:40.253884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:40.253884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:42.310380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:42.392240 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa6424e2-7f14-41c5-a5ee-538fe9eed1cc tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 2.213127 Aug 25 13:27:42.398353 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2640/5359] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:40 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:42.440762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:42.445915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:42.477946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:42.479286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:42.481149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:42.484452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:42.487326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:42.502353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.273778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:44.324352 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9f1e776-4df6-479e-a1de-6cb70cdffaf6 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.886624 Aug 25 13:27:44.326012 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2720/5360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:42 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:44.370414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:44.371701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:44.420691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.421904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.429510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.431231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:44.432483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:44.433649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:44.454193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:45.087814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:45.123845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4cf1bc0f-37f6-49e9-8940-43a3e8fc9dab tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.760902 Aug 25 13:27:45.125784 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2641/5361] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:44 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:45.183980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:45.185196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:45.220605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.230996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.232727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.234898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.237264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.238422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.327150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lazy-loading 'flavor' on Instance uuid 75c053c9-b1a8-41a1-a5b3-d7354938e85c {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:27:45.651800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08accd2e-24d9-45a3-b8d6-9996bac1ec34 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.471134 Aug 25 13:27:45.654132 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2721/5362] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:45 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:27:45.668952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:45.671321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:45.715386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.741488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.744281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:45.749661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:45.753499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:45.757286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:46.532324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:46.563951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6f0cb21-6391-4a2c-a12c-85c4f6f9186c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1678 microversion: 2.1 time: 0.903822 Aug 25 13:27:46.577255 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2642/5363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:45 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1678 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:47.649424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:47.652686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:47.717815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:47.725207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:47.730597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:47.733512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:47.738804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:47.743724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:47.747543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:47.763825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:48.647536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:48.686519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e5a0ca94-34c8-43dd-9c89-18ca395c064f tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1661 microversion: 2.1 time: 1.075819 Aug 25 13:27:48.691950 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2722/5364] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:47 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1661 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:48.746138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:27:48.748372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:48.775059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:27:48.784164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:48.792222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:48.793110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:48.795218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:48.796149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:48.796984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.147032 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8fe057dc-5b2d-4315-a8dd-28733af4a9e5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action" status: 202 len: 0 microversion: 2.1 time: 0.417719 Aug 25 13:27:49.150377 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2643/5365] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:27:48 2022] POST /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:27:49.166494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:49.167549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:49.195727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.201317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.202148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:49.203490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:49.209515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:49.215845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:50.751794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:50.787571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-17188cac-b42c-4611-97b8-504f7026e7cd tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1667 microversion: 2.1 time: 1.629419 Aug 25 13:27:50.792810 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2723/5366] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:49 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1667 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:51.854576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:51.878543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:51.921960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:51.924528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:51.927264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:51.942176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:51.946493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:51.952055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:52.658112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:52.686016 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b294087-a5e0-4793-9936-9fa2e4bae7c0 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1667 microversion: 2.1 time: 0.858250 Aug 25 13:27:52.687614 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2644/5367] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:51 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1667 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:53.738902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:53.741563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:53.774554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.775760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.776724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:53.778060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:53.778908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:53.779685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:54.660809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:54.704657 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8a245b43-2ce6-4b92-957e-3da578be20fe tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 0.972718 Aug 25 13:27:54.708891 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2724/5368] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:53 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:27:54.759305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:54.761762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:54.800350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:54.801822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:54.803629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:54.806630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:54.807757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:54.808920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:56.575651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:27:56.648664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08596529-7737-4bcd-bfb0-ef132f47954a tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1670 microversion: 2.1 time: 1.907403 Aug 25 13:27:56.681324 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2645/5369] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:27:54 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1670 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:27:56.704436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:27:56.706722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:27:56.727126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:56.728245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:56.729015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:56.730022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:27:56.730784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:27:56.731394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:27:56.801015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:27:56.814469 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Working on deleting snapshot 049418c8-60ce-471f-b3f8-64f219b96b10 from shelved instance... Aug 25 13:28:00.228192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-404795566", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c6744318-8fa2-458d-8ec8-76657199a8db", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:00.315171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Doing local delete in cell caa1cbfc-061c-405c-b05c-317f7d63a7f7(cell1) {{(pid=122701) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 25 13:28:00.316827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:00.318081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:00.318827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:00.319465 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 25 13:28:00.342767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] deallocate_for_instance() {{(pid=122701) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 25 13:28:00.669658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:28:04.191293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Updating instance_info_cache with network_info: [] {{(pid=122701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:28:05.124602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:28:05.127597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:28:05.133988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:28:05.135913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:28:05.138748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:28:05.189358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.195597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.201410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.206206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.210850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.218203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.328454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:28:05.371982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:28:05.426324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:28:05.436091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c6744318-8fa2-458d-8ec8-76657199a8db',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:28:05.498051 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-410d59b4-5efb-476c-9854-48a55484357d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 204 len: 0 microversion: 2.1 time: 8.800689 Aug 25 13:28:05.500270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2725/5370] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:27:56 2022] DELETE /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 0 bytes in 8806 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:28:05.512247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a43f6a-4a73-4fb2-bf05-d4d766c052ab", "name": "network-vif-deleted", "tag": "3caf6b33-732a-41fb-bf5a-5dd78f31a6ae"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:05.579855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.582159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.586000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.643345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.server_external_events [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] Unable to find a host for instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab. Dropping event network-vif-deleted {{(pid=122701) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 13:28:05.645991 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cb0efb48-6bce-41ba-bb8b-9c2d7aaae877 req-bdac1a8e-d82f-4e46-af43-e3d7dc4b006f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.143193 Aug 25 13:28:05.647951 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2726/5371] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 146 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 13:28:05.668513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:05.669878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 80a43f6a-4a73-4fb2-bf05-d4d766c052ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:05.690119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.693042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.694198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.695870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.698087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.700253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.769146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab HTTP/1.1 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '80a43f6a-4a73-4fb2-bf05-d4d766c052ab'} Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:05.783772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. Aug 25 13:28:05.796571 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:05.806799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 404 to user: Instance 80a43f6a-4a73-4fb2-bf05-d4d766c052ab could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:05.812786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ebbc597d-6300-4b12-9211-abc6eae3acec tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab" status: 404 len: 111 microversion: 2.1 time: 0.160477 Aug 25 13:28:05.814729 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2727/5372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:05 2022] GET /compute/v2.1/servers/80a43f6a-4a73-4fb2-bf05-d4d766c052ab => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:05.842011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:05.848162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:05.891088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a1530ce-f0a8-406c-a077-e08a8c03c23e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.693616 Aug 25 13:28:05.891723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.892402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2646/5373] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:28:05.894428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.901652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.903750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:05.913138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:05.913984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:05.951427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a02c97d0-8777-4afb-ab6d-d1cd145cae2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:05.952712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a02c97d0-8777-4afb-ab6d-d1cd145cae2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:06.099860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:06.667990 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13b8ff8b-c415-4439-96f4-dcd3dee17e91 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 204 len: 0 microversion: 2.1 time: 0.844913 Aug 25 13:28:06.674912 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2728/5374] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:05 2022] DELETE /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:06.699501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:06.701682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:06.747997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.749453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.758684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:06.764260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:06.766485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:06.802652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:07.103063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a02c97d0-8777-4afb-ab6d-d1cd145cae2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:07.146389 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a02c97d0-8777-4afb-ab6d-d1cd145cae2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1056 microversion: 2.1 time: 1.225823 Aug 25 13:28:07.152010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2647/5375] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:05 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1056 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:07.373922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:07.396853 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-33a66af6-175f-4c95-bf74-6f0f40df5625 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1465 microversion: 2.1 time: 0.714050 Aug 25 13:28:07.398928 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2729/5376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:06 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1465 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:08.198249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:08.210024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:08.253605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:08.258203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:08.259767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:08.261876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:08.264455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:08.267790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:08.453522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:08.461058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:08.513805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:08.517003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:08.520929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:08.523874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:08.528704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:08.534687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:08.660777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:08.689665 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13b1e851-e4dd-4b7a-841f-98f3cec54c88 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1060 microversion: 2.1 time: 0.505183 Aug 25 13:28:08.696936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2648/5377] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:08 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1060 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:09.618709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:09.661968 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7558a84f-06f8-455c-acc3-e8b80a5a540c tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1465 microversion: 2.1 time: 1.221547 Aug 25 13:28:09.663153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2730/5378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:08 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1465 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:09.742952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:09.744216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:09.798838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:09.811956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:09.812956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:09.814241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:09.814893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:09.815670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:10.195033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:10.237583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-02dd0060-18ce-48bb-b6dd-e9c9e66455f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1116 microversion: 2.1 time: 0.501870 Aug 25 13:28:10.240473 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2649/5379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:09 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1116 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:10.706293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:10.712780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:10.736221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:10.737824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:10.739182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:10.741005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:10.742840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:10.743937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:11.194544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:11.226327 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7fb6d66-0d85-4920-b8ea-47a9d4d960a3 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1465 microversion: 2.1 time: 0.528933 Aug 25 13:28:11.235627 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2731/5380] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:10 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1465 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:11.284547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:11.287555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:11.320168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:11.324362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:11.325349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:11.331109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:11.332012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:11.332886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:11.836618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:11.893929 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f38bdad-dd19-4e1e-b9f5-116fa6084cf0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1126 microversion: 2.1 time: 0.611876 Aug 25 13:28:11.898382 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2650/5381] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:11 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1126 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:12.285212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:12.290903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:12.323371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.332267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.333415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.338976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.340019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.340852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.363427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:12.523674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53372d70-b9ad-4ee2-9907-fa3b6e886006", "name": "network-vif-deleted", "tag": "206496ee-cd77-49bf-a04c-2aea8576d3ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:12.578290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.579634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.580675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.653526 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] Creating event network-vif-deleted:206496ee-cd77-49bf-a04c-2aea8576d3ef for instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 on n-h1-850468-18 Aug 25 13:28:12.682573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d889aa32-b619-4ead-b534-4bc10d81638c req-84ef23e2-19ee-4cac-8154-02b7ecdec996 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165474 Aug 25 13:28:12.684086 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2651/5382] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:28:12.941852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:12.946018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:12.979320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.980280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.984807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:12.989917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:12.992594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:12.995094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:13.035969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:13.064239 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8dc40d4-a741-4a1c-9e3b-877d511940fb tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 200 len: 1465 microversion: 2.1 time: 0.793323 Aug 25 13:28:13.068831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2732/5383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:12 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 1465 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:13.314191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:13.355144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fe8594fa-92b0-4609-9fb4-e0739dab0853 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1126 microversion: 2.1 time: 0.419517 Aug 25 13:28:13.358864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2652/5384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:12 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1126 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:14.109932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:14.111439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 53372d70-b9ad-4ee2-9907-fa3b6e886006] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:14.136568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.137512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.139101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.144007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.145685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.146892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.190208 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 HTTP/1.1 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '53372d70-b9ad-4ee2-9907-fa3b6e886006'} Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:14.195897 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:14.209859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 404 to user: Instance 53372d70-b9ad-4ee2-9907-fa3b6e886006 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:14.214044 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41f08da6-11da-4b73-908f-b64170259a1d tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006" status: 404 len: 111 microversion: 2.1 time: 0.113199 Aug 25 13:28:14.216536 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2733/5385] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:14 2022] GET /compute/v2.1/servers/53372d70-b9ad-4ee2-9907-fa3b6e886006 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:14.242495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:14.248179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:14.311418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.312903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.323329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.340704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.342305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.343371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.399360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:14.400462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:14.437188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.448472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.449908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.451627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.460903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.462291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.462602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:14.682181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:14.799158 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3ec9e5c-a1ac-4aa6-b4ea-6f08a6803894 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 204 len: 0 microversion: 2.1 time: 0.573987 Aug 25 13:28:14.804256 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2653/5386] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:14 2022] DELETE /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:14.845975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:14.847347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:14.890477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.907240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.908426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:14.910122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:14.915306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:14.916180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:15.010257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:15.045155 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-91183b24-440e-4dbc-b528-5eb4e012e82c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1126 microversion: 2.1 time: 0.655208 Aug 25 13:28:15.077110 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2734/5387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:14 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1126 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:15.285715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:16.111613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:16.115688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:16.145435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:16.147295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:16.148107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:16.149500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:16.150363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:16.151139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:16.693982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:16.727901 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8628bb5-356d-40c0-885c-39c51eab6b0b tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1508 microversion: 2.1 time: 1.912425 Aug 25 13:28:16.734314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2654/5388] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:14 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1508 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:17.782345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:17.783369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:17.795836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:17.836997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:17.846744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:17.850733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:17.855763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:17.857143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:17.862228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:20.037709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:20.085948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ff30d386-104e-4048-baed-8adc0dbc865a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 3.980639 Aug 25 13:28:20.087920 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2735/5389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:16 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 3985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:20.987236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:21.041386 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ca7ba87-2e6f-4075-9809-fbe51fa4bd8e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1508 microversion: 2.1 time: 3.266654 Aug 25 13:28:21.049703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2655/5390] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:17 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1508 bytes in 3274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:21.138550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:21.139744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:21.185204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:21.200545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:21.201644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:21.202487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:21.203916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:21.225410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:21.226482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:21.979238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030802ec-1e33-4984-a893-eaca086a2e36", "name": "network-vif-deleted", "tag": "8b2294e0-0dd9-4130-907e-8e087dfccd23"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:22.059730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:22.075583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.081927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.082907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.160510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] Creating event network-vif-deleted:8b2294e0-0dd9-4130-907e-8e087dfccd23 for instance 030802ec-1e33-4984-a893-eaca086a2e36 on n-h1-850468-18 Aug 25 13:28:22.254673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-92490e26-6ef6-40fb-9e8e-6643194c5faf req-cea545e7-28b4-4659-b60c-58aec5e5eaf0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269152 Aug 25 13:28:22.260668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2656/5391] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:22.297635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:22.299704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:22.325144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.327028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.328590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.331221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.332698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.334747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.483406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:22.487442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:22.492267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:22.495908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lazy-loading 'fault' on Instance uuid 030802ec-1e33-4984-a893-eaca086a2e36 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:28:22.502731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:22.548891 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dbcd23fc-a326-4059-982a-3057df9e0035 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 1.422450 Aug 25 13:28:22.550366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2736/5392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:21 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:23.022093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:23.054060 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a89512f1-a7d2-4e14-9704-ad439471b2f5 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 200 len: 1305 microversion: 2.1 time: 0.791406 Aug 25 13:28:23.077414 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2657/5393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:22 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 1305 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:23.617424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:23.618611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:23.658615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:23.659458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:23.668420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:23.670055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:23.670947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:23.671738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.120094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:24.124499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 030802ec-1e33-4984-a893-eaca086a2e36] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:24.149029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.149961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:24.150811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.162128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.163445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:24.164515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.249865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 HTTP/1.1 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '030802ec-1e33-4984-a893-eaca086a2e36'} Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:24.264820 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. Aug 25 13:28:24.277376 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:28:24.284631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 404 to user: Instance 030802ec-1e33-4984-a893-eaca086a2e36 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:24.286553 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c9b9097-b4cd-4b16-a72e-af09b8c8a8c1 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36" status: 404 len: 111 microversion: 2.1 time: 0.173650 Aug 25 13:28:24.302649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2658/5394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:24 2022] GET /compute/v2.1/servers/030802ec-1e33-4984-a893-eaca086a2e36 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:24.313632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:24.331711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:24.378343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.380691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:24.382176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.384627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.385990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:24.397264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.503501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:24.921121 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-280c6852-b8b2-4064-95ed-65bafd1df676 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 204 len: 0 microversion: 2.1 time: 0.615458 Aug 25 13:28:24.923728 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2659/5395] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:24 2022] DELETE /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:24.964555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:24.965885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:24.990861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.998296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:24.998296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:24.998296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:24.998296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:25.012919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:28.189323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:28.225966 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-55a5b853-2742-4782-baca-23861953054e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1494 microversion: 2.1 time: 3.279286 Aug 25 13:28:28.231405 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2660/5396] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:24 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1494 bytes in 3287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:29.059343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1404d7-f108-483c-9136-972e912c78f7", "tag": "236fec74-d299-4626-99de-99210854dd7a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:29.101643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:29.157821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04e6ed06-7a23-4b0c-829f-6a10884f779c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 5.564420 Aug 25 13:28:29.165365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2737/5397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:23 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 5573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:29.166972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:29.168141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:29.169323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:29.250434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] Creating event network-changed:236fec74-d299-4626-99de-99210854dd7a for instance fe1404d7-f108-483c-9136-972e912c78f7 on n-h1-850468-18 Aug 25 13:28:29.265248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:29.272748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:29.302064 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9589d908-b05e-4714-a5e7-c82b60404705 req-603d22f1-11f7-4abd-8d3f-04001ed7429c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.065041 Aug 25 13:28:29.310535 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2661/5398] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:29.337031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:29.338530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:29.344295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:29.352283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:29.360934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:29.364828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:30.221970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:30.224042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:30.277154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:30.284968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:30.289639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:30.291561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:30.298444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:30.300842 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:32.858664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:32.933922 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3e27da4-c5f1-4ee0-a6ff-b0e4afa6b396 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1494 microversion: 2.1 time: 3.658700 Aug 25 13:28:32.947162 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2738/5399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:29 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1494 bytes in 3691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:32.988352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805cca72-e665-4604-9611-f03da19df693", "name": "network-vif-unplugged", "status": "completed", "tag": "63d1f987-cf7e-42bc-bfdb-67d86e3bfccd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:33.096607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:33.104908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:33.111330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:33.259005 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] Creating event network-vif-unplugged:63d1f987-cf7e-42bc-bfdb-67d86e3bfccd for instance 805cca72-e665-4604-9611-f03da19df693 on n-h1-850468-18 Aug 25 13:28:33.296409 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9f395e1d-d24d-486a-b15f-91c751881e2c req-cb6810ec-c3de-4886-96be-49000c655f6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.338444 Aug 25 13:28:33.302905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2739/5400] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:33.436933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:33.478078 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-07dc9a56-907c-49f3-bf3d-b8bfe384afda tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 3.277421 Aug 25 13:28:33.480976 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2662/5401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:30 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 3283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:33.995466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:33.996835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:34.046911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.047874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.061834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:34.072406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.073374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.076172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:34.584930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:34.587902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:34.646324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:34.683658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b042fe3-a498-4a64-b944-2fc3d5e772be tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1452 microversion: 2.1 time: 0.699847 Aug 25 13:28:34.688301 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2740/5402] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:33 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1452 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:34.728696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.768341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.769854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:34.776103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:34.785769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:34.795028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:35.759260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:35.784270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:35.843198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:35.844386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:35.850048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:35.851578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:35.852900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:35.854036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:37.491977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:37.524942 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fb69292-629e-4d5a-b8c9-735672b05271 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 2.986630 Aug 25 13:28:37.528259 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2663/5403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:34 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 2994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:37.543856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805cca72-e665-4604-9611-f03da19df693", "name": "network-vif-deleted", "tag": "63d1f987-cf7e-42bc-bfdb-67d86e3bfccd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:37.607644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:37.609347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:37.610648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:37.643286 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] Creating event network-vif-deleted:63d1f987-cf7e-42bc-bfdb-67d86e3bfccd for instance 805cca72-e665-4604-9611-f03da19df693 on n-h1-850468-18 Aug 25 13:28:37.666590 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-cb117146-242e-43e3-8c83-3c62cba8ee04 req-19d55200-db09-4f4f-add0-71b9c9e2278e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134105 Aug 25 13:28:37.668863 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2664/5404] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:37.992720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:38.035474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-51e444fd-20ce-4c2f-ba78-2295bf35460e tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 200 len: 1287 microversion: 2.1 time: 2.306117 Aug 25 13:28:38.039620 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2741/5405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:35 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 1287 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:38.568057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:38.580067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:38.641328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.646477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.649143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:38.652962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:38.657641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:38.659006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.084359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.086631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 805cca72-e665-4604-9611-f03da19df693] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.138528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.151456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.152312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.153475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.154664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.155444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.206194 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 HTTP/1.1 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '805cca72-e665-4604-9611-f03da19df693'} Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:39.214632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. Aug 25 13:28:39.224028 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:39.229395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 404 to user: Instance 805cca72-e665-4604-9611-f03da19df693 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:39.229395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3020fa39-f2b6-403d-b53f-657a55216576 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693" status: 404 len: 111 microversion: 2.1 time: 0.153111 Aug 25 13:28:39.236352 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2742/5406] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/805cca72-e665-4604-9611-f03da19df693 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:28:39.256497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.259672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.282732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.289405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.290986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.292670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.297390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.298521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.434263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:28:39.826380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-49599472-0d8b-4ea3-b131-12f3ee692acf tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 204 len: 0 microversion: 2.1 time: 0.586838 Aug 25 13:28:39.842414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2743/5407] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:28:39 2022] DELETE /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:28:39.873961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:39.880212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:39.917407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.918964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.921487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:39.927290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:39.935684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:39.937036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:40.117940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:40.176948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2172220-be5f-450c-996f-9c06f2061276 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 1.619004 Aug 25 13:28:40.182936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2665/5408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:38 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:41.234855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:41.242809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:41.294365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:41.299805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:41.304227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:41.311155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:41.312166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:41.312994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:42.955351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:42.983789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:43.006585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c7fd6c2-86d1-47a9-8d22-6c0aef063357 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1676 microversion: 2.1 time: 3.160632 Aug 25 13:28:43.016837 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2744/5409] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:39 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1676 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:44.056627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:44.057773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:44.160358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.161375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.162256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.182063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:44.184349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:44.185539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:44.725031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:44.797348 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31acd00a-ddb7-4531-819f-8a976387b0ed tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 3.567024 Aug 25 13:28:44.800772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2666/5410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:41 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 3580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:45.851626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:45.852933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:45.902187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:45.904559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:45.905522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.910002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:45.912907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:45.918150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:45.973360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:49.713782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:49.720210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:49.777965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-10e731ce-d311-4a3b-9721-51de6d3d1e73 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1676 microversion: 2.1 time: 5.712023 Aug 25 13:28:49.780100 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cafe4550-3ce8-40e5-b614-505d467600dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 3.927929 Aug 25 13:28:49.783725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2745/5411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:44 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1676 bytes in 5736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:49.813417 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2667/5412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:45 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 3975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:50.837084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:50.838160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:50.847177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:50.852077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:50.900266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.901479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.902368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.903713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.904554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.905321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.925328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.926261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.968006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:50.975014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:50.982286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:50.986310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.637518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49037c20b4264d9ca4942a62c83f52b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f741d0b090d4d60b0b1c9370abff9eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:51.676948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e9a1472-a9b8-44b1-bf24-ade46d752449 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 200 len: 1608 microversion: 2.1 time: 0.843535 Aug 25 13:28:51.682937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2746/5413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:50 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 1608 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:28:51.706609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c053c9-b1a8-41a1-a5b3-d7354938e85c", "name": "network-vif-deleted", "tag": "17d72b16-1cb6-49b0-8ff9-37e7a3656e13"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:28:51.753267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:51.792064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:51.793115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:51.794046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:51.886962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] Creating event network-vif-deleted:17d72b16-1cb6-49b0-8ff9-37e7a3656e13 for instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c on n-h1-850468-18 Aug 25 13:28:51.912918 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e692457e-815b-484d-82e4-0c13c1805615 req-fc32db96-cbc5-494c-a72b-a42455d11cb4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216362 Aug 25 13:28:51.921699 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2747/5414] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:28:52.025317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:52.066232 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ec2cca14-84cc-4bb2-b7e7-79306a65347d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 1.236905 Aug 25 13:28:52.069187 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2668/5415] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:50 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:52.743400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:52.749322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] [instance: 75c053c9-b1a8-41a1-a5b3-d7354938e85c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:52.782154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:52.783643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:52.784799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:52.787220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:52.788969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:52.790172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:52.862012 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] HTTP exception thrown: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Request method failure captured: Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c HTTP/1.1 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3VWiwOcY7eO_3OmHqf1KSvEmF7O_51NIiCzSBxxcvPSZYRGOCQlOUpaBIzCl_WaGKQ4jm21cB3acAvKO5Af6JSD8gIocGPEno5DFPn1qy8nezDvMubjuOpzj5NZJ20DONz5SNWJ32Rcgmf9J5urL4eqC6Fk165NA3PJxxifLVOIUC4 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3f741d0b090d4d60b0b1c9370abff9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 3f741d0b090d4d60b0b1c9370abff9eb Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-1795714182 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 49037c20b4264d9ca4942a62c83f52b4 Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-1795714182-project Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '75c053c9-b1a8-41a1-a5b3-d7354938e85c'} Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:28:52.871426 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. Aug 25 13:28:52.883904 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:28:52.893927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Returning 404 to user: Instance 75c053c9-b1a8-41a1-a5b3-d7354938e85c could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:28:52.898449 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41668bae-3e39-4c86-91b8-2b844c7db022 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c" status: 404 len: 111 microversion: 2.1 time: 0.163425 Aug 25 13:28:52.906235 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2748/5416] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:52 2022] GET /compute/v2.1/servers/75c053c9-b1a8-41a1-a5b3-d7354938e85c => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:28:52.922118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2cd586e1-0327-48f6-b3dc-c437ed33d5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] Calling method '.version_select at 0x7fc6c6bf2160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:52.990578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:28:53.039747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2cd586e1-0327-48f6-b3dc-c437ed33d5b7 tempest-ServerActionsTestJSON-1795714182 tempest-ServerActionsTestJSON-1795714182-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119530470" status: 202 len: 0 microversion: 2.1 time: 0.125566 Aug 25 13:28:53.041180 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2669/5417] 10.222.0.60 () {58 vars in 1218 bytes} [Thu Aug 25 13:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119530470 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:28:53.107393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:53.108481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:53.139103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:53.140628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:53.141892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:53.143631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:53.156093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:53.158350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:54.011745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:54.058877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e01ca9c-0d55-4144-906e-8d7e6010d278 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 0.957050 Aug 25 13:28:54.078297 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2749/5418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:53 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:55.137372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:55.144431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:55.200295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.203474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.208017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:55.209656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:55.210481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:55.211259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:56.711034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:56.738605 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-68c823bc-a00b-499d-acee-6365aed611bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 1.631373 Aug 25 13:28:56.760154 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2670/5419] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:55 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:57.792729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:57.796867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:57.825770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.838244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.841906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:57.849191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:57.853145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:57.854335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:58.633791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:28:58.665443 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc8625da-fccf-4981-836b-97ea055d393a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1168 microversion: 2.1 time: 0.883216 Aug 25 13:28:58.669565 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2750/5420] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:57 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1168 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:28:59.711115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:28:59.721049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:28:59.750570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:59.754207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:59.758269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:28:59.764654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:28:59.765968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:28:59.767127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:02.201297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:02.233090 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7793138-0b0f-4122-a6ec-abc8182c8f97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 2.530388 Aug 25 13:29:02.245214 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2671/5421] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:28:59 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:03.299390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:03.310520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:03.365027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:03.366232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:03.371661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:03.375768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:03.381593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:03.382691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:04.224969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:04.252296 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60e3d352-0a24-4706-8478-62b51e4d1b8e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 0.962813 Aug 25 13:29:04.260760 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2751/5422] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:03 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:05.306807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:05.309528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:05.330010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:05.331850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:05.336531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:05.338361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:05.340740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:05.342052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:06.421875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:06.459133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f639505-2693-4606-9d96-961e2a3565b0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 1.162384 Aug 25 13:29:06.460495 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2672/5423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:05 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:07.503606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:07.505269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:07.538135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:07.541247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:07.545620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:07.547694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:07.554141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:07.555356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:08.338409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:08.362703 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dbef1100-b262-4bde-aa64-27c3956c642f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 0.864969 Aug 25 13:29:08.365910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2752/5424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:07 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:09.406834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:09.407986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:09.435295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:09.438764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:09.439982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:09.442547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:09.444162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:09.445305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:10.103390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:10.128347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8c124725-9453-41eb-bb38-d5aac197d1da tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 0.728430 Aug 25 13:29:10.158923 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2673/5425] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:09 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:11.177090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:11.178807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:11.215184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:11.218245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:11.220923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:11.227274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:11.235341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:11.236498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:13.112838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:13.168729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9228ccf7-dca7-4c17-b102-3d600350c96f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 2.002572 Aug 25 13:29:13.176538 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2753/5426] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:11 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:14.230748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:14.258449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:14.282648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:14.284489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:14.286761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:14.288846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:14.290148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:14.291865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:15.982507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:16.035961 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56e16d8d-efeb-45b8-bb36-9f9bcb48bd09 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 1.818332 Aug 25 13:29:16.037322 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2674/5427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:14 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:16.353833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1404d7-f108-483c-9136-972e912c78f7", "name": "network-vif-plugged", "status": "completed", "tag": "236fec74-d299-4626-99de-99210854dd7a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:16.415405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:16.416995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:16.421117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:16.449641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=48 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:16.520995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] Creating event network-vif-plugged:236fec74-d299-4626-99de-99210854dd7a for instance fe1404d7-f108-483c-9136-972e912c78f7 on n-h1-850468-18 Aug 25 13:29:16.540268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ebd47361-ea2d-4d7f-8147-406a1a0d0e9f req-f7bfbcb2-664d-4a46-9763-481af83a4a71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203061 Aug 25 13:29:16.543220 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2754/5428] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:17.088975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:17.092242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:17.124794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:17.125781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:17.126614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:17.134200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:17.149769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:17.154905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:17.248533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=42 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:18.528519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:18.583400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e5fe3f2-8971-415f-8b80-7d42b0c68ff7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 1.499670 Aug 25 13:29:18.585730 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2675/5429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:17 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:19.647164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:19.649935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:19.689317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:19.690211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:19.699702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:19.711794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:19.712866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:19.720055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:21.062394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:21.095775 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18fdd202-481c-4158-944f-d051bac93730 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1202 microversion: 2.1 time: 1.471201 Aug 25 13:29:21.120193 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2755/5430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:19 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1202 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:22.162443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:22.163652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:22.197175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.197979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.198822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:22.205441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:22.206828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:22.208217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:23.846857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:23.892923 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3560a111-59f9-4802-ae6c-6a3c2bf24569 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1390 microversion: 2.1 time: 1.752161 Aug 25 13:29:23.893917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2676/5431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:22 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1390 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:23.946182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:23.947372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:24.009722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:24.013797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:24.023076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:24.024571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:24.026408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:24.052292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:24.054200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.763357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:26.795906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-66f79a87-0411-45b5-92a1-dbf135133a07 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1390 microversion: 2.1 time: 2.856740 Aug 25 13:29:26.812153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2756/5432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:23 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1390 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:26.842331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:26.849188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:26.861772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:26.867700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.868922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.881637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:26.886458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:26.897801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:26.899530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.126556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:28.171423 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a41036d-9470-4fc9-864a-876bbfc8f80e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1390 microversion: 2.1 time: 1.342560 Aug 25 13:29:28.183509 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2677/5433] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:26 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1390 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:28.468704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:28.470905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:28.496394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.497334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.498074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.500094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.500376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.501308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.587105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:29:28.866907 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-864d5941-26dd-4bf0-9134-797261c2d7f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 204 len: 0 microversion: 2.1 time: 0.410926 Aug 25 13:29:28.875539 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2757/5434] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:29:28 2022] DELETE /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:29:28.883361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:28.887977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:28.905413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.906286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.907098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:28.915467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:28.932389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:28.933427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:30.176577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:30.220427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbaa2d78-cbe5-4e51-904a-e9bb8d6dba12 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1396 microversion: 2.1 time: 1.344006 Aug 25 13:29:30.222079 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2678/5435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:28 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1396 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:31.282115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:31.294098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:31.330079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.334799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.336465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:31.340453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:31.342527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:31.378793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:32.235927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:32.266602 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a3066e2-3c39-4360-9208-73af4798b266 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1396 microversion: 2.1 time: 0.989833 Aug 25 13:29:32.269270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2758/5436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:31 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1396 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:33.317485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:33.322389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:33.369302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.373846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.382185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:33.390908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:33.395945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:33.397477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:34.697347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1404d7-f108-483c-9136-972e912c78f7", "name": "network-vif-unplugged", "status": "completed", "tag": "236fec74-d299-4626-99de-99210854dd7a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:34.720717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:34.721700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:34.723131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:34.748868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] Creating event network-vif-unplugged:236fec74-d299-4626-99de-99210854dd7a for instance fe1404d7-f108-483c-9136-972e912c78f7 on n-h1-850468-18 Aug 25 13:29:34.771763 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-43509b8d-5be2-43fb-9495-8e9607640507 req-e001c5ef-3321-440e-9d80-28f159eff3b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.328602 Aug 25 13:29:34.773829 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2759/5437] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:35.109335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:35.130198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7126c9c-3e86-450a-9b06-a097c655e4eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1396 microversion: 2.1 time: 1.824094 Aug 25 13:29:35.132268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2679/5438] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:33 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1396 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:36.204511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:36.210267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:36.239542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:36.251328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:36.252814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:36.274521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:36.281714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:36.282674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:36.800445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:36.839308 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a4428d2-7ca9-43d5-8eb1-0400e23e5360 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1354 microversion: 2.1 time: 0.671673 Aug 25 13:29:36.868236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2760/5439] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:36 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1354 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:37.909560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:37.912515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:37.943863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.952080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.953268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:37.956405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:37.957921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:37.960895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:38.288446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:38.324445 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1cd2cb2b-900a-413d-96d4-a543c61e20d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.426348 Aug 25 13:29:38.340911 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2680/5440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:37 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:39.377636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1404d7-f108-483c-9136-972e912c78f7", "name": "network-vif-deleted", "tag": "236fec74-d299-4626-99de-99210854dd7a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:29:39.378487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:39.382200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:39.423044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.423987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.436453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.442790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.451945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.454070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.455287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:39.456248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:39.458053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:39.555355 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] Creating event network-vif-deleted:236fec74-d299-4626-99de-99210854dd7a for instance fe1404d7-f108-483c-9136-972e912c78f7 on n-h1-850468-18 Aug 25 13:29:39.619336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-07fe93ad-fbdc-440d-96d5-4b9ae33f7720 req-639944be-b5f1-4518-820c-de81792e1d22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.531209 Aug 25 13:29:39.621005 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2761/5441] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:29:40.166377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:40.226444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0834d040-4a0e-4581-a496-46644227c6c8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.854341 Aug 25 13:29:40.249869 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2681/5442] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:39 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:41.285628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:41.287035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:41.333861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:41.339587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:41.340553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:41.342028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:41.342953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:41.343804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:41.627562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:41.654199 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1fc24d8-d95a-4497-a5bc-d08bd77b561c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.376963 Aug 25 13:29:41.664847 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2762/5443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:41 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:42.711486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:42.716284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:42.781864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:42.788295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:42.789609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:42.793108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:42.797143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:42.802228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:42.997458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:43.042037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2a4cb1fc-ff4a-4722-8a85-6eebdcbd9ca4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.345477 Aug 25 13:29:43.046930 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2682/5444] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:42 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:44.093062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:44.096143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:44.133615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:44.137525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:44.138330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:44.139695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:44.142388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:44.146298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:44.293120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:44.311108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12ca05e4-ac76-4bc2-a3c8-28d0cf275259 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.224572 Aug 25 13:29:44.312969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2763/5445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:44 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:45.348418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:45.373437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:45.404538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:45.406609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:45.407878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:45.409562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:45.412217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:45.413474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:45.623804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:45.683432 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1727f5c3-73e4-4c8c-a9f9-bc511a464c26 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.342976 Aug 25 13:29:45.698889 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2683/5446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:45 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:46.739144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:46.744822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:46.775355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:46.789133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:46.793098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:46.794773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:46.803176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:46.805371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:46.906513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:47.438556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:47.513138 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a2ea7fb-2cf4-43bd-99a7-a40b44fd32db tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.781207 Aug 25 13:29:47.517803 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2764/5447] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:46 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:48.561945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:48.572916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:48.593597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:48.594980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:48.598735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:48.604944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:48.606434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:48.607594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:48.701820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=54 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:29:48.871605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:48.904542 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a711ca8-05f3-4095-99d8-4ab5bdf3a6a4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.349722 Aug 25 13:29:48.921494 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2684/5448] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:48 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:49.962623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:49.977734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:50.007706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:50.009947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:50.010876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:50.015170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:50.016287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:50.022511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:50.459225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:50.495472 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14060037-9320-415d-a606-2754feb86343 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.541425 Aug 25 13:29:50.507467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2765/5449] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:49 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:51.551939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:51.553205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:51.583014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:51.583953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:51.584808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:51.597134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:51.607054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:51.607929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:51.888872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:51.934397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f0ce408-b6f7-41bd-9a1d-cad0de555a06 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1187 microversion: 2.1 time: 0.386892 Aug 25 13:29:51.940353 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2685/5450] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:51 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1187 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:29:52.988288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:52.991484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:53.017087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:53.029451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:53.030859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:53.032644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:53.033992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:53.035849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:53.189967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:53.193598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:53.195350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:53.196757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lazy-loading 'fault' on Instance uuid fe1404d7-f108-483c-9136-972e912c78f7 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:29:53.703467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:29:53.736884 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d2a4791-26cc-49dc-8316-28515ea3bd67 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 200 len: 1192 microversion: 2.1 time: 0.747229 Aug 25 13:29:53.744698 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2766/5451] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:52 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 1192 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:29:54.787135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:29:54.792943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:29:54.828167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:54.829726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:54.831204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:54.834599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:29:54.835981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:29:54.837243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:29:54.886606 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 HTTP/1.1 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'fe1404d7-f108-483c-9136-972e912c78f7'} Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:29:54.901962 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:29:54.914990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:29:54.920249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:29:54.922490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dfbb7372-216b-45bf-a446-63f0b2ed6849 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 404 len: 111 microversion: 2.1 time: 0.144635 Aug 25 13:29:54.926726 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2686/5452] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:29:54 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:30:05.391479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:05.396417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:05.427195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:05.431253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=19 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:05.444776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.446973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.450915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.457469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.468743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.474983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.546769 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 HTTP/1.1 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'fe1404d7-f108-483c-9136-972e912c78f7'} Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:30:05.552390 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.563964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.569466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:30:05.571908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef82e5c4-8e61-477b-9ab5-756cad283298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 404 len: 111 microversion: 2.1 time: 0.189940 Aug 25 13:30:05.574270 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2767/5453] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:30:05 2022] DELETE /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:30:05.585804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=19 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:05.587229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=13 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:05.626048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:05.632807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: fe1404d7-f108-483c-9136-972e912c78f7] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:05.679466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.688702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.690681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.695691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:05.697669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:05.708378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:05.804590 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 HTTP/1.1 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'fe1404d7-f108-483c-9136-972e912c78f7'} Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:30:05.814667 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. Aug 25 13:30:05.825660 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:30:05.828279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance fe1404d7-f108-483c-9136-972e912c78f7 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:30:05.835606 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-94e67d9f-93e5-4b84-b37e-1f1e64ddbe80 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7" status: 404 len: 111 microversion: 2.1 time: 0.251331 Aug 25 13:30:05.837378 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2687/5454] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:05 2022] GET /compute/v2.1/servers/fe1404d7-f108-483c-9136-972e912c78f7 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:30:11.715628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-341997392", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "38a273fc-f044-459a-943f-a3aaec2c7076"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:11.759618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e6cbbda-11ab-481c-80ab-29252edbc61a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Action: 'create', calling method: .version_select at 0x7fc6c1751c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1274602722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/fMzce7TRb/fnxrUw7XO9dIbeEPq+qKSkR2vfTVud3AhZlQ/GRHmTTSys/H2DFfZFgBzKXhy78MbwHYLqZv8sFXFE0I2igHOBakT9jc5a2PTqs4mh6mpCLxMqDKlYOAg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:11.927342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-2e6cbbda-11ab-481c-80ab-29252edbc61a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for project 8778c870a0004a338258a9256a5e199f. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:11.981225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-2e6cbbda-11ab-481c-80ab-29252edbc61a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for user bc93f34a658548a1b0878bbfb7e14632 and project 8778c870a0004a338258a9256a5e199f. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:12.115471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] validate_networks() for [('38a273fc-f044-459a-943f-a3aaec2c7076', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:12.127523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e6cbbda-11ab-481c-80ab-29252edbc61a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.714998 Aug 25 13:30:12.136713 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2768/5455] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:30:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:14.031542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-21767367", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "4d8fd935-41e2-4614-911a-2a289e37ce75"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:14.305749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] validate_networks() for [('4d8fd935-41e2-4614-911a-2a289e37ce75', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:15.545956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:15.747316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:16.013081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:16.013845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:16.014782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:16.015561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:16.016382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:16.102168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.104358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.105224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.112460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:16.115252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:16.122702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:16.248565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Getting quotas for project 8629306c8af3498e8ca35b2823cbfc5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:16.309333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Getting quotas for user 7ce59e5f036841818c527911668deb32 and project 8629306c8af3498e8ca35b2823cbfc5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:16.446301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:16.480936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:16.763863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6f33780-6d4a-4862-95a0-8ec91abf4986 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.770819 Aug 25 13:30:16.780991 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2688/5456] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:16.796034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35353eab-c08b-44e3-bd63-22ab6732ca27 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:16.804401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35353eab-c08b-44e3-bd63-22ab6732ca27 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:17.367520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35353eab-c08b-44e3-bd63-22ab6732ca27 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:17.415424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35353eab-c08b-44e3-bd63-22ab6732ca27 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1213 microversion: 2.1 time: 0.626018 Aug 25 13:30:17.423266 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2689/5457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:16 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1213 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:18.462934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dc3f3103-3c4f-4731-8073-c9fadd261bd8 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:18.475708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dc3f3103-3c4f-4731-8073-c9fadd261bd8 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:19.133153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dc3f3103-3c4f-4731-8073-c9fadd261bd8 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:19.184511 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dc3f3103-3c4f-4731-8073-c9fadd261bd8 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1213 microversion: 2.1 time: 0.729982 Aug 25 13:30:19.203865 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2690/5458] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:18 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1213 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:20.230635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd153d1a-7db3-4617-a8b2-660c2d5322d5 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:20.246169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd153d1a-7db3-4617-a8b2-660c2d5322d5 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:20.977153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fd153d1a-7db3-4617-a8b2-660c2d5322d5 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:21.018667 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd153d1a-7db3-4617-a8b2-660c2d5322d5 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1213 microversion: 2.1 time: 0.787440 Aug 25 13:30:21.023821 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2691/5459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:20 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1213 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:21.723297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:21.729937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:21.733019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:21.740758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:21.757789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:21.840044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.841362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.842147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:21.845695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:21.846559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:21.847929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:22.048219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Getting quotas for project dde4171b169349e29fcab93bc99af6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:22.087172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c373ac4d-a36d-4f76-a96b-03f37c404171 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:22.090302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Getting quotas for user 0991cb690c374e04a042d1ab4f5b7a89 and project dde4171b169349e29fcab93bc99af6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:22.094395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c373ac4d-a36d-4f76-a96b-03f37c404171 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:22.254719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:22.284347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:22.565608 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f1bd104-cc0c-4199-85ef-8d23657e4d0e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.717304 Aug 25 13:30:22.578977 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2769/5460] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 8732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:22.589138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-242738043", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1274602722", "security_groups": [{"name": "tempest-secgroup-smoke-973985090"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "2795bc64-294c-4aff-b007-4944545ec4f4"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:22.745473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c373ac4d-a36d-4f76-a96b-03f37c404171 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:22.792618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c373ac4d-a36d-4f76-a96b-03f37c404171 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1213 microversion: 2.1 time: 0.723980 Aug 25 13:30:22.809340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2692/5461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:22 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1213 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:22.837874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91f051df-afb7-424f-8194-47018d1e2095 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:22.857652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91f051df-afb7-424f-8194-47018d1e2095 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:23.328230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-91f051df-afb7-424f-8194-47018d1e2095 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:23.359083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91f051df-afb7-424f-8194-47018d1e2095 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1223 microversion: 2.1 time: 0.547376 Aug 25 13:30:23.361703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2693/5462] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:22 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1223 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:23.489638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] validate_networks() for [('2795bc64-294c-4aff-b007-4944545ec4f4', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:30:23.841720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:23.856199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:23.942070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:23.945100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:23.949902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:23.954615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:23.955503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:23.969114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:25.048537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:25.098656 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ee244adb-8398-4dcb-a0b4-adda911262dd tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1273 microversion: 2.1 time: 1.264221 Aug 25 13:30:25.104543 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2694/5463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:23 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1273 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:25.121447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-62723f05-2d16-4e2a-bb09-b2eddc7a56ae tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:25.139173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-62723f05-2d16-4e2a-bb09-b2eddc7a56ae tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:25.496096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-62723f05-2d16-4e2a-bb09-b2eddc7a56ae tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:25.540680 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-62723f05-2d16-4e2a-bb09-b2eddc7a56ae tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1223 microversion: 2.1 time: 0.433916 Aug 25 13:30:25.541677 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2695/5464] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:25 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1223 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:26.142805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:26.156745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:26.194460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:26.203142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.207325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.218515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.220324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.226805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.231443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.705482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:26.735597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-60f607dc-2336-4d8f-9c87-058fbb5da100 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1271 microversion: 2.1 time: 0.602318 Aug 25 13:30:26.737517 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2696/5465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:26 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1271 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:26.748391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:26.750093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:26.762933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.764461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.765549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:26.767627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:26.770730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:26.772048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:27.323052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:27.359390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acf294dd-bb91-466d-bd34-6ab768f28987 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1227 microversion: 2.1 time: 0.617917 Aug 25 13:30:27.361263 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2697/5466] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:26 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1227 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:27.806439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:27.810475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:27.853593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.861509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.864737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:27.867186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:27.886171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:27.901075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.076410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for project 8778c870a0004a338258a9256a5e199f. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:28.094594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for user bc93f34a658548a1b0878bbfb7e14632 and project 8778c870a0004a338258a9256a5e199f. Resources: dict_keys(['metadata_items']) {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:28.151651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:30:28.154309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:30:28.155336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:30:28.162733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:30:28.163764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:30:28.207301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.214477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.215348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.220618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.225589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.225929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.316806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for project 8778c870a0004a338258a9256a5e199f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:30:28.331525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Getting quotas for user bc93f34a658548a1b0878bbfb7e14632 and project 8778c870a0004a338258a9256a5e199f. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:30:28.382297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:30:28.385730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:30:28.494638 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aaa05761-fd18-42e6-9a1b-b68078141bb9 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.910479 Aug 25 13:30:28.498127 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2770/5467] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:30:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 5918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:30:28.521107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:28.525382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:28.554221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:28.567537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.573886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.579426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.582180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:28.588594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:28.590498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:28.604424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52d8e8ca-7466-4cbf-bc32-d7e4e1e5e9ac tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1271 microversion: 2.1 time: 0.819288 Aug 25 13:30:28.605436 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2698/5468] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:27 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1271 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:28.640717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-26644c5b-266a-464a-9087-bd9244651e4e tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:28.645109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-26644c5b-266a-464a-9087-bd9244651e4e tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:29.355364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26644c5b-266a-464a-9087-bd9244651e4e tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:29.393114 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-26644c5b-266a-464a-9087-bd9244651e4e tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1302 microversion: 2.1 time: 0.768465 Aug 25 13:30:29.398577 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2699/5469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:28 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1302 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:29.410829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:29.452013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3056df7f-7d71-4ee8-8d80-4eef5c95a4dd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1275 microversion: 2.1 time: 0.949249 Aug 25 13:30:29.454995 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2771/5470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:28 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1275 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:29.648390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:29.669696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:29.732694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.734037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.744571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:29.746354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:29.747766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:29.749009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.439414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:30.442963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:30.570669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:30.579578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:30.602924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.604014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:30.609302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:30.613642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:30.988036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.043849 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a923ecf1-9cd0-49b4-8cb6-488b35b4b847 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 1.404891 Aug 25 13:30:31.045834 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2700/5471] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:29 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:31.052208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.079134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:31.080947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:31.083207 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa964821-a409-44ca-8c38-f38fb6c03ef3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1306 microversion: 2.1 time: 0.649516 Aug 25 13:30:31.089441 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2772/5472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:30 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1306 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:31.147782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:31.149149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:31.151217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:31.153672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:31.157086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:31.159185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:31.781054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:31.829057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1c47b5d-4abe-41e2-95ff-082af1a7ec43 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1281 microversion: 2.1 time: 0.780825 Aug 25 13:30:31.830027 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2701/5473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:31 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1281 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:32.096239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:32.099613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:32.131676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.134791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.136549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.138465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.139859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.141030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.142952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:32.150996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:32.198291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.199209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.200034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.205651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:32.207121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:32.223819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:32.820938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:32.880210 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-202a718f-ecf6-4f80-8c92-983e4961e994 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1354 microversion: 2.1 time: 0.733284 Aug 25 13:30:32.889893 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2702/5474] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:32 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1354 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:32.975846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:32.977657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:33.002633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.016576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.017921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:33.020281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:33.021573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:33.022774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.690542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.736490 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-deb8a847-d23a-4033-8e69-d7023fdb4aa3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1281 microversion: 2.1 time: 1.817922 Aug 25 13:30:34.738271 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2703/5475] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:32 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1281 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:34.758796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:34.765219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:34.802882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.818601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.820339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.825710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:34.837645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:34.839965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:34.933167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:34.965871 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-20ab1fe4-8f4f-4731-9384-95ce95a07271 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 2.873973 Aug 25 13:30:34.967021 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2773/5476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:32 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 2883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:35.329167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:35.354215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1c9ea3d-15dc-466e-a7ab-b28c3b950a19 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1360 microversion: 2.1 time: 0.606956 Aug 25 13:30:35.355035 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2704/5477] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:34 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1360 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:35.781101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:35.786574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9013b5-9442-41b4-9316-790b6fba7a49", "tag": "83b48a09-6b00-4a3e-95a0-6907f2b91041"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:35.788603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:35.809977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:35.839228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:35.847683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:35.851631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:35.858446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:35.864195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:35.864725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:35.865667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:35.908160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:35.915012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:35.916001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:35.968648 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] Creating event network-changed:83b48a09-6b00-4a3e-95a0-6907f2b91041 for instance 9e9013b5-9442-41b4-9316-790b6fba7a49 on n-h1-850468-18 Aug 25 13:30:35.983522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a8278521-8a8b-4a4f-a4f1-4708e61ccc65 req-a4fd2541-953c-4bfd-b186-61200ca22e48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230481 Aug 25 13:30:35.985296 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2774/5478] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:36.011550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.012738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.025505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.026658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.028027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.030664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.034308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.035039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.437198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.464759 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef0c0f95-b784-4fb9-acc0-75f12db20c95 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1281 microversion: 2.1 time: 0.691498 Aug 25 13:30:36.476970 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2705/5479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:35 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1281 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:36.510590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:36.520779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:36.552455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.553724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.554734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.556821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:36.558049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:36.559277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:36.851081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:36.892672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6f4b16b5-4fb1-4cf9-91f4-ce3f1a8c1010 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1360 microversion: 2.1 time: 0.411177 Aug 25 13:30:36.901591 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2706/5480] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:36 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1360 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:37.478538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:37.517282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:37.517812 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1804389d-3993-40ca-b416-cd289a47b74e tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 1.492708 Aug 25 13:30:37.520257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:37.523154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2775/5481] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:36 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:37.565402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.567523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.568424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.569794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.570661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.571397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.945178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:37.948529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:37.969316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.971207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.976477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:37.978228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:37.981626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:37.990704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:38.194482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:38.254814 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7f2ced20-6b75-462f-9980-202f25890703 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1360 microversion: 2.1 time: 0.321405 Aug 25 13:30:38.259915 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2776/5482] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:37 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1360 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:38.597924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:38.607553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:38.630218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:38.637427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:38.667376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:38.668248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:38.669086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:38.672092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:38.672092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:38.672092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:39.387706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=20 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:39.962506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:40.015766 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b3a9640-e9d4-49b9-b3c2-cc77e7926b44 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 2.500025 Aug 25 13:30:40.022303 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2707/5483] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:37 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:40.046529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:40.048521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:40.118149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.122812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.127303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.130660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:40.135841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:40.137110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:40.587407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:40.624581 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d9ba51b0-0b1a-460c-8f2f-d039625b5f09 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1360 microversion: 2.1 time: 0.599328 Aug 25 13:30:40.626553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2708/5484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:40 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1360 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:41.087184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:41.091374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:41.125901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:41.127286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:41.128745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:41.133802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:41.135439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:41.144515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:42.925796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:42.971021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1b77e7d-59f6-4985-93ed-6f72f813260a tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 4.402774 Aug 25 13:30:42.976268 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2777/5485] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:38 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 4413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:42.989250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:42.990516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:43.030991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:43.031946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:43.032809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:43.034171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:43.035440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:43.037196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:43.597821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:43.634834 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-545a993b-2364-44e4-b359-57f6a9c54dfd tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 2.570314 Aug 25 13:30:43.637469 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2709/5486] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:41 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:44.030530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:44.036291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:44.090318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.099572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.101457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.103379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.107622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.114022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.804270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:44.850054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e81d0f43-9597-4184-bcec-4134d45274d0 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 1.871572 Aug 25 13:30:44.851046 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2778/5487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:42 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:44.872052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:44.873266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:44.902688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.903571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.904372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:44.905711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:44.906587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:44.907371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:45.951549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:45.986532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=91 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:45.991043 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5033a947-8d28-43b9-b128-6236e104d962 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 1.981506 Aug 25 13:30:46.000297 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2710/5488] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:44 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:46.009141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9013b5-9442-41b4-9316-790b6fba7a49", "name": "network-vif-plugged", "status": "completed", "tag": "83b48a09-6b00-4a3e-95a0-6907f2b91041"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:46.056183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:46.057119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:46.057953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.079185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] Creating event network-vif-plugged:83b48a09-6b00-4a3e-95a0-6907f2b91041 for instance 9e9013b5-9442-41b4-9316-790b6fba7a49 on n-h1-850468-18 Aug 25 13:30:46.090741 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5512c2b3-526f-48da-a2ed-7e69d19f61ed req-9e35bac9-31fc-4d43-98c4-0e51dd2e4721 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088165 Aug 25 13:30:46.091871 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2711/5489] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:46.105871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:46.107500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:46.139466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:46.140778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:46.142748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.145254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:46.146525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:46.147815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:46.663823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:46.678894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=53 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:30:46.737157 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f055f6f1-3110-4164-bc67-e04934d65874 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.881153 Aug 25 13:30:46.742029 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2779/5490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:44 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:47.044824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:47.055097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:47.101388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.110552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.111435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:47.115114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.116038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.121003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:47.475657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:47.529495 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-314ad731-906b-441a-869f-8832fceac9c3 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 1.434991 Aug 25 13:30:47.537544 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2712/5491] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:46 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:47.791576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:47.801985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:47.840654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.842022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.843106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:47.845591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:47.848479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:47.850527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:49.529376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:49.554283 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cdef0554-b909-4240-9be3-ffa246d1f383 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1313 microversion: 2.1 time: 2.516343 Aug 25 13:30:49.555870 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2780/5492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:47 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1313 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:49.568046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:49.570295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:49.590126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:49.591348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:49.592649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:49.596169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:49.599549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:49.601007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:49.611545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:49.644750 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ed9885b-6398-4618-9da1-39e703631f07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.863521 Aug 25 13:30:49.655882 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2713/5493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:47 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:50.614981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:50.624336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:50.677666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:50.680056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:50.685089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:50.699615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:50.703188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:50.705753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:51.498886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:51.522758 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c2d0d2f-3c04-4230-8a93-cf8628b50c94 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 1.959085 Aug 25 13:30:51.523902 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2781/5494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:49 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:51.542091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:51.561691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:51.585126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:51.589664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:51.595680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:51.598403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:51.600310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:51.601685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:52.515113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:52.570916 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69c59500-37ed-4dde-bde8-9dbc9e68e31b tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1497 microversion: 2.1 time: 1.966929 Aug 25 13:30:52.585960 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2714/5495] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:50 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1497 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:52.938967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc01b553-e41e-4b44-8eaf-41816112385b", "tag": "9559230a-bd24-48fb-95f3-570cd3cb3d16"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:52.977281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:52.982043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:53.011625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:53.048426 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] Creating event network-changed:9559230a-bd24-48fb-95f3-570cd3cb3d16 for instance bc01b553-e41e-4b44-8eaf-41816112385b on n-h1-850468-18 Aug 25 13:30:53.064436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a53b839a-ca72-4903-aa04-340280058c41 req-35c87240-7014-44f7-b7f4-be78594bd1e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459046 Aug 25 13:30:53.067864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2715/5496] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:53.139983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:53.143599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:53.205526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:53.218050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:53.224066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:53.226339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:53.227742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:53.242580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:53.336847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:53.382104 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-80591626-3329-4401-b505-488c5f040b5a tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.853138 Aug 25 13:30:53.388145 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2782/5497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:51 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:54.437687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:54.451261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:54.492854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:54.495037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:54.496384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:54.497707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:54.498541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:54.499341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:55.631688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:55.667947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56d6755a-e15e-4f68-95ff-9d88670bda1a tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 2.597784 Aug 25 13:30:55.672456 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2716/5498] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:53 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:55.684043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb", "tag": "596268a9-b9f2-4ba2-987d-aa679a7013aa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:30:55.734398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:55.735157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:55.739351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:55.772547 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] Creating event network-changed:596268a9-b9f2-4ba2-987d-aa679a7013aa for instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb on n-h1-850468-18 Aug 25 13:30:55.794836 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-dead6ec2-c457-4675-8e4d-0662258f61b1 req-48128123-dc48-4607-83b1-1206c71f1285 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116428 Aug 25 13:30:55.797057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2717/5499] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:30:55.891246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:55.931844 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d6c7c88-4e29-4dbb-b62f-4ee88094c25f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.502255 Aug 25 13:30:55.976932 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2783/5500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:54 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:56.742126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:56.752099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:56.820267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:56.822198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:56.825750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:56.827641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:56.829440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:56.834102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:57.017770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:57.026934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:57.152458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:57.152458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:57.154499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:57.156311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:57.179786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:57.181562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:57.852441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:57.889678 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a9b1d91-36d9-4d9f-bab1-8cf8eab5e7b8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 1.172616 Aug 25 13:30:57.895540 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2718/5501] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:56 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:57.948565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:57.975706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-71b23c81-0a27-4897-9e72-f2a7a4b66900 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 0.973192 Aug 25 13:30:57.978246 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2784/5502] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:56 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:30:58.934483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:58.944865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:58.981490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:58.982400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:58.998067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.009749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:59.014560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:59.017971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.027324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:30:59.029855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:30:59.062744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:59.065947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:59.068245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.070080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:30:59.072526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:30:59.074760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:30:59.793085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:59.823532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-55466b36-75f0-4a2f-a30e-5aa25e288c54 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 0.897316 Aug 25 13:30:59.825173 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2719/5503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:58 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:30:59.826184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:30:59.888525 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b1d794af-804e-4428-af36-5993422f71c3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 0.873038 Aug 25 13:30:59.892545 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2785/5504] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:30:59 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:00.875007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.878817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:00.923304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.933944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.936465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:00.937682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.941852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.943013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:00.949507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:00.963654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:00.984148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.985405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.986987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:00.989434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:00.990971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:00.992924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:03.420663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:03.472684 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5fcb04a8-8f65-44fb-a4d3-43ad97182778 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 2.539660 Aug 25 13:31:03.490430 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2786/5505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:03.523545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:03.531694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:03.575077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:03.576679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:03.580210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:03.582927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:03.589500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:03.590797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:03.767159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:31:03.915917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:03.972407 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4aa1a795-49bf-41de-8055-1eb32bdba8a8 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 3.106791 Aug 25 13:31:03.978662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2720/5506] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:00 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 3123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:04.003587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb", "name": "network-vif-plugged", "status": "completed", "tag": "596268a9-b9f2-4ba2-987d-aa679a7013aa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:04.084876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.088875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.092281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.179095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a842baf-4cfb-47c3-a954-24378f779332 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 204 len: 0 microversion: 2.1 time: 0.676991 Aug 25 13:31:04.192654 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2787/5507] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:31:03 2022] DELETE /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:31:04.225438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] Creating event network-vif-plugged:596268a9-b9f2-4ba2-987d-aa679a7013aa for instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb on n-h1-850468-18 Aug 25 13:31:04.256081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:04.257528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:04.276479 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8a919ff4-8268-4a10-a83d-2f9f319e690a req-8fabde4b-d567-4cd9-83ce-ed548c9e23c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293084 Aug 25 13:31:04.277702 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2721/5508] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:04.319367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.322507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.323353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.335912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.345741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.347600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.527609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:04.531855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:04.559238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.560200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.560984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:04.562341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:04.563225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:04.577455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:05.082903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:05.119058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddc14009-3a32-42f4-a6bf-a6b304813720 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1503 microversion: 2.1 time: 0.918747 Aug 25 13:31:05.121203 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2788/5509] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:04 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1503 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:05.139215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:05.143152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:05.178981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:05.180966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:05.182337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:05.192377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:05.194899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:05.200432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:05.239780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:05.282469 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fcd012b0-af24-4c1b-af8c-fad90f60715c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 0.768461 Aug 25 13:31:05.291373 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2722/5510] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:04 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:06.161550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:06.162777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:06.208344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:06.212469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.219232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.229534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.231207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.239875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.242050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.793717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:06.824853 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e848d07-865a-42df-a601-87aba700b99b tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 1.701164 Aug 25 13:31:06.830609 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2789/5511] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:05 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:06.846218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:06.853745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:06.884952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:06.890748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:06.892685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.901443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.902374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.909948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:06.910835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:06.911643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:06.928439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31dae15b-6296-43a3-a584-909f45696433 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1503 microversion: 2.1 time: 0.775241 Aug 25 13:31:06.934547 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2723/5512] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:06 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1503 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:07.320797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:07.349114 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5cfe723-185b-46d4-8b48-09cd2118db7c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 0.511733 Aug 25 13:31:07.351073 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2790/5513] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:06 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:07.881828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:07.897752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:07.942968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:07.943903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:07.944789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:07.951782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:07.956911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:07.958164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:07.988053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:07.993302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:08.038533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:08.041364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:08.044334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:08.047615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:08.052794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:08.054285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:08.561584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:08.591867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6b2bacb-6b68-4066-b929-f6ee7ab2cc78 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1427 microversion: 2.1 time: 0.721942 Aug 25 13:31:08.592967 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2724/5514] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:07 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1427 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:08.642599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:08.648526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:08.697471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:08.699003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:08.700865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:08.706560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:08.716929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:08.718255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:08.770979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:08.831710 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18438dfb-514d-41c4-9b90-1c5e5ccd91a7 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1503 microversion: 2.1 time: 0.851336 Aug 25 13:31:08.849840 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2791/5515] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:07 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1503 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:09.220701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:09.275357 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-798a1e43-d11d-4ac0-a659-ed4c1fd35f6c tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 0.644892 Aug 25 13:31:09.281922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2725/5516] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:08 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:09.636481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:09.639954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:09.673930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.676472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.680389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:09.683442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.685392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.689439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:09.887895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:09.889487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:09.917876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.918760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.919586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:09.921452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:09.925696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:09.937254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.258910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ce59e5f036841818c527911668deb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8629306c8af3498e8ca35b2823cbfc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:10.284826 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e7d698f-f0dd-42da-94d6-2098fec91873 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 200 len: 1461 microversion: 2.1 time: 0.411474 Aug 25 13:31:10.287088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2726/5517] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:09 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 1461 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:10.296161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01b553-e41e-4b44-8eaf-41816112385b", "name": "network-vif-plugged", "status": "completed", "tag": "9559230a-bd24-48fb-95f3-570cd3cb3d16"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:10.349382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.355430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.357224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.413178 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] Creating event network-vif-plugged:9559230a-bd24-48fb-95f3-570cd3cb3d16 for instance bc01b553-e41e-4b44-8eaf-41816112385b on n-h1-850468-18 Aug 25 13:31:10.444306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bd46aba1-436d-4624-a889-0036b00ac093 req-f8e04deb-1ca3-4692-9163-f70ebc5dde1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151414 Aug 25 13:31:10.447173 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2727/5518] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:10.468824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9013b5-9442-41b4-9316-790b6fba7a49", "name": "network-vif-deleted", "tag": "83b48a09-6b00-4a3e-95a0-6907f2b91041"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:10.509871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.517111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.517990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.564604 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] Creating event network-vif-deleted:83b48a09-6b00-4a3e-95a0-6907f2b91041 for instance 9e9013b5-9442-41b4-9316-790b6fba7a49 on n-h1-850468-18 Aug 25 13:31:10.581338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c100d30c-1733-4a7d-b35a-2230bd9b81b0 req-0eb43905-f7fa-4a73-af9e-4bbb812bdcf1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131171 Aug 25 13:31:10.584657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2728/5519] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:10.596163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:10.598565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:10.637794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.641290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.645060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.648610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.653390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.661634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.691364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:10.739674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d146e3f3-9eac-4c59-b555-c8ce98ac9d22 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1606 microversion: 2.1 time: 1.102746 Aug 25 13:31:10.740842 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2792/5520] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:09 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1606 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:10.792302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:10.796725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:10.823036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.827200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.832808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:10.837926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:10.839359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:10.848079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.651087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:11.682825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:11.694609 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f70c18ff-ada2-4256-8345-7640a0235e85 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1606 microversion: 2.1 time: 0.911558 Aug 25 13:31:11.722716 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2793/5521] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:10 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1606 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:11.778226 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a20539c9-9cf6-4772-84cb-34369fee4eb3 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.187237 Aug 25 13:31:11.790763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:11.791976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] [instance: 9e9013b5-9442-41b4-9316-790b6fba7a49] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:11.808245 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2729/5522] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:10 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:11.845341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:11.850435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:11.851305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.855485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:11.858440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:11.859836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:11.866495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:11.874569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.903850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:11.905541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:11.920588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.935817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:11.936895 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] HTTP exception thrown: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. Aug 25 13:31:11.937588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:11.938475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Request method failure captured: Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 HTTP/1.1 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3lX03VgvW9Y6Zrp_s1ShrBa7qycmCKScI_21LD7kO16UiuuAyr8MyEwDqRjl8AjO75AGOsSQYACO4eFEhRfQB1eRSWtqkGEAMhO6gPh585qsrjwk_QsgnUo_bhCrkOIog4FQdlNioHfnStr0xRng8rZJjV1qQKHUOjACHukaXPo1Uw Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8629306c8af3498e8ca35b2823cbfc5a Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesActionsTest-2124723353 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8629306c8af3498e8ca35b2823cbfc5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8629306c8af3498e8ca35b2823cbfc5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8629306c8af3498e8ca35b2823cbfc5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8629306c8af3498e8ca35b2823cbfc5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesActionsTest-2124723353 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8629306c8af3498e8ca35b2823cbfc5a Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesActionsTest-2124723353 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesActionsTest-2124723353-project Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 7ce59e5f036841818c527911668deb32 Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesActionsTest-2124723353-project Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '9e9013b5-9442-41b4-9316-790b6fba7a49'} Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:11.941480 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. Aug 25 13:31:11.951039 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:11.954330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] Returning 404 to user: Instance 9e9013b5-9442-41b4-9316-790b6fba7a49 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:31:11.964865 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b2ec2c4-8634-4945-866a-20ff418f7242 tempest-VolumesActionsTest-2124723353 tempest-VolumesActionsTest-2124723353-project] 10.222.0.60 "GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49" status: 404 len: 111 microversion: 2.1 time: 0.239413 Aug 25 13:31:11.976636 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2794/5523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:11 2022] GET /compute/v2.1/servers/9e9013b5-9442-41b4-9316-790b6fba7a49 => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:31:12.840697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:12.848027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:12.901083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:12.902214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:12.907779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:12.916388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:12.924602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:12.929911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:13.023149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:13.563982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:13.632069 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e6477e2-76bc-456b-a506-1485d7c34123 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1606 microversion: 2.1 time: 1.816740 Aug 25 13:31:13.638049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2730/5524] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:11 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1606 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:13.796456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:13.831423 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fdc1fc5c-7f8e-4f69-8367-da00a2453222 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 1.003273 Aug 25 13:31:13.837996 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2795/5525] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:12 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:14.866578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:14.870207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:14.901105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:14.910561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:14.915248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:14.917129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:14.921102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:14.922961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:15.065619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:17.240025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:17.311340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9f44705c-1f47-427a-9ed2-ef6c6332af4e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1323 microversion: 2.1 time: 2.447657 Aug 25 13:31:17.312979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2731/5526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:14 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1323 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:18.354096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:18.359075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:18.411633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.412346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.413193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:18.414620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:18.415979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:18.430967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:19.844566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:19.865401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5586932b-1f6d-4996-a5e2-60ca1919c61e tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1521 microversion: 2.1 time: 1.522480 Aug 25 13:31:19.872982 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2796/5527] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:18 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1521 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:19.930736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:19.933145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:19.951943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:19.953433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:19.955989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:19.959888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:19.961244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:19.962573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:20.076036 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] HTTP exception thrown: Instance is not a member of specified network Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Request method failure captured: Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b/ips/invalid HTTP/1.1 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3ll-DffvXGHjiMfb7A2ldB2MSMSTjrTtKBVXfbCTIVxC4504J9nSpvDK_eXHr-eg-pjxtcb8ZeMl5Rc4VeruQ-dTSL33f56EpxERxod6Fm5X6XLRghtIeLqjw-k0UlnBzvnrqwEXrt10UVnuY_Ht1OJ8xM8vVbtI9lgjLWK7UI1gh0 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0991cb690c374e04a042d1ab4f5b7a89 Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance is not a member of specified network Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'bc01b553-e41e-4b44-8eaf-41816112385b', 'id': 'invalid'} Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 25 13:31:20.085796 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.097793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:31:20.099875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e805a41-5d9b-404f-9bdf-3b4e5a209925 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.184981 Aug 25 13:31:20.101140 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2732/5528] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:31:19 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b/ips/invalid => generated 91 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:31:20.119598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:20.124580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Failed to fetch instance by id 999 {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 25 13:31:20.126198 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] HTTP exception thrown: Instance 999 could not be found. Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Request method failure captured: Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3ll-DffvXGHjiMfb7A2ldB2MSMSTjrTtKBVXfbCTIVxC4504J9nSpvDK_eXHr-eg-pjxtcb8ZeMl5Rc4VeruQ-dTSL33f56EpxERxod6Fm5X6XLRghtIeLqjw-k0UlnBzvnrqwEXrt10UVnuY_Ht1OJ8xM8vVbtI9lgjLWK7UI1gh0 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0991cb690c374e04a042d1ab4f5b7a89 Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 999 could not be found. Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': '999'} Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 25 13:31:20.130765 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:31:20.149424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:31:20.151744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9a2874d7-8db3-4277-a964-70284fd1bb07 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.039756 Aug 25 13:31:20.157954 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2797/5529] 10.222.0.60 () {58 vars in 1149 bytes} [Thu Aug 25 13:31:20 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 13:31:20.193498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:20.193680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:20.207955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:20.209254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:20.210348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:20.211748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:20.212863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:20.213674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:20.357076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:31:20.735566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f10bc7a-821e-496c-adaf-106e1e80038f tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 204 len: 0 microversion: 2.1 time: 0.563190 Aug 25 13:31:20.738771 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2733/5530] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:31:20 2022] DELETE /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:31:20.753881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:20.755242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:20.872908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:20.879228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:20.883138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:20.885900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:20.888708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:20.898547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:21.640156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:21.683975 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c9fd13c-b890-4fa8-a03e-7b7ca9316690 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1527 microversion: 2.1 time: 0.938532 Aug 25 13:31:21.689772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2798/5531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:20 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1527 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:22.279993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb", "tag": "596268a9-b9f2-4ba2-987d-aa679a7013aa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:22.336635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:22.337933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:22.339084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:22.388768 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] Creating event network-changed:596268a9-b9f2-4ba2-987d-aa679a7013aa for instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb on n-h1-850468-18 Aug 25 13:31:22.412145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5ee82c4a-febe-4f49-b97f-ba61c7e0d6a1 req-76ee2b9e-44e7-4a91-a77e-49981cdf94dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153323 Aug 25 13:31:22.420595 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2734/5532] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:22.738654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:22.743677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:22.782715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:22.783250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:22.784459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:22.794531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:22.795790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:22.796068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:24.021484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:24.107443 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eee6db4d-b007-4ce3-ba68-4a7bc784c5cf tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1527 microversion: 2.1 time: 1.346974 Aug 25 13:31:24.116248 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2799/5533] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:22 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1527 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:25.169991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:25.172861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:25.239291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:25.240417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:25.251021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:25.252548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:25.253434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:25.254521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:27.335338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01b553-e41e-4b44-8eaf-41816112385b", "name": "network-vif-deleted", "tag": "9559230a-bd24-48fb-95f3-570cd3cb3d16"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:27.412602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:27.422529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:27.423412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:27.492067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] Creating event network-vif-deleted:9559230a-bd24-48fb-95f3-570cd3cb3d16 for instance bc01b553-e41e-4b44-8eaf-41816112385b on n-h1-850468-18 Aug 25 13:31:27.535459 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-111864e5-535d-4ee0-8d95-420370ac40f0 req-e9a6f393-347e-4350-b046-1dbba48008c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208403 Aug 25 13:31:27.549115 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2800/5534] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:27.811512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0991cb690c374e04a042d1ab4f5b7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde4171b169349e29fcab93bc99af6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:27.841478 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e190aae-3d54-4b9b-a7c6-18f07cbe1018 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 200 len: 1527 microversion: 2.1 time: 2.685014 Aug 25 13:31:27.843036 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2735/5535] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:25 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 1527 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:28.595780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-450985868", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "77701c52-4e2e-4589-84a0-b3c431e74fc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:28.907215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:28.911844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] [instance: bc01b553-e41e-4b44-8eaf-41816112385b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:28.946378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:28.946940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:28.947460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:28.951518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:28.952012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:28.952495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:29.014175 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] HTTP exception thrown: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Request method failure captured: Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b HTTP/1.1 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3ll-DffvXGHjiMfb7A2ldB2MSMSTjrTtKBVXfbCTIVxC4504J9nSpvDK_eXHr-eg-pjxtcb8ZeMl5Rc4VeruQ-dTSL33f56EpxERxod6Fm5X6XLRghtIeLqjw-k0UlnBzvnrqwEXrt10UVnuY_Ht1OJ8xM8vVbtI9lgjLWK7UI1gh0 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dde4171b169349e29fcab93bc99af6d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: dde4171b169349e29fcab93bc99af6d1 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-326456704 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0991cb690c374e04a042d1ab4f5b7a89 Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-326456704-project Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bc01b553-e41e-4b44-8eaf-41816112385b'} Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:29.028224 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] Returning 404 to user: Instance bc01b553-e41e-4b44-8eaf-41816112385b could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4a54e77-4792-4a21-a752-f9f35c9825f4 tempest-ServerAddressesNegativeTestJSON-326456704 tempest-ServerAddressesNegativeTestJSON-326456704-project] 10.222.0.60 "GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b" status: 404 len: 111 microversion: 2.1 time: 0.150648 Aug 25 13:31:29.043920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2736/5536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:28 2022] GET /compute/v2.1/servers/bc01b553-e41e-4b44-8eaf-41816112385b => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:31:29.332841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:31:31.823954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:31:31.825855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:31:31.826791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:31:31.827642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:31:31.828449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:31:31.855520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:31.856785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:31.867008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:31.868983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:31.871507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:31.872784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:31.944171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:31:31.967496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:31:32.239304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:31:32.258187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77701c52-4e2e-4589-84a0-b3c431e74fc5',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:31:32.711638 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e6ac0f6-789a-40fe-a5c0-2ff3320c90c0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.125107 Aug 25 13:31:32.724176 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2801/5537] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:31:32.737561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66c2ba53-0e4f-49bd-8db6-8886eea9d0d1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:32.739385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66c2ba53-0e4f-49bd-8db6-8886eea9d0d1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:32.946287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-66c2ba53-0e4f-49bd-8db6-8886eea9d0d1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:32.990219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66c2ba53-0e4f-49bd-8db6-8886eea9d0d1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1070 microversion: 2.1 time: 0.262495 Aug 25 13:31:33.018658 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2737/5538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:32 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1070 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:34.055326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ada7a1b-11ac-4464-a972-087c7f779c7b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:34.065818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ada7a1b-11ac-4464-a972-087c7f779c7b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:34.610305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ada7a1b-11ac-4464-a972-087c7f779c7b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:34.639625 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ada7a1b-11ac-4464-a972-087c7f779c7b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1070 microversion: 2.1 time: 0.610809 Aug 25 13:31:34.665304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2802/5539] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:34 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1070 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:35.687278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:35.691036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:35.734727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:35.735737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:35.737191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:35.739045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:35.745871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:35.747245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:36.107729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:36.200820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e5975d6-bd59-43e4-83a4-5dd70f508a94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1168 microversion: 2.1 time: 0.523263 Aug 25 13:31:36.205141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2738/5540] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:35 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1168 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:37.261433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:37.262555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:37.286288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:37.327361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:37.328350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:37.329201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:37.330867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:37.331543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:37.351359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:37.726726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:37.779108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35015f49-2ade-4f85-8519-ed6a78576d6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1186 microversion: 2.1 time: 0.525172 Aug 25 13:31:37.789515 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2803/5541] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:37 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1186 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:38.840388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:38.851040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:38.856542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:38.911409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:38.912846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:38.915535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:38.917422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:38.918672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:38.925088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:39.277664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:39.323124 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3c8b3f47-c100-4d85-9979-f8c46896baa1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1186 microversion: 2.1 time: 0.489874 Aug 25 13:31:39.347070 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2739/5542] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:38 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1186 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:40.392158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:40.405211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:40.470198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:40.484924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:40.491049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:40.502069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:40.508757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:40.510314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:41.615962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:41.648579 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2c01023-72a4-4de3-ad04-233f65dba90f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1186 microversion: 2.1 time: 1.279046 Aug 25 13:31:41.656652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2804/5543] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:40 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1186 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:42.706499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:42.713123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:42.770442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:42.780756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:42.782166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:42.783905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:42.790883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:42.794682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:42.996568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:44.529489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:44.581533 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ddd5bfe-cbd1-43b7-a297-a1b796cf9245 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 1.861916 Aug 25 13:31:44.583035 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2740/5544] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:42 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:45.669781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:45.673778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:45.726957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:45.738142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:45.759812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:45.761466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:45.763553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:45.767607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:45.772684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:45.777169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:45.853311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=38 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:47.797987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:47.845380 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c25b231-c029-43e4-a87c-22c8f5765463 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 2.200904 Aug 25 13:31:47.853716 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2805/5545] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:45 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:48.910252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:48.916247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:48.968479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.969912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.985416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:48.987394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:48.992996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:48.997178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:49.092061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:31:50.140720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:50.181078 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-476b4a58-9549-4bf5-8a0b-717ba1a0cc6e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 1.291701 Aug 25 13:31:50.192170 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2741/5546] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:48 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:31:51.233561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:51.237776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:51.315441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:51.317505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:51.318444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:51.322505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:51.323458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:51.329259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:53.809399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:53.846186 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f51eb75d-9600-4158-9d4f-257e9b0722b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 2.622936 Aug 25 13:31:53.851451 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2806/5547] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:51 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:54.101791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5", "tag": "46851aea-614c-451f-b034-511bf8b90a4c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:31:54.196315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:54.198042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:54.198244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:54.288583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] Creating event network-changed:46851aea-614c-451f-b034-511bf8b90a4c for instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 on n-h1-850468-18 Aug 25 13:31:54.302593 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b51f45ea-74f7-480f-b64b-e765258e98e1 req-bd27fba7-da5d-4181-9726-895a4246bbee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207883 Aug 25 13:31:54.304669 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2742/5548] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:31:54.894483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:54.895976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:54.930918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:54.931822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:54.937417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:54.939264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:54.944969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:54.946023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:55.539382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:55.573242 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b8abde3-0695-461a-a18d-e86767b3a9a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 0.689738 Aug 25 13:31:55.574822 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2807/5549] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:54 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:56.644686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:56.652072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:56.724360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:56.746296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:56.746887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:56.748157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:56.749018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:56.749914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:57.881626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:31:57.926067 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ea12cfb-894b-4eae-8dbc-f353331511ee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1228 microversion: 2.1 time: 1.314059 Aug 25 13:31:57.930436 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2743/5550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:56 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1228 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:31:58.976887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:31:58.980802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:31:59.008924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:59.016154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:59.017523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:59.022296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:31:59.023514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:31:59.027335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:31:59.983549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:00.029318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f90cd38-996b-49c4-be51-bc988bfac163 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.064627 Aug 25 13:32:00.036741 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2808/5551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:31:58 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:01.098644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:01.102142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:01.143846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:01.145564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:01.152846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:01.154784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:01.156900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:01.159701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:02.058708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:02.107636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0d3ace1-717c-4065-8991-5e96220e88b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.020532 Aug 25 13:32:02.110908 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2744/5552] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:01 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:03.157253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:03.160234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:03.224696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:03.247658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:03.250600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:03.255596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:03.257010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:03.260928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:03.686850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:03.713659 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61da3c97-48f9-4fad-b72c-4cd2572ca5e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 0.570550 Aug 25 13:32:03.742180 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2809/5553] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:03 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:32:04.754646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:04.765021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:04.798568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:04.800068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:04.801120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:04.802278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:04.803168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:04.803904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:06.124293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:06.183213 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b2a7b59-017d-4b5e-8e91-170e9c6faa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.436003 Aug 25 13:32:06.202862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2745/5554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:04 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:07.229247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:07.233784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:07.294164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:07.295376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:07.296282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:07.297713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:07.298648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:07.315249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:08.169923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:08.244814 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-849c89e9-765f-47e7-8fd2-7b2ed0650e7c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.013717 Aug 25 13:32:08.248360 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2810/5555] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:07 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:09.290844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:09.298503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:09.309657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:09.351835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:09.352939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:09.357349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:09.359001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:09.364068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:09.365636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:10.527254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:10.566008 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d99f84c8-5e4f-41ae-949a-7f10dcdbb411 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.282549 Aug 25 13:32:10.571877 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2746/5556] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:09 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:11.624565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:11.629797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:11.661105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:11.670046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:11.676942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:11.678139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:11.681363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:11.686811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:11.691087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:14.198014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:14.233044 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7206f876-145f-41d3-8252-2a6b2d1639c2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 2.614314 Aug 25 13:32:14.249671 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2811/5557] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:11 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:14.854664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5", "name": "network-vif-plugged", "status": "completed", "tag": "46851aea-614c-451f-b034-511bf8b90a4c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:14.961619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:14.965697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:14.972299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:15.039975 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] Creating event network-vif-plugged:46851aea-614c-451f-b034-511bf8b90a4c for instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 on n-h1-850468-18 Aug 25 13:32:15.061535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f8b057f9-1f62-4167-a378-f0d1acf8db6f req-601edd1b-4373-4dea-ad74-8546c1dcddb9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215589 Aug 25 13:32:15.066742 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2747/5558] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:15.316847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:15.318073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:15.409182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:15.411898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:15.418007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:15.425703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:15.428860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:15.432236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:16.905071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:16.920172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=46 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:16.927197 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa38e0ff-78f9-414e-8eb5-261456e06653 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1216 microversion: 2.1 time: 1.651262 Aug 25 13:32:16.930705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2812/5559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:15 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1216 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:17.988661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:17.990142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:18.023681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:18.024582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:18.025811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:18.026783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:18.027672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:18.028512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:19.004548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:19.064163 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e8b8425-c3b5-483b-ab18-2329e04aec57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1403 microversion: 2.1 time: 1.082771 Aug 25 13:32:19.067034 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2748/5560] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:17 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1403 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:19.115156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:19.128780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:19.154585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:19.155808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:19.157082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:19.161840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:19.162775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:19.168758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:20.130420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:20.162046 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d237ac0-98a4-492e-a6fd-8b0083895e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1403 microversion: 2.1 time: 1.056670 Aug 25 13:32:20.193104 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2813/5561] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:19 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1403 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:20.230441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1308281847"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:20.241649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:20.259222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:20.260905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:20.262945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:20.266520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:20.268791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:20.270239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:20.286196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:20.622630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.api [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Attempting to quiesce instance before volume snapshot. Aug 25 13:32:20.696726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.api [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 25 13:32:21.059406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Creating snapshot from volume 77701c52-4e2e-4589-84a0-b3c431e74fc5. {{(pid=122700) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 25 13:32:25.207555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9ac9b1f-b6b8-465d-9e76-056c9ee3a6d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5/action" status: 202 len: 0 microversion: 2.1 time: 4.986572 Aug 25 13:32:25.217045 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2749/5562] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:32:20 2022] POST /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5/action => generated 0 bytes in 4998 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 13:32:29.899923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:29.906283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:29.937383 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:32:29.940989 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb/os-server-password (ip 10.222.0.60) !!! Aug 25 13:32:29.950394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:29.969020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:29.971789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:29.983876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:29.987840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:30.008668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:30.011482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:30.015998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1137887791", "imageRef": "47c3409e-62e6-4377-b35a-b645f546ef10", "flavorRef": "452", "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:30.118146 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b1618ae-0bf4-405b-a7c1-815b9593994f tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.241575 Aug 25 13:32:30.119968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2814/5563] 10.222.0.60 () {58 vars in 1293 bytes} [Thu Aug 25 13:32:29 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb/os-server-password => generated 116 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:30.136323 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:32:30.143848 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:32:30.347191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:32:31.758025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:33.409941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:32:33.411067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:32:33.411721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:32:33.412588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:32:33.413392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:32:33.482364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:33.483958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:33.485168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:33.489305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:33.490641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:33.492401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:33.594906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:32:33.623531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:32:33.681495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:32:33.701170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4af71057-d3c5-4514-aa68-b9d494fa74c2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:32:34.098597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e00df99-c8fc-46e3-9665-64e8f599bfe7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.099689 Aug 25 13:32:34.109759 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2750/5564] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:32:34.133094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a306348c-8898-4511-addc-27b25a03c7c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:34.140435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a306348c-8898-4511-addc-27b25a03c7c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:34.854562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a306348c-8898-4511-addc-27b25a03c7c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:34.902235 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a306348c-8898-4511-addc-27b25a03c7c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1230 microversion: 2.1 time: 0.788581 Aug 25 13:32:34.927607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2815/5565] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:34 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1230 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:35.967405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e047e63-de45-47ed-bc53-e44ea8e77ef6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:35.977516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e047e63-de45-47ed-bc53-e44ea8e77ef6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:36.450317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e047e63-de45-47ed-bc53-e44ea8e77ef6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:36.478542 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e047e63-de45-47ed-bc53-e44ea8e77ef6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1230 microversion: 2.1 time: 0.531377 Aug 25 13:32:36.486270 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2751/5566] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:35 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1230 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:37.428696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1196236774", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:37.531142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:37.550757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:37.624242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:37.625294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:37.626667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:37.628071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:37.629042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:37.637085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:37.742231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] validate_networks() for [('38d4ef2a-3e30-4c28-871c-2b9f1a2cde52', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:32:38.129029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:38.172049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d5d3d9e-fd71-4e69-ac73-cc086df07e97 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1282 microversion: 2.1 time: 0.650095 Aug 25 13:32:38.174203 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2752/5567] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:37 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1282 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:32:39.233700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:39.238790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:39.294319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:39.299761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:39.312969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:39.314596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:39.320779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:39.325332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:40.109882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=11 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:41.035555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:41.072159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b72d8d92-052d-4090-bd7f-65c888567660 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1300 microversion: 2.1 time: 1.857845 Aug 25 13:32:41.074457 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2753/5568] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:39 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1300 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:42.179822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:42.197369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:42.239791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:42.272653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:42.273710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:42.274648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:42.276101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:42.286943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:42.287784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:43.000334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:43.042203 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab0b45bc-7f1a-43ed-96ad-e9df97f164b5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1300 microversion: 2.1 time: 0.925047 Aug 25 13:32:43.074272 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2754/5569] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:42 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1300 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:44.129937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:44.134507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:44.150305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:44.175717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:44.180944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:44.185027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:44.186604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:44.187794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:44.190416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:44.867612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:45.986989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:32:45.988037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:32:45.989079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:32:45.989956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:32:45.990786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:32:46.140389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:46.150523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:46.167843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:46.191402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:46.197982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:46.210838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:46.460176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Getting quotas for project 1be24bd017314d76af5fda9e51225f40. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:32:46.477158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:46.497938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Getting quotas for user ccf3ac67b5bd4ab5933e7e998c6e66f2 and project 1be24bd017314d76af5fda9e51225f40. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:32:46.606742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:32:46.627735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:32:47.000729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63ba0dea-4ada-4883-8cf0-f15a336a5677 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 10.246645 Aug 25 13:32:47.006179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2816/5570] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:32:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 10257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:32:47.032795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ede73a89-8702-4336-98a6-f5399fefb4d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:47.035195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ede73a89-8702-4336-98a6-f5399fefb4d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:47.872055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:47.918242 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6bc51814-55c1-499a-a8cd-8d1918292a92 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 3.819567 Aug 25 13:32:47.942010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2755/5571] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:44 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 3854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:32:47.951039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ede73a89-8702-4336-98a6-f5399fefb4d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:47.991191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ede73a89-8702-4336-98a6-f5399fefb4d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1223 microversion: 2.1 time: 0.974250 Aug 25 13:32:47.994708 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2817/5572] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:47 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1223 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:32:48.967549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:48.975743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:49.034399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:49.040297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:49.042567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:49.055373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c89a137f-4a5e-4fe5-8cfc-b811ae2b2d19 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:49.059470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c89a137f-4a5e-4fe5-8cfc-b811ae2b2d19 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:49.060248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:49.061347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:49.062255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:50.294267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c89a137f-4a5e-4fe5-8cfc-b811ae2b2d19 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:50.328445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c89a137f-4a5e-4fe5-8cfc-b811ae2b2d19 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1223 microversion: 2.1 time: 1.287663 Aug 25 13:32:50.334975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2818/5573] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:49 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1223 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:51.227715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986499ab-4d73-4a3c-9a05-845f7b41c5b6", "tag": "1a8084e9-ea3e-4ff8-896a-6344350cda33"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:32:51.352619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:51.358183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:51.368991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:51.566383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:51.637568 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] Creating event network-changed:1a8084e9-ea3e-4ff8-896a-6344350cda33 for instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 on n-h1-850468-18 Aug 25 13:32:51.664698 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2bcbdc1b-b3ed-45a3-b1fe-d409de81bd0c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 2.704670 Aug 25 13:32:51.668534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2756/5574] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:48 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:51.693035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:51.694900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:51.723392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:51.726346 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b88efc0d-8c60-4271-bbd1-290b504324d6 req-cb97c397-8ac7-408c-bf20-af97e89ea03f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.509409 Aug 25 13:32:51.727642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:51.729953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:51.732638 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2819/5575] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:32:51.734925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:51.740395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:51.741795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:52.291405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:52.418127 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9bed92d8-a5df-4645-91c0-f204f35b1879 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1283 microversion: 2.1 time: 0.731385 Aug 25 13:32:52.432903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2757/5576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:51 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1283 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:53.500089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:53.506088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:53.534984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:53.538394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:53.543392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:53.556665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:53.560853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:53.562261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:53.566638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:53.572517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:53.605633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:53.613598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:53.614856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:53.620600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:53.622021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:53.623306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:54.140139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:54.198839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac7aa242-abec-4d84-bcb3-84ef76fb57d9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1281 microversion: 2.1 time: 0.704354 Aug 25 13:32:54.211296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2758/5577] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:53 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1281 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:32:54.522719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:54.568702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d988b82-4ca7-4525-8a63-3d5971060cbb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.854100 Aug 25 13:32:54.575498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2820/5578] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:52 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:55.256014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:55.271229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:55.324770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:55.330695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:55.331951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:55.339003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:55.340488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:55.343735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:55.631892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:55.641216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:55.683951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:55.690579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:55.692670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:55.705260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:55.713119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:55.718922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:55.729606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:55.780068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-19f05723-1fc4-4065-a571-1fbcb12cb4c0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1281 microversion: 2.1 time: 0.531255 Aug 25 13:32:55.781516 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2759/5579] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:55 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:56.345970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:32:56.815204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:56.821806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:56.855802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:56.861014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:56.864595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:56.886975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:56.890522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:56.896480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:57.444878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:57.492084 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34796522-778c-48cd-a1d1-5c504495be69 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1281 microversion: 2.1 time: 0.686019 Aug 25 13:32:57.528279 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2760/5580] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:56 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1281 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:58.068652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:32:58.183070 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2866c8d-4c88-4079-a82d-3f569c6dcffb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 2.531359 Aug 25 13:32:58.185256 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2821/5581] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:55 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:32:58.565362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:58.583072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:58.609087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:58.610728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:58.615273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:58.617380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:58.618668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:58.620069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:59.250731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:32:59.276046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:32:59.311285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:59.322507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:59.324183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:32:59.333935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:32:59.335297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:32:59.336818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:00.311282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=10 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:01.416320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:01.482931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a509cb2-3e19-467f-965a-e8310ace945b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 2.949576 Aug 25 13:33:01.498999 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2761/5582] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:58 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 2967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:02.172776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:02.230231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c60f347f-4672-4afa-b2d6-caa11759488a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 3.004077 Aug 25 13:33:02.231356 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2822/5583] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:32:59 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:02.535478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:02.574406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:02.617193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:02.618170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:02.619368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:02.621125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:02.624303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:02.627550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:02.712809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=63 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:03.281232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:03.281913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:03.335580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:03.353471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:03.354840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:03.356095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:03.357956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:03.359247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:03.361263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:04.562697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:04.601418 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1786eab4-578b-47a9-ac2a-f765198bd9f2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 2.080017 Aug 25 13:33:04.613485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2762/5584] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:02 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:04.914599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:04.975474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0316008d-bdb8-4288-81c9-46cc56d248b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.702072 Aug 25 13:33:04.981006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2823/5585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:03 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:05.680298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:05.681650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:05.723791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:05.724893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:05.725839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:05.726758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:05.727902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:05.745388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:06.053536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:06.062183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:06.103225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:06.108106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:06.113388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:06.124208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:06.134341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:06.135917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:07.600743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:07.656349 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47c1204e-a729-4637-a881-5276ee342cd0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 1.987386 Aug 25 13:33:07.681294 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2763/5586] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:05 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:07.807149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:07.868785 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a683f2a-3528-49ed-a62c-d6f713f02fc9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.842997 Aug 25 13:33:07.899865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2824/5587] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:06 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:08.712973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:08.713598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:08.763632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.767731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.768825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.770307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:08.771266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:08.772175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:08.951088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:08.959882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:09.019895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:09.037026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:09.044856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:09.046407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:09.047346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:09.054355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:09.706616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:09.724939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-410907dc-161f-4c35-860c-f6f65bfef042 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 1.021026 Aug 25 13:33:09.726017 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2764/5588] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:08 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:10.034726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:10.090741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:10.092214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:10.105388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:10.157172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] Creating event network-changed:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:33:10.185903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-29c74997-d90e-4b8f-91d6-8cf19ba97a24 req-7b821e1c-56df-481f-9abd-0ff43a368c97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177735 Aug 25 13:33:10.196621 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2765/5589] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:33:10.387785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:10.413442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=39 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:10.427940 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-98f039ba-054c-4570-8fa1-76e0aa08bf3f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.486142 Aug 25 13:33:10.448158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2825/5590] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:08 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:10.777247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:10.781817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:10.809652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:10.811007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:10.815462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:10.825219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:10.827880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:10.838061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:11.479728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:11.481274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:11.535795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:11.549141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:11.564455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:11.564455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:11.564455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:11.564455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:12.182061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:12.293856 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f08842d-4ff3-423c-a1fb-7ecad057aa54 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 1.530591 Aug 25 13:33:12.300928 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2766/5591] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:10 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:12.666616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:12.696072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f13adb78-7627-4856-affc-d1ce9ee23dae tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.224605 Aug 25 13:33:12.705864 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2826/5592] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:11 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:13.347757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:13.353833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:13.387460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:13.406933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:13.411675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:13.415439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:13.418105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:13.420928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:13.425253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:13.754031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:13.758692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:13.812247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:13.814090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:13.819598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:13.821934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:13.822868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:13.823723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:14.651357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:14.707788 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2196feca-9e97-4677-b04c-a07aaad9bbc0 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 1.368369 Aug 25 13:33:14.715547 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2767/5593] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:13 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:15.074950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:15.114807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4025c59-9118-4589-b21e-2ec037efd6e9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.374894 Aug 25 13:33:15.120298 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2827/5594] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:13 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:15.773520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:15.786000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:15.841720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:15.848002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:15.861192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:15.863321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:15.876583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:15.882112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:16.161686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:16.164186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:16.211596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:16.214996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:16.217608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:16.226055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:16.228812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:16.231054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:17.780207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:17.815514 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6907214a-94a0-43a9-926a-65518085c331 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 2.063486 Aug 25 13:33:17.827076 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2768/5595] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:15 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:18.369262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:18.453144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a324cf70-2838-4e08-b553-6b2a09cd3912 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 2.298698 Aug 25 13:33:18.455952 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2828/5596] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:16 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:18.878080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:18.887399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:18.920233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:18.924745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:18.926236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:18.937419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:18.938407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:18.939636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:19.500361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:19.511203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:19.553539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:19.555126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:19.555951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:19.557401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:19.558273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:19.569322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:21.905828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:21.936554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23cfe903-7208-43d3-aa1d-631e087e2d8c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 2.446380 Aug 25 13:33:21.973570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:21.981034 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2829/5597] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:19 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:21.994715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61c1cedf-0be6-4d3c-93e0-0c1ffc7201ca tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 3.134186 Aug 25 13:33:21.996899 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2769/5598] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:18 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:22.517889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "name": "network-vif-plugged", "status": "completed", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:22.596593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:22.597553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:22.598346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:22.677069 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] Creating event network-vif-plugged:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:33:22.699083 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-966bfade-2922-4072-a333-574f0cad6571 req-4f92f91d-6eed-417d-841e-9aa522d4e582 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188164 Aug 25 13:33:22.700670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2830/5599] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:33:22.984512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:22.993542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:23.015387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:23.016409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:23.018747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:23.021649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:23.024655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:23.026196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:23.061356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:23.072920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:23.127539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:23.130256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:23.135305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:23.141007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:23.146295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:23.151217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:24.243733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:24.278376 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a8c316e-7920-4e1f-b106-18fc0aaa72fe tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1323 microversion: 2.1 time: 1.240096 Aug 25 13:33:24.282926 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2831/5600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:23 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1323 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:24.399151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:24.434053 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fdf1bf3-5ca0-47ad-8b3d-bafe5223b63e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.456861 Aug 25 13:33:24.448164 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2770/5601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:22 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:25.338655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:25.343673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:25.391255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.393361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.402044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.403794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.405164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.405990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.490812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:25.498619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:25.535909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.537855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.539289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:25.542266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:25.544644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:25.546888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:26.322140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:26.358739 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b610910e-5d3d-4241-953e-34124b87a033 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1517 microversion: 2.1 time: 1.033122 Aug 25 13:33:26.375351 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2832/5602] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:25 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1517 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:26.420206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:26.432817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:26.485979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:26.489792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:26.505745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:26.512667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:26.513546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:26.514379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:26.613198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:26.637890 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad6cc79a-5216-4be7-8130-198765fe8c81 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.163819 Aug 25 13:33:26.643083 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2771/5603] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:25 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:26.691160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lazy-loading 'flavor' on Instance uuid bff779a8-f913-4a36-be10-f26cd78828e8 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:33:27.110842 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-820326f9-fcfd-4bf5-b89f-9cb4b45f6262 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action" status: 200 len: 32 microversion: 2.1 time: 0.704581 Aug 25 13:33:27.132732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2833/5604] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:33:26 2022] POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action => generated 32 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 13:33:27.133397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:27.136149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:27.182154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.196653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.197319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:27.198895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.214690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.216638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:27.727781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:27.731263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:27.784249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.794255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.805386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:27.807474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:27.809389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:27.810886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:28.551326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:28.589457 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41a9031a-d071-4569-b580-d739fb23715e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.467935 Aug 25 13:33:28.590211 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2772/5605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:27 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:29.352463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:29.390271 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43e4b5d2-ecb6-41dc-9c4c-d6ad865afb6d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 1.712604 Aug 25 13:33:29.397186 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2834/5606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:27 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:29.642349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:29.656173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:29.709863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:29.716734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:29.718554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:29.720845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:29.724575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:29.728420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:30.483716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:30.488702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:30.552465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:30.554049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:30.556092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:30.571918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:30.589526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:30.590803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:31.040068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:31.103795 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-efe6cf89-22c3-4eac-8995-712230325646 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.459777 Aug 25 13:33:31.106300 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2773/5607] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:29 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:32.153272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:32.169365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:32.224023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:32.225383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:32.226695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:32.234389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:32.240390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:32.242553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:32.668675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:32.705635 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0187ede-5762-4c90-8ea8-7ed84e1647e1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 2.257856 Aug 25 13:33:32.730129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2835/5608] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:30 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:33.194214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:33.231198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=72 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:33.248770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d865d426-2630-42fa-b592-281727bbe307 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.101201 Aug 25 13:33:33.250057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2774/5609] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:32 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:33.748306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:33.749491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:33.787655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=26 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:33.790517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:33.791373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:33.801319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:33.802934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:33.804206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:33.807959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:34.173952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:34.198568 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-694ec8db-f30c-44dc-9f96-592f55b2dc56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 0.459048 Aug 25 13:33:34.199895 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2836/5610] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:33 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:34.313909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:34.315191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:34.341590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:34.343105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:34.345245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:34.347158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:34.348519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:34.349757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:34.761284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:34.776305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5b6180d-ae44-4360-8f4d-ac287b6615b7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 0.469532 Aug 25 13:33:34.793460 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2775/5611] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:34 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:35.254449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:35.255940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:35.301135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:35.302008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:35.302508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:35.304019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:35.305270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:35.306020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:35.827848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:35.829522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:35.871022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:35.878302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:35.881601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:35.883470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:35.909649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:35.917012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:36.038579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:36.090220 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bc377beb-d0d4-4665-a87f-4b7bcbb9f659 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1342 microversion: 2.1 time: 0.852738 Aug 25 13:33:36.091457 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2837/5612] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:35 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1342 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:36.969466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:36.996797 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dab17297-03e1-4403-b501-2b666e08ba7d tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.183274 Aug 25 13:33:37.004560 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2776/5613] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:35 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:37.138324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:37.140678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:37.154107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:37.155526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:37.156719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:37.158427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:37.159590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:37.160769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:38.036352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:38.040406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:38.078214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:38.079099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:38.079956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:38.087183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:38.088236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:38.093145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:38.230977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:38.305692 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8efa0b34-2cfb-4907-af2c-60b336437a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 1.171222 Aug 25 13:33:38.327456 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2838/5614] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:37 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:39.374537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:39.378952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:39.394341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:39.395551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:39.397817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:39.399605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:39.400963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:39.402148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:39.464345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:39.492424 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6517777e-ff73-49b5-8c23-87f2370d8106 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.465136 Aug 25 13:33:39.529445 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2777/5615] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:38 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:40.008466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:40.056910 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dfbfd017-f332-4bf6-ab19-36042f219559 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 0.696368 Aug 25 13:33:40.072174 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2839/5616] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:39 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:40.542719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:40.552704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:40.581628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:40.583041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:40.584535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:40.586647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:40.588512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:40.589972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:41.143842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:41.149159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:41.199757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:41.201297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:41.202396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:41.204452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:41.205726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:41.206732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:41.560034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:41.611671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d58e3b3-0aeb-4f11-baf7-53bcce30a1cb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.075472 Aug 25 13:33:41.616005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2778/5617] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:40 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:42.147397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:42.164043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:42.197726 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f67f09fe-94c2-47dd-808f-b2bd9831e298 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 1.081768 Aug 25 13:33:42.199226 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2840/5618] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:41 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:42.670429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:42.676632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:42.737569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:42.738536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:42.739326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:42.740707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:42.741950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:42.742818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:43.248605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:43.254357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:43.295863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:43.300365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:43.303858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:43.308018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:43.310668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:43.347004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:43.645125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:43.694707 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61289b3d-1dad-4270-99ef-6fad883c341c tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.041950 Aug 25 13:33:43.721683 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2779/5619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:42 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:44.019357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:44.040163 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e49179c-f5ed-4b93-9408-e21cc379780f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 0.812286 Aug 25 13:33:44.056809 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2841/5620] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:43 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:44.738732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:44.740354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:44.757302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:33:44.761121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:44.762974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:44.764569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:44.766548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:44.768256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:44.770157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:45.093482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:45.108954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:45.137195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:45.137195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:45.137195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:45.137195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:45.139010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:45.139010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:45.163367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:45.191503 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c2f147c-24c6-4771-933e-3bffd531947b tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 0.463172 Aug 25 13:33:45.196041 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2780/5621] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:44 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:45.722913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:45.757148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2259f6a9-67c7-4f09-862e-8c5aab43c299 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 0.682837 Aug 25 13:33:45.761028 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2842/5622] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:45 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:46.244257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:46.247368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:46.268193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:46.272616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:46.274190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:46.278690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:46.288850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:46.291285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:46.838060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:46.845278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:46.907508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:46.910667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:46.914419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:46.918949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:46.924783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:46.927151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:47.484473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:47.516476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4a04fa3-55ea-4afb-ac0f-ab25f270d982 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.289052 Aug 25 13:33:47.518529 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2781/5623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:46 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:47.796091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:47.822599 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da127812-cd3d-421f-8589-f5d5c459417b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 1.022842 Aug 25 13:33:47.838827 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2843/5624] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:46 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:48.572783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:48.580331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:48.612875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:48.621047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:48.625497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:48.627529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:48.628541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:48.632286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:48.873877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:48.874919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:48.973553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:48.981929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:48.983380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:48.990673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:48.995499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:49.002790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:50.607216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:50.675205 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-529b412a-3004-4141-acae-6dadef03346a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 2.116611 Aug 25 13:33:50.715146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2782/5625] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:48 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:50.882441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:50.930906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-18780ef5-7188-459f-90dd-5ad6dbfd650a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 2.067818 Aug 25 13:33:50.941134 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2844/5626] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:48 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:51.690158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986499ab-4d73-4a3c-9a05-845f7b41c5b6", "name": "network-vif-plugged", "status": "completed", "tag": "1a8084e9-ea3e-4ff8-896a-6344350cda33"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:33:51.732627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:51.741438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:51.749338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:51.754249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:51.755103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:51.795517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:51.799841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:51.800608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] Creating event network-vif-plugged:1a8084e9-ea3e-4ff8-896a-6344350cda33 for instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 on n-h1-850468-18 Aug 25 13:33:51.802081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:51.806163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:51.810513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:51.815120 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2e01b1ba-243c-4e02-a1ec-a7818efaae49 req-09f3bbe1-65f4-4139-bd28-d31ad30d32b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131608 Aug 25 13:33:51.815557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:51.830458 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2783/5627] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:33:51.988718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:51.998073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:52.047157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.065903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.065903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:52.065903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:52.067175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:52.067422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:53.635321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:53.650336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:53.691996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5cc254d-bce0-40d0-8710-9153806f1190 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.951358 Aug 25 13:33:53.700151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2845/5628] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:51 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:53.754815 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-721927f6-9c35-4a71-85f7-870b0a367a46 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1376 microversion: 2.1 time: 1.774497 Aug 25 13:33:53.762109 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2784/5629] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:51 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1376 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:54.744945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:54.756290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:54.778572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:54.785868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:54.787140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:54.788957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:54.797937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:54.800778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:54.801608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:54.802248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:54.837274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:54.846853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:54.849953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:54.851343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:54.855084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:54.856956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:55.382619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:55.416089 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-087c5990-1fe5-498d-8c61-c2e7ab95d016 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 0.679426 Aug 25 13:33:55.417264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2846/5630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:54 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:55.548308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:55.568356 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5ab394e7-5579-4e12-9504-bb2468c9c84e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1563 microversion: 2.1 time: 0.780138 Aug 25 13:33:55.570353 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2785/5631] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:54 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1563 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:33:55.620379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:55.624665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:55.670052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:55.671045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:55.671839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:55.673398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:55.682014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:55.686153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:56.218937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:56.248584 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4956a7d2-478a-4d7b-b988-ccd28e1d0e3c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1563 microversion: 2.1 time: 0.635286 Aug 25 13:33:56.251236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2847/5632] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:55 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1563 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:56.482917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:56.484402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:56.488226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:56.489800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:56.522306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:56.526660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:56.527383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:56.529980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:56.530858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:56.534118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:56.535238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:56.536204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:56.539573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:56.540149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:56.541372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:56.545268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:56.689726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:33:57.031577 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69b45247-0ba2-496d-ab8e-23d6b9f5784f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 204 len: 0 microversion: 2.1 time: 0.573695 Aug 25 13:33:57.046311 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2786/5633] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:33:56 2022] DELETE /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:33:57.061560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:57.068983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:57.088023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:57.090069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:57.091811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:57.093939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:57.096172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:57.097875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:58.255606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:58.289038 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51386389-320c-4b8a-bc88-578c25b9a2d8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1569 microversion: 2.1 time: 1.235610 Aug 25 13:33:58.292649 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2787/5634] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:57 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1569 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:58.454979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:33:58.490059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d353f3c9-7752-49f6-8b16-60a1531b5d8f tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 2.037220 Aug 25 13:33:58.496268 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2848/5635] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:56 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:33:59.346680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:59.352958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:59.396758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:59.403378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:59.408202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:59.412018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:59.415393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:59.417358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:59.533877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:33:59.542669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:33:59.585867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:59.595447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:59.602160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:33:59.604918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:33:59.606496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:33:59.611822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:00.520626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:00.566006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c8a391c7-7253-4c95-9941-6a4bc942424e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 1.031777 Aug 25 13:34:00.571290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2849/5636] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:59 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:00.601980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:00.680753 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2fff1c04-9d7a-4655-86bd-fbe5e44c3116 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1569 microversion: 2.1 time: 1.339807 Aug 25 13:34:00.683054 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2788/5637] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:33:59 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1569 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:01.626155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:01.632302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:01.675337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:01.678007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:01.680624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:01.686790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:01.690451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:01.691727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:01.728337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:01.732741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:01.764156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:01.771426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:01.772192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:01.773751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:01.774483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:01.775083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:03.530413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:03.572412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:03.605660 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34fe6795-06af-4fd0-9846-85881ba97053 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1523 microversion: 2.1 time: 2.004204 Aug 25 13:34:03.611839 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2850/5638] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:01 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1523 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:03.622155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d71e9404-beb5-4250-9e6f-9eea5353929f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1569 microversion: 2.1 time: 1.901565 Aug 25 13:34:03.624168 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2789/5639] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:01 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1569 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:04.070952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986499ab-4d73-4a3c-9a05-845f7b41c5b6", "name": "network-vif-deleted", "tag": "1a8084e9-ea3e-4ff8-896a-6344350cda33"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:04.113497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:04.181772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:04.195176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:04.196546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:04.282956 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] Creating event network-vif-deleted:1a8084e9-ea3e-4ff8-896a-6344350cda33 for instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 on n-h1-850468-18 Aug 25 13:34:04.314783 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f0b71696-d1ec-4a7c-a178-664c34c83438 req-ce31efb7-2525-4f0e-a75b-1389da1e8653 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311601 Aug 25 13:34:04.319908 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2851/5640] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:04.663674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:04.665299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:04.689585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:04.699296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:04.702325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:04.702697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:04.704037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:04.710337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:04.711109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:04.717417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:04.721369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:04.723343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:04.724829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:04.727316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:04.729225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:04.732760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:04.819209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:05.081861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:05.130155 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8c10fe7a-fe2b-4562-9f81-b36cb18302dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.451248 Aug 25 13:34:05.134852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2852/5641] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:04 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:05.314934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:05.349875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da9c662b-6444-49fc-ab22-62c8d999fcdb tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1503 microversion: 2.1 time: 0.697635 Aug 25 13:34:05.378007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2790/5642] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:04 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1503 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:05.397252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-133d0a9d-b3d4-44ff-9590-3e18751d3072 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'create', calling method: .version_select at 0x7fc6c1fc54c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-743090580", "description": "tempest-description-805715910"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:06.178986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:06.182983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:06.213612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:06.214962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:06.216256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:06.218034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:06.219904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:06.221438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:06.617428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:06.673699 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ef2ce6f-b350-4d86-b03f-a152b8b9fe0d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.505557 Aug 25 13:34:06.685844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2791/5643] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:06 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:06.924056 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-133d0a9d-b3d4-44ff-9590-3e18751d3072 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.535955 Aug 25 13:34:06.927905 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2853/5644] 10.222.0.60 () {60 vars in 1180 bytes} [Thu Aug 25 13:34:05 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:06.956792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-743090580"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:06.957958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:06.986797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:06.991329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:06.992867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:06.995650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:06.997178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:06.999514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:07.713764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:07.714891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:07.729587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:07.730482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:07.731281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:07.732648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:07.733846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:07.735246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:07.888840 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Adding security group 3ddc7288-fde1-47f2-89a7-3adb5bc40dd6 to port 22d33fcf-fe26-49a9-b95a-db007146a73e Aug 25 13:34:07.981296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:07.999527 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3ef8237-3361-415d-8186-fc3a4e5a7929 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.294276 Aug 25 13:34:08.005236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2854/5645] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:07 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:09.053775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:09.064077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:09.101870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:09.102909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:09.103547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:09.121971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:09.122911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:09.123766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:09.411647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:09.477658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a453d654-ddc1-4fff-ac11-abb6402b3ed4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.421638 Aug 25 13:34:09.501818 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2855/5646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:09 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:09.800573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6ec040e-48d6-48ea-b88b-37f8e94e9335 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action" status: 202 len: 0 microversion: 2.1 time: 2.854632 Aug 25 13:34:09.802099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2792/5647] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:34:06 2022] POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action => generated 0 bytes in 2858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:34:09.817323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-743090580"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:09.824260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:09.837977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:09.865363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:09.869346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:09.870611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:09.874726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:09.882222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:09.883487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:09.900885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:09.912059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:09.913326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:09.964306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] Creating event network-changed:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:34:09.980448 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-efff9a06-ab62-45af-9be4-1f3d7b040aa5 req-ff4d7489-660d-40f8-aed5-396403a5fc63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149055 Aug 25 13:34:09.989399 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2793/5648] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:34:10.519194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:10.540900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:10.577903 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:34:10.578974 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 (ip 10.222.0.60) !!! Aug 25 13:34:10.605595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:10.606804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:10.607652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:10.609050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:10.610501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:10.611800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:10.942163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:10.984285 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9438071-fa2c-4176-9e9f-d397152e72ec tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.473373 Aug 25 13:34:10.999563 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2794/5649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:10 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:11.239878 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.network.security_group_api [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Removing security group 3ddc7288-fde1-47f2-89a7-3adb5bc40dd6 from port 22d33fcf-fe26-49a9-b95a-db007146a73e Aug 25 13:34:12.034893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:12.045820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:12.073200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:12.075005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:12.076258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:12.078084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:12.079806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:12.085916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:12.394315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:12.426220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a35fe1d3-ab0a-4dc5-9941-e37193f132d9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.399647 Aug 25 13:34:12.440736 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2795/5650] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:12 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:13.472024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:13.481751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:13.508091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:13.514660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:13.517063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:13.519073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:13.525340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:13.527460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:14.040570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:14.060109 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a7d38d8e-28be-4c4a-82a1-583bfc01f8af tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.598381 Aug 25 13:34:14.096636 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2796/5651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:13 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:14.165838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96254280-d138-4b84-bd08-2b8885db33b1 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action" status: 202 len: 0 microversion: 2.1 time: 4.357180 Aug 25 13:34:14.166789 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2856/5652] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:34:09 2022] POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action => generated 0 bytes in 4359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:34:14.182937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7eec6f5-ba15-465b-a4ea-8fcf20beb798 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'create', calling method: .version_select at 0x7fc6c2e5e3a0>, body: {"pool": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:14.227462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:14.278074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:14.279350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:14.280519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:14.305906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=86 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:14.310279 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] Creating event network-changed:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:34:14.323824 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-35965ea2-499a-4bd9-b8ab-236e5180a952 req-8fc38073-45f9-4021-b029-b6ff32d1c3b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102160 Aug 25 13:34:14.326049 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2857/5653] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:15.119873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:15.131629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:15.190132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:15.191296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:15.192332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:15.201716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:15.209289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:15.210297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:15.874406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:15.912336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56cb3e6c-d407-4a5d-9d0d-ec2b8e8b6b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.797872 Aug 25 13:34:15.917224 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2858/5654] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:15 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:16.970745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:16.974973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:17.017472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:17.024770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:17.027541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:17.032931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:17.034678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:17.038042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:17.543839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:17.616491 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bedd6ddb-5ba9-444c-b8b7-f0332164bc2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1361 microversion: 2.1 time: 0.657194 Aug 25 13:34:17.617559 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2859/5655] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:16 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1361 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:18.660506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:18.669821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:18.726706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:18.727638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:18.728528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:18.733852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:18.740572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:18.744014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:19.067852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:19.093849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:19.093849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:19.093849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lazy-loading 'fault' on Instance uuid 986499ab-4d73-4a3c-9a05-845f7b41c5b6 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:34:19.723544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:19.745886 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8c3962c-412a-46c3-bdd4-458787395d6a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 200 len: 1320 microversion: 2.1 time: 1.093684 Aug 25 13:34:19.748103 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2860/5656] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:18 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 1320 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:20.800364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:20.808268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:20.844100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:20.845725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:20.847277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:20.851484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:20.853020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:20.854354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:20.888938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 HTTP/1.1 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '986499ab-4d73-4a3c-9a05-845f7b41c5b6'} Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:20.894861 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:34:20.915621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:34:20.919528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:20.922015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b8b4480-f456-4b6e-b42b-57681b5f9651 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 404 len: 111 microversion: 2.1 time: 0.131335 Aug 25 13:34:20.924396 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2861/5657] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:20 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:34:23.498853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:23.595642 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7eec6f5-ba15-465b-a4ea-8fcf20beb798 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.418201 Aug 25 13:34:23.595852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2797/5658] 10.222.0.60 () {60 vars in 1170 bytes} [Thu Aug 25 13:34:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:23.619255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:23.623748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:23.683122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:23.689725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:23.693309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:23.706757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:23.706757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:23.718801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:23.818619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:34:23.824761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquired lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:34:30.379393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Building network info cache for instance {{(pid=122701) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 13:34:30.401045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:30.442153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=35 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:30.465965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:30.467649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:30.476923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:30.555865 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] Creating event network-changed:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:34:30.603068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-da3720d0-b5b0-4d83-a463-064723c3aca8 req-f699ea60-8892-445f-861d-f540bef525c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209086 Aug 25 13:34:30.604791 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2798/5659] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:33.686262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=23 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:36.213708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Updating instance_info_cache with network_info: [{"id": "22d33fcf-fe26-49a9-b95a-db007146a73e", "address": "fa:16:3e:8f:82:f9", "network": {"id": "38d4ef2a-3e30-4c28-871c-2b9f1a2cde52", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-987735407-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1be24bd017314d76af5fda9e51225f40", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap22d33fcf-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122701) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:34:36.287421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Releasing lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122701) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:34:36.289555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02ee6cb8-eadb-4c15-a4db-61b57cc49fa2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action" status: 202 len: 0 microversion: 2.1 time: 12.677787 Aug 25 13:34:36.291720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2862/5660] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:34:23 2022] POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action => generated 0 bytes in 12681 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 13:34:36.320783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:37.030770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:37.034370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:37.039607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:37.062480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.063885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.068648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:37.070262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.071984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.072492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.072934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.074126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:37.076271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.079197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.079671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:37.081122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:37.277440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:34:37.612940 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d421e0c-c03e-4524-9701-dbf70596679c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 204 len: 0 microversion: 2.1 time: 0.594909 Aug 25 13:34:37.616979 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2863/5661] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:34:37 2022] DELETE /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:34:37.646259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:37.655866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:37.686895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.697688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.698572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:37.704901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:37.708109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:37.714269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:38.587920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:38.628644 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-def08aba-1f37-496c-b7a0-16f364862296 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1409 microversion: 2.1 time: 0.991452 Aug 25 13:34:38.630354 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2864/5662] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:37 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1409 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:38.787658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 13:34:38.788486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquired lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 13:34:39.676401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:39.679822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:39.709991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:39.711315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:39.712749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:39.714441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:39.716312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:39.717297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:40.787581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:40.836806 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95b7cad9-a7e9-4ccd-bad6-a8fe8ea39bd4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1409 microversion: 2.1 time: 1.166920 Aug 25 13:34:40.845726 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2865/5663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:39 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1409 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:41.897212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:41.900003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:41.922351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:41.925372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:41.930915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:41.932846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:41.934342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:41.936491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:42.429209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Building network info cache for instance {{(pid=122700) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 25 13:34:43.325638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:43.360299 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62c9f476-6027-4157-98c0-35f9755a8efc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1409 microversion: 2.1 time: 1.471893 Aug 25 13:34:43.361761 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2866/5664] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:41 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1409 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:43.377519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70b116ad-2cd3-42c3-8f99-6445c76327f8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: .version_select at 0x7fc6c1ffa4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-224760319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpY8+cv+QiMKn/MAtZ8yAcW4AfK4j0TrnX2ooOpSTrRv1FhDSIqpNl4qXALNa2dXboJtPcw80Ezk9JVtCpjczg1BplbfSZA3CxAL9/VDk7j6Bk3yNegXrGMEWMqV1bnYg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:43.451393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-70b116ad-2cd3-42c3-8f99-6445c76327f8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:34:43.478324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-70b116ad-2cd3-42c3-8f99-6445c76327f8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:34:43.557428 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70b116ad-2cd3-42c3-8f99-6445c76327f8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.192572 Aug 25 13:34:43.559621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2867/5665] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:34:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:43.600198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-33051863", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:43.743811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:34:46.277291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:34:46.278225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:34:46.279042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:34:46.279857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:34:46.285362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:34:46.343512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:46.348891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:46.349813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:46.351051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:46.352765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:46.355871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:46.410322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=64,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:46.501743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Getting quotas for project 2c3e14ac71924855954f71f20525e99b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:34:46.545128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Getting quotas for user ea947f38069344bca9b75897b9a826cc and project 2c3e14ac71924855954f71f20525e99b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:34:46.643996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:34:46.658888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:34:46.903774 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ec71071-1dfe-41d0-96dc-7d6ca4d2a3f0 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.336957 Aug 25 13:34:46.905033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2868/5666] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:34:46.939583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:47.030829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:47.057206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:47.066941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:47.069428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:47.139360 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] Creating event network-changed:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:34:47.170992 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-29b2f503-b5aa-4008-a678-a2bd36fe8513 req-937eb1e1-19c4-456b-b085-09ad88c30fc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257793 Aug 25 13:34:47.173289 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2869/5667] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:47.273909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Updating instance_info_cache with network_info: [{"id": "22d33fcf-fe26-49a9-b95a-db007146a73e", "address": "fa:16:3e:8f:82:f9", "network": {"id": "38d4ef2a-3e30-4c28-871c-2b9f1a2cde52", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-987735407-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1be24bd017314d76af5fda9e51225f40", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap22d33fcf-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122700) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 25 13:34:47.328262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Releasing lock "refresh_cache-bff779a8-f913-4a36-be10-f26cd78828e8" {{(pid=122700) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 13:34:47.330139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2fe85c86-7869-4818-8cd1-38f00e2c947a tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action" status: 202 len: 0 microversion: 2.1 time: 11.030060 Aug 25 13:34:47.331249 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2799/5668] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:34:36 2022] POST /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8/action => generated 0 bytes in 11033 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 25 13:34:47.353649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:47.365966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:47.431931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:47.438343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:47.443525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:47.445155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:47.454824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:47.456051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:47.871158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:47.934506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-945eb4de-5f33-4688-b5a3-83709232cc82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.589041 Aug 25 13:34:47.945579 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2800/5669] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:47 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:47.986932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-efa50bec-0165-4dd2-8ffb-61dbdb714176 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:47.987949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-efa50bec-0165-4dd2-8ffb-61dbdb714176 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:48.439173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-efa50bec-0165-4dd2-8ffb-61dbdb714176 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:48.488249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-efa50bec-0165-4dd2-8ffb-61dbdb714176 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1213 microversion: 2.1 time: 0.539649 Aug 25 13:34:48.489484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2801/5670] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:47 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1213 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:48.534386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56700f1f-6433-43a8-806e-b6784cdf06c9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '.version_select at 0x7fc6c6cc5a60>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:48.575925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5", "name": "network-vif-deleted", "tag": "46851aea-614c-451f-b034-511bf8b90a4c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:48.658879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:48.663410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:48.669034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:48.757828 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] Creating event network-vif-deleted:46851aea-614c-451f-b034-511bf8b90a4c for instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 on n-h1-850468-18 Aug 25 13:34:48.776416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e557f5fa-6741-4a1b-a0c8-f084a1866678 req-5ca6e141-c375-449d-a82f-62c2f2f65f46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.600229 Aug 25 13:34:48.792629 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2870/5671] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:34:48.990815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:48.993280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:49.026521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:49.027661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:49.028719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:49.030207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:49.031167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:49.032954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:49.421679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:49.452195 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f28f46d7-7b67-4ce3-bc94-90938a6ec416 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.472219 Aug 25 13:34:49.454208 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2871/5672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:48 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:49.528008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:49.529439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:49.553359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:49.554020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:49.554548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:49.555587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:49.563980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:49.564850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:50.020469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:50.063047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa8641e5-eebd-41dd-9ab4-4c5e485c7e6f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1217 microversion: 2.1 time: 0.540118 Aug 25 13:34:50.072539 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2872/5673] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:49 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1217 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:50.500432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:50.503631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:50.540150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:50.545597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:50.548052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:50.550765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:50.553215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:50.556203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:50.802044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:50.833193 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01268878-1195-4b2e-a1f4-3f945b63bde5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.340266 Aug 25 13:34:50.843061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2873/5674] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:50 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:51.109751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:51.111199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:51.163520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:51.174383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:51.175585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:51.177291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:51.178445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:51.179272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:51.499228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:51.546311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-22e78319-4f50-4494-bf21-ff9841358b13 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1283 microversion: 2.1 time: 0.444186 Aug 25 13:34:51.553683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2874/5675] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:51 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1283 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:51.895070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:51.898221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:51.910542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:51.911252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:51.912360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:51.913530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:51.914647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:51.916556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:51.991198 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56700f1f-6433-43a8-806e-b6784cdf06c9 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "DELETE /compute/v2.1/os-floating-ips/0c21d75d-46bc-4b92-93eb-5f8aaa46e74f" status: 202 len: 0 microversion: 2.1 time: 3.471413 Aug 25 13:34:51.992664 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2802/5676] 10.222.0.60 () {58 vars in 1263 bytes} [Thu Aug 25 13:34:48 2022] DELETE /compute/v2.1/os-floating-ips/0c21d75d-46bc-4b92-93eb-5f8aaa46e74f => generated 0 bytes in 3503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:34:52.007788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13c2694a-474f-4e17-9537-fe3dfa04a5f6 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '.version_select at 0x7fc6c6cc53a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:52.122513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:52.153547 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-06af6773-fa58-4cbf-9676-36960e8a3242 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.273014 Aug 25 13:34:52.160957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2875/5677] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:51 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:52.593208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:52.597914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:52.622493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.626042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.629709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:52.631336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.634358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.636198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:52.862156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:52.879013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a00774d-3f06-4d1c-8cba-036100c66bee tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1271 microversion: 2.1 time: 0.293150 Aug 25 13:34:52.880728 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2876/5678] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:52 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:52.902970 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13c2694a-474f-4e17-9537-fe3dfa04a5f6 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "DELETE /compute/v2.1/os-security-groups/3ddc7288-fde1-47f2-89a7-3adb5bc40dd6" status: 202 len: 0 microversion: 2.1 time: 0.901582 Aug 25 13:34:52.907833 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2803/5679] 10.222.0.60 () {58 vars in 1272 bytes} [Thu Aug 25 13:34:51 2022] DELETE /compute/v2.1/os-security-groups/3ddc7288-fde1-47f2-89a7-3adb5bc40dd6 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:34:52.921096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:52.927901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:52.944158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.956868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.958023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:52.959563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:52.961449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:52.962593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:53.056233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:34:53.203770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:53.217358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:53.239760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:53.241563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:53.242644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:53.244389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:53.245478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:53.248430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:53.320477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6163994-7f28-4e52-9186-50d2af77157e tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 204 len: 0 microversion: 2.1 time: 0.407071 Aug 25 13:34:53.326068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2877/5680] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:34:52 2022] DELETE /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:34:53.342525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:53.347252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:53.377372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:53.378281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:53.379117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:53.380466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:53.383738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:53.387640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:53.525375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:53.598453 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71194cf1-3d69-4894-a774-08136f611d79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.404725 Aug 25 13:34:53.602511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2804/5681] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:53 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:53.778174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-436329536", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "2770b2d0-42bb-42b9-806b-4fc9db85af82"}], "key_name": "tempest-TestNetworkBasicOps-224760319", "security_groups": [{"name": "tempest-secgroup-smoke-821396489"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:54.073988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:54.113021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c23b8f83-6604-45e5-aeb8-7922de386fc7 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1509 microversion: 2.1 time: 0.778716 Aug 25 13:34:54.114585 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2878/5682] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:53 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1509 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:54.132594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:54.133622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:54.153926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:54.155117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:54.156759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:54.158352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:54.159797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:54.161422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:54.166436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] validate_networks() for [('2770b2d0-42bb-42b9-806b-4fc9db85af82', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:34:54.833787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:54.877693 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7be1c774-2421-480d-b864-d2ce7e447a10 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 0.760555 Aug 25 13:34:54.892378 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2879/5683] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:54 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:54.914947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:54.916211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:54.928612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:54.929538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:54.930363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:54.931894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:54.932550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:54.933405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.136766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:55.170978 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-058d0fa8-e7f5-43c7-804b-79154542e6c7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.276065 Aug 25 13:34:55.174128 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2880/5684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:54 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:55.204268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:55.206861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:55.223316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.224687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.225715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.228098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.230658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.231713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.451315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:34:55.456201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:34:55.458461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:34:55.460848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:34:55.462307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:34:55.489244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.491462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.493180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.495386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.497743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.499018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:55.553363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:34:55.567477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:34:55.603992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:34:55.608556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:55.611714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:34:55.629402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67b0705c-b7cf-491d-8ee0-55d3c07bdeef tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1509 microversion: 2.1 time: 0.436751 Aug 25 13:34:55.633795 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2881/5685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:55 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:55.760156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-467ec39b-f231-4276-a199-6d75434258af tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.990227 Aug 25 13:34:55.762469 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2805/5686] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:34:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:34:55.781007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e53b3b2-4a4b-4d2c-93ef-2108b769e3d6 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:55.782528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e53b3b2-4a4b-4d2c-93ef-2108b769e3d6 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:55.895842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e53b3b2-4a4b-4d2c-93ef-2108b769e3d6 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:55.914688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e53b3b2-4a4b-4d2c-93ef-2108b769e3d6 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1247 microversion: 2.1 time: 0.140425 Aug 25 13:34:55.922218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:55.936405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:55.937843 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2882/5687] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:55 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1247 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:55.975667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:55.990035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:55.997733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.002146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.003569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.005179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.234641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.237646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:56.293243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.294066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.295968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.299623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.300797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.302011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.414204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:34:56.533093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:56.576430 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-991fea97-33f1-4431-93fc-31bf9e9a9a7f tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 0.663579 Aug 25 13:34:56.584043 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2806/5688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:55 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:56.690581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.693970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:56.715769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.717968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.719594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.723694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:56.727032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:56.728960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:56.745585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:56.824396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea2cfcd1-901d-45b6-bfdd-0daa4f82f4fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 200 len: 1201 microversion: 2.1 time: 0.603722 Aug 25 13:34:56.830737 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2883/5689] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:56 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 1201 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:56.975445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7cb611ac-f93f-4f36-b999-a4ed1287964c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:56.982907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7cb611ac-f93f-4f36-b999-a4ed1287964c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:57.459315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7cb611ac-f93f-4f36-b999-a4ed1287964c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:57.488776 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7cb611ac-f93f-4f36-b999-a4ed1287964c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1247 microversion: 2.1 time: 0.536892 Aug 25 13:34:57.489914 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2884/5690] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:56 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1247 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:57.514024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:57.539062 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf2d1506-8df6-49f1-bd80-21aacde195d2 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1509 microversion: 2.1 time: 0.866937 Aug 25 13:34:57.541826 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2807/5691] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:56 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1509 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:57.626367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:57.633243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:57.648323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:57.649669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:57.650949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:57.654115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:57.655256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:57.657653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:57.871723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:57.876102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:57.897408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:57.898321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:57.899150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:57.905009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:57.906165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:57.906984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:57.971904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 HTTP/1.1 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5'} Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:34:57.975317 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:34:57.983440 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bcc734a8-8fc8-43bb-bddd-3bb751ceaf2c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 404 len: 111 microversion: 2.1 time: 0.116570 Aug 25 13:34:58.004667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2808/5692] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:57 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:34:58.533629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:58.535446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:58.551990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:58.554565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:58.557321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:58.559836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:58.561232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:58.562713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:59.172160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:59.227418 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f62de05-7bb4-43fc-bcf8-de4c2e17d76b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1299 microversion: 2.1 time: 0.701981 Aug 25 13:34:59.235759 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2809/5693] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:58 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1299 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:59.254582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:34:59.256516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:34:59.313624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:59.315055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:59.316041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:59.317980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:59.322595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:59.324256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:34:59.544932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:59.590928 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c66a1f5c-9148-472b-9ae2-23f35a533b0b tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 1.970296 Aug 25 13:34:59.591144 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2885/5694] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:57 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:34:59.667164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:34:59.703783 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7bb39b2f-2053-4af9-8a2b-cef82ec24d75 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1467 microversion: 2.1 time: 0.464411 Aug 25 13:34:59.709007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2810/5695] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:34:59 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1467 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:34:59.860006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff779a8-f913-4a36-be10-f26cd78828e8", "name": "network-vif-deleted", "tag": "22d33fcf-fe26-49a9-b95a-db007146a73e"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:34:59.935274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:34:59.936520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:34:59.938036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.017054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] Creating event network-vif-deleted:22d33fcf-fe26-49a9-b95a-db007146a73e for instance bff779a8-f913-4a36-be10-f26cd78828e8 on n-h1-850468-18 Aug 25 13:35:00.050639 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bc4e4705-f2ec-4434-99eb-ce73e2d2ffcc req-6c05f3ab-5822-45bd-93b1-06457fb26122 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196608 Aug 25 13:35:00.052202 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2886/5696] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:00.282900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:00.286629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:00.336726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.337605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.338662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.339964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.340831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.357386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.644478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:00.646702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:00.678952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.680047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.680993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.682718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.683759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.690112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.841129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:00.866498 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8cd69561-5de2-4302-8f78-2dac078297f0 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1305 microversion: 2.1 time: 0.594904 Aug 25 13:35:00.875938 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2811/5697] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:00 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1305 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:00.901350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:00.903500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:00.949904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.957150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.960682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:00.965902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:00.966895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:00.969590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:01.100491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:01.101724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:01.102752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:01.104040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lazy-loading 'fault' on Instance uuid bff779a8-f913-4a36-be10-f26cd78828e8 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:35:01.685560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf3ac67b5bd4ab5933e7e998c6e66f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be24bd017314d76af5fda9e51225f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:01.733439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bfec83f7-955d-4041-9f42-0a63cf8e1650 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 200 len: 1313 microversion: 2.1 time: 0.854964 Aug 25 13:35:01.743131 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2812/5698] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:00 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:01.927349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:01.929368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:01.949083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:01.952025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:01.959193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:01.961071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:01.963329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:01.965014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:02.307059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:02.326478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:02.352597 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31709527-a83b-4847-b7ce-5ec283da94db tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 1.719635 Aug 25 13:35:02.359868 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2887/5699] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:00 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:02.380047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df1ea29-51fc-4442-a786-08cdb1a040ed", "tag": "211e57c7-62b6-4424-8351-b87a0f71394b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:02.410655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:02.411881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:02.413205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:02.455728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] Creating event network-changed:211e57c7-62b6-4424-8351-b87a0f71394b for instance 7df1ea29-51fc-4442-a786-08cdb1a040ed on n-h1-850468-18 Aug 25 13:35:02.469361 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-40351965-47a1-4019-a20b-b4613fb617db req-2c296eae-8092-4509-9a5f-e70fdd34589e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105525 Aug 25 13:35:02.475907 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2888/5700] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:02.530180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:02.554825 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fee62197-7893-4c2b-bb4c-d0186760c2e4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1305 microversion: 2.1 time: 0.636632 Aug 25 13:35:02.585216 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2813/5701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:01 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1305 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:02.797141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:02.799339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] [instance: bff779a8-f913-4a36-be10-f26cd78828e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:02.820162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:02.822340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:02.824806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:02.828045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:02.829688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:02.831148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:02.892107 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] HTTP exception thrown: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Request method failure captured: Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 HTTP/1.1 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3n0me7OKnVf3-aXi-KwoV13VDj9GH5DT0s_3WaTjQl7fL_72z1klIk9-SzyQXoij_1i0ch-pxrs4cdo_ZbTv6o2YxGvD4hQfEi1xKbMi7wH491nhC2SQFygwr2QBpkydx8Get2-tYLq-KDKRbAsceBFL5JDb9hARkvaLIJsF_fzlaM Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 1be24bd017314d76af5fda9e51225f40 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-662232276 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1be24bd017314d76af5fda9e51225f40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1be24bd017314d76af5fda9e51225f40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be24bd017314d76af5fda9e51225f40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1be24bd017314d76af5fda9e51225f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-662232276 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 1be24bd017314d76af5fda9e51225f40 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-662232276 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerRescueTestJSONUnderV235-662232276-project Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: ccf3ac67b5bd4ab5933e7e998c6e66f2 Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-662232276-project Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'bff779a8-f913-4a36-be10-f26cd78828e8'} Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:02.900100 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. Aug 25 13:35:02.907176 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:02.911788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] Returning 404 to user: Instance bff779a8-f913-4a36-be10-f26cd78828e8 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:02.917017 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c33d15ae-1357-41e7-b8f0-c131664cb9b3 tempest-ServerRescueTestJSONUnderV235-662232276 tempest-ServerRescueTestJSONUnderV235-662232276-project] 10.222.0.60 "GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8" status: 404 len: 111 microversion: 2.1 time: 0.136309 Aug 25 13:35:02.918718 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2889/5702] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:02 2022] GET /compute/v2.1/servers/bff779a8-f913-4a36-be10-f26cd78828e8 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:03.402771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:03.407883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:03.428580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.429996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.431130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:03.432808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.433983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.435108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:03.609714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:03.612592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:03.627526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.628771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.629709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:03.631310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:03.633156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:03.634972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:03.934003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:03.959458 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-889e5b88-1a1d-44d1-b58b-0e10a0e26cba tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1305 microversion: 2.1 time: 0.363280 Aug 25 13:35:03.974365 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2890/5703] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:03 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1305 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:04.226609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:04.250044 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12be2fb7-32b7-4e31-8c55-450f4ca78060 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 0.854307 Aug 25 13:35:04.251065 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2814/5704] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:03 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:04.998527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:05.001259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:05.027306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:05.050732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.052406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.053843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.055682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.057361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.058683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.298170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:05.303464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:05.339031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.340205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.341630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.343930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:05.345359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:05.346629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:05.529969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:05.588503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:05.832191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:05.851521 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db6ab386-53df-45d2-b0b7-dd10d06e2a5c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 0.860376 Aug 25 13:35:05.868154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2891/5705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:04 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:06.208938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:06.254516 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c5f928b-a176-42f4-a065-ba640bff970e tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 0.961391 Aug 25 13:35:06.256481 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2815/5706] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:05 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:06.898120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:06.909770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:06.923991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:06.944881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:06.946163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:06.947886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:06.957413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:06.958604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.307751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:07.314001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:07.344632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:07.346289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:07.353150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.355179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:07.356462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:07.363218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:07.383694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:07.467254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=14 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:08.490389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:08.541442 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e5773dc4-e895-4f53-bda7-bb8190711b3c tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 1.241693 Aug 25 13:35:08.569705 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2816/5707] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:07 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:08.669145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:08.710749 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b86df0b0-ca6c-48a4-8c3b-359053df529e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.820647 Aug 25 13:35:08.744254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2892/5708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:06 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:09.587720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:09.588964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:09.610031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.610789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.621256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:09.622757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.623800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.625405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:09.770966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:09.777083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:09.807009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.807619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.808338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:09.811260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:09.812519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:09.821316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:10.987202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:11.044630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e9eb24c-9b23-4fd0-926c-f47c1540d63a tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 1.462454 Aug 25 13:35:11.046722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2817/5709] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:09 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:11.443403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:11.455509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:11.495497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.498910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.503731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.505632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.511575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.514854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.587832 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 HTTP/1.1 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '986499ab-4d73-4a3c-9a05-845f7b41c5b6'} Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:11.599163 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.605381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:11.608349 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acd19b6a-f8e8-4480-be69-4f9e4a003881 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 404 len: 111 microversion: 2.1 time: 0.190482 Aug 25 13:35:11.615078 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2818/5710] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:35:11 2022] DELETE /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:35:11.625380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:11.635181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:11.640738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 986499ab-4d73-4a3c-9a05-845f7b41c5b6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:11.670654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.679459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.682348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.686260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:11.686516 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a07b688f-9fc2-4a4c-95cd-139367cab69d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.919444 Aug 25 13:35:11.687889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:11.697324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:11.707872 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2893/5711] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:09 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:11.832486 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 HTTP/1.1 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '986499ab-4d73-4a3c-9a05-845f7b41c5b6'} Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:11.837152 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. Aug 25 13:35:11.845649 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:11.848588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 986499ab-4d73-4a3c-9a05-845f7b41c5b6 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:11.855687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c595633b-36c5-4869-94fb-0c7d2b655658 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6" status: 404 len: 111 microversion: 2.1 time: 0.237309 Aug 25 13:35:11.864824 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2819/5712] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:11 2022] GET /compute/v2.1/servers/986499ab-4d73-4a3c-9a05-845f7b41c5b6 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:12.022988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0c0c40-0638-45f6-9ad5-501b32f493f1", "tag": "fea494dd-d600-4269-885f-c69cd057bc0c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:12.081871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.085664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.088653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:12.153935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] Creating event network-changed:fea494dd-d600-4269-885f-c69cd057bc0c for instance db0c0c40-0638-45f6-9ad5-501b32f493f1 on n-h1-850468-18 Aug 25 13:35:12.182297 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2c888da9-e0d6-41a7-bcec-076c812fcae9 req-d67bd375-74d7-469d-b617-0d0b5841fccc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165755 Aug 25 13:35:12.200439 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2820/5713] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:12.226554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:12.237844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:12.276476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.286449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.291190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:12.293109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.294627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.298329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:12.379659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df1ea29-51fc-4442-a786-08cdb1a040ed", "name": "network-vif-plugged", "status": "completed", "tag": "211e57c7-62b6-4424-8351-b87a0f71394b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:12.436340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.438158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.439396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:12.496097 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] Creating event network-vif-plugged:211e57c7-62b6-4424-8351-b87a0f71394b for instance 7df1ea29-51fc-4442-a786-08cdb1a040ed on n-h1-850468-18 Aug 25 13:35:12.507670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-17c1d7f2-9bc6-41fe-92af-b1a6dbfe53c7 req-4399cdd9-07ef-47d9-a1f2-96b525050a02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.797194 Aug 25 13:35:12.516245 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2894/5714] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:12.734332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:12.737146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:12.803371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.804666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.805755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:12.807567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:12.808908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:12.810001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.154269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:14.203256 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fabf929-2e68-4c24-9207-d5af298ce219 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.479078 Aug 25 13:35:14.209412 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2895/5715] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:12 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:14.225272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:14.226364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:14.241915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.243877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.244991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.246753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.247861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.248958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.258383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:14.287910 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.294000 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10a1a631-06ab-4a1d-bef4-7dbe3e0858f4 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 2.091113 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 HTTP/1.1 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5'} Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:14.298956 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35f1687d-71bb-431f-9b88-9a8172a50e15 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 404 len: 111 microversion: 2.1 time: 0.090588 Aug 25 13:35:14.313528 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2896/5716] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:35:14 2022] DELETE /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:14.316144 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2821/5717] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:12 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:14.322556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:14.323884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:14.359790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.362863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.372663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.374409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:14.376741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:14.377888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:14.411922 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 HTTP/1.1 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5'} Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:14.415533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. Aug 25 13:35:14.423509 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:35:14.427117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:14.429360 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d1e8079-bcdf-4717-bfdc-2ecaeb75e483 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5" status: 404 len: 111 microversion: 2.1 time: 0.117396 Aug 25 13:35:14.431037 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2897/5718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:14 2022] GET /compute/v2.1/servers/a0850ac1-57b9-4a3c-8041-d3f7ba2a9db5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:14.620210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98cb027c-352f-4bc3-b1b5-5118a8b66fbd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: .version_select at 0x7fc6c6c2d670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-536620425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSFm7jaILulPcL6vhgsYLZona84lCMoHwWuLcxcbAb309EZFGyCY1OLmHavuS3GtkiYbzTsDvR0BeTeK09Qc480xgnxfavPGkNcyM8VrpQTV8tZBAJRvfgyzFLg4EVA9A=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:14.678320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-98cb027c-352f-4bc3-b1b5-5118a8b66fbd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:35:14.694163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-98cb027c-352f-4bc3-b1b5-5118a8b66fbd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:35:14.764974 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98cb027c-352f-4bc3-b1b5-5118a8b66fbd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.157553 Aug 25 13:35:14.773033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2822/5719] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:35:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:15.261009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:15.262581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:15.284318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:15.285566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:15.286936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:15.289535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:15.291268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:15.292743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:15.350620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:15.352095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:15.374133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:15.377573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:15.378500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:15.379934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:15.392460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:15.394701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:15.829164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:15.854998 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd4b0ec8-bd4a-497a-b4c3-f238c5977552 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 0.604882 Aug 25 13:35:15.864271 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2898/5720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:15 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:16.029287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:16.059757 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58f626c5-e3b7-4fe0-9b4d-c61a74ba109d tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1313 microversion: 2.1 time: 0.729660 Aug 25 13:35:16.061687 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2823/5721] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:15 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:16.922576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:16.925445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:16.991067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:16.992089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.001402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:17.003445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:17.006699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.009279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:17.110067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:17.115960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:17.137134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:17.159609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:17.167218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.168708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:17.182621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:17.184092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:17.198551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:18.200765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:18.225933 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ddd3911c-d445-496f-8581-de23f1836c35 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.330457 Aug 25 13:35:18.236454 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2899/5722] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:16 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:18.373898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:18.398539 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-99b05335-621d-40c2-917b-49dd8f3cc1a6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1463 microversion: 2.1 time: 1.298265 Aug 25 13:35:18.400813 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2824/5723] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:17 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1463 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:18.564469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:18.566417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:18.587270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:18.589949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:18.592071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:18.594158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:18.595606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:18.596873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:18.661175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:35:18.937543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a95aefb6-fb15-40fa-87a9-530b28e12cb5 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 204 len: 0 microversion: 2.1 time: 0.381037 Aug 25 13:35:18.939859 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2900/5724] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:35:18 2022] DELETE /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:35:18.955666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:18.957748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:18.974854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:18.983447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:18.984965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:18.986463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:18.987380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:18.994301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:19.299789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:19.306434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:19.335190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:19.336634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:19.337924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:19.342383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:19.347288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:19.348837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:19.417501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:19.447378 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-720f2136-60bc-4da0-bc4e-34ca8bfdae80 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1469 microversion: 2.1 time: 0.501261 Aug 25 13:35:19.461141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2825/5725] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:18 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1469 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:19.745589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:19.782586 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b24b92b9-db1e-4989-a223-90fef93cb742 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 0.510841 Aug 25 13:35:19.796868 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2901/5726] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:19 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:20.507705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:20.526201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:20.591685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:20.599641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:20.607937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:20.615770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:20.620076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:20.632705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:20.833258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:20.839975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:20.866588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:20.881515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:20.883875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:20.891260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:20.892469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:20.893632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:22.253077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:22.298233 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3dc65f2e-69a6-488e-8539-8805ca6bb43d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.472857 Aug 25 13:35:22.302683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2902/5727] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:20 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:22.386816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:22.423141 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-05ab3dba-139a-4892-b6d9-490114891423 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1469 microversion: 2.1 time: 1.926441 Aug 25 13:35:22.428700 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2826/5728] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:20 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1469 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:23.362633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.369237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:23.385305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0c0c40-0638-45f6-9ad5-501b32f493f1", "name": "network-vif-plugged", "status": "completed", "tag": "fea494dd-d600-4269-885f-c69cd057bc0c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:23.431486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.442708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.445015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.456520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.461994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.466608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.482152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.485782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.505840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.598502 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] Creating event network-vif-plugged:fea494dd-d600-4269-885f-c69cd057bc0c for instance db0c0c40-0638-45f6-9ad5-501b32f493f1 on n-h1-850468-18 Aug 25 13:35:23.632610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-32653198-3810-482a-acea-86cccb05ba56 req-89cd6526-6fef-4ccc-a44b-11df9ec61f41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258176 Aug 25 13:35:23.634379 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2827/5729] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:23.673526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:23.677974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:23.725770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.731053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.736567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:23.739430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:23.747011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:23.750316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:24.196545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:24.228029 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9dab122b-50ff-433f-8ce5-f9903e7e46d6 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1427 microversion: 2.1 time: 0.590918 Aug 25 13:35:24.229140 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2828/5730] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:23 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1427 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:24.277370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df1ea29-51fc-4442-a786-08cdb1a040ed", "name": "network-vif-deleted", "tag": "211e57c7-62b6-4424-8351-b87a0f71394b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:24.320440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:24.321754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:24.322859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:24.368958 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] Creating event network-vif-deleted:211e57c7-62b6-4424-8351-b87a0f71394b for instance 7df1ea29-51fc-4442-a786-08cdb1a040ed on n-h1-850468-18 Aug 25 13:35:24.396932 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-959fc9aa-b312-4844-b68f-425fb877068c req-131d7687-4e87-4300-bf23-9a0e25cb98c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132275 Aug 25 13:35:24.398430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2829/5731] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:24.677142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:24.722637 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f7cf92d-8a58-44ca-9bef-b8e1f45a9e0a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 1.390649 Aug 25 13:35:24.728825 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2903/5732] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:23 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:35:25.286466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:25.298175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:25.300337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:25.314606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.316010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.318186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.319933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.321056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.322866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.504634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.508574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.512324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.514389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lazy-loading 'fault' on Instance uuid 7df1ea29-51fc-4442-a786-08cdb1a040ed {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:35:25.661131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947f38069344bca9b75897b9a826cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3e14ac71924855954f71f20525e99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:25.684394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4970c739-6ec1-496d-888b-278e83ecbce2 tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 200 len: 1303 microversion: 2.1 time: 0.417257 Aug 25 13:35:25.700161 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2830/5733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:25 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 1303 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:25.795898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:25.799770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:25.860957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.862772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.864364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:25.867266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:25.868595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:25.871436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:26.602921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:26.633959 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f720f2fb-cc0b-4bae-b322-ce7a242cd762 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1372 microversion: 2.1 time: 0.876920 Aug 25 13:35:26.648420 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2904/5734] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:25 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1372 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:26.733036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:26.741824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] [instance: 7df1ea29-51fc-4442-a786-08cdb1a040ed] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:26.789974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:26.798949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:26.805880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:26.807797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:26.807797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:26.808620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:26.844523 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] HTTP exception thrown: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Request method failure captured: Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed HTTP/1.1 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3psrVx4T-TReN0QDSZnj-b8Sm7fEJwIkIiksJVTBIdd2VJP9hTRrmgPWjdZN53Z2_UPiVsw51BnxRZmpkvh6j4Tbyoh8wcJMmv1DZ52HJZt1VC5uoD4OhcHNu66A78vGLTBmxkcw7XeNEee751D3-TQhFl5AanM-6pTYvgopE82RTQ Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2c3e14ac71924855954f71f20525e99b Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesNegativeTest-1936288789 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2c3e14ac71924855954f71f20525e99b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2c3e14ac71924855954f71f20525e99b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c3e14ac71924855954f71f20525e99b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2c3e14ac71924855954f71f20525e99b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesNegativeTest-1936288789 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2c3e14ac71924855954f71f20525e99b Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesNegativeTest-1936288789 Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesNegativeTest-1936288789-project Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: ea947f38069344bca9b75897b9a826cc Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesNegativeTest-1936288789-project Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7df1ea29-51fc-4442-a786-08cdb1a040ed'} Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:35:26.848446 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. Aug 25 13:35:26.856088 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:35:26.860325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] Returning 404 to user: Instance 7df1ea29-51fc-4442-a786-08cdb1a040ed could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:35:26.863195 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3bfa29d9-ad74-48d5-a591-b70495316ebd tempest-VolumesNegativeTest-1936288789 tempest-VolumesNegativeTest-1936288789-project] 10.222.0.60 "GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed" status: 404 len: 111 microversion: 2.1 time: 0.142103 Aug 25 13:35:26.864696 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2831/5735] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:26 2022] GET /compute/v2.1/servers/7df1ea29-51fc-4442-a786-08cdb1a040ed => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:35:27.686102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:27.688036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:27.729069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:27.729976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:27.730805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:27.732206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:27.733111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:27.745315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:28.788228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:28.835553 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1542 microversion: 2.1 time: 1.165282 Aug 25 13:35:28.865718 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2905/5736] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:27 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1542 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:28.881880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:28.882900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:35:28.901911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:28.902671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:28.903336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:28.914180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:28.915227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:28.916096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:29.843640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:35:29.872687 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa5e3fa1-97db-425c-93df-12cf02664bdd tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1542 microversion: 2.1 time: 1.001271 Aug 25 13:35:29.894601 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2832/5737] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:35:28 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1542 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:35:39.939530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:35:39.941394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8dfe9170-4bda-4353-8558-0d334fbcfc2d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002672 Aug 25 13:35:39.944688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2906/5738] 10.222.0.60 () {56 vars in 886 bytes} [Thu Aug 25 13:35:39 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 25 13:35:41.705526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0c0c40-0638-45f6-9ad5-501b32f493f1", "tag": "fea494dd-d600-4269-885f-c69cd057bc0c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:35:41.787373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=19 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:41.794982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=73 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:41.806511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:35:41.810133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:35:41.818370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:35:41.887258 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] Creating event network-changed:fea494dd-d600-4269-885f-c69cd057bc0c for instance db0c0c40-0638-45f6-9ad5-501b32f493f1 on n-h1-850468-18 Aug 25 13:35:41.923873 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0f56d36d-32bf-4eec-85b0-110ff908a603 req-01545923-77f6-46c8-a053-d4c2035d9585 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224037 Aug 25 13:35:41.926020 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2833/5739] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:35:59.216214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:59.221698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:35:59.606406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6816b97c-6eda-4a7e-8df2-00d3376b49ca tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Action: 'create', calling method: .version_select at 0x7fc6c1ffa4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-106876713", "metadata": {"Type": "work"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:00.700301 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6816b97c-6eda-4a7e-8df2-00d3376b49ca tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.494329 Aug 25 13:36:00.705944 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2907/5740] 10.222.0.60 () {60 vars in 1156 bytes} [Thu Aug 25 13:35:59 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1501 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 13:36:00.731008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:00.735023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:00.767793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b46b43dc-2867-40f8-bdf5-3b281146b017 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c2929af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:01.013315 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b46b43dc-2867-40f8-bdf5-3b281146b017 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.286352 Aug 25 13:36:01.016631 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2834/5741] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:00 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:01.097997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:01.111099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:01.134934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:01.142180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:01.151960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:01.154556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:01.156148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:01.157174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:01.334853 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f765364b-d305-4e04-a31e-30b5c9eb4d0e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1/action" status: 200 len: 24569 microversion: 2.1 time: 0.245490 Aug 25 13:36:01.335971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2908/5742] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:36:01 2022] POST /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1/action => generated 24569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:36:02.051129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c2c2b24-f0f7-49a7-95a7-89a59744fdc3 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c6bf3b80>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:02.230338 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c2c2b24-f0f7-49a7-95a7-89a59744fdc3 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.197306 Aug 25 13:36:02.231987 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2835/5743] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:02 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:03.280412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3eb5e6c-141a-4b04-8f38-d670c02ca307 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c2663f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:03.585493 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3eb5e6c-141a-4b04-8f38-d670c02ca307 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 353 microversion: 2.1 time: 0.336185 Aug 25 13:36:03.586621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2909/5744] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:03 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 353 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:03.616480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b27a644b-f19e-4c37-889f-aeecad49aa0a tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c29298b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:03.752578 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b27a644b-f19e-4c37-889f-aeecad49aa0a tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 353 microversion: 2.1 time: 0.144096 Aug 25 13:36:03.755117 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2836/5745] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:03 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:03.789905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-113ceab3-05a5-4f68-9aba-5496d61fd9ea tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c6c408b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:04.042112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-113ceab3-05a5-4f68-9aba-5496d61fd9ea tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 202 len: 0 microversion: 2.1 time: 0.265856 Aug 25 13:36:04.044632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2910/5746] 10.222.0.60 () {58 vars in 1248 bytes} [Thu Aug 25 13:36:03 2022] DELETE /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:36:04.059911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f420902b-5da2-46bd-b0b7-80f91ef99892 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c115aee0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:04.237074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f420902b-5da2-46bd-b0b7-80f91ef99892 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.183496 Aug 25 13:36:04.240146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2837/5747] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:04 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:05.277874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-163a9439-bf1c-438b-bc9e-5c5e9cea30fb tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c1e22f70>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:05.420218 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-163a9439-bf1c-438b-bc9e-5c5e9cea30fb tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.161906 Aug 25 13:36:05.421791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2911/5748] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:05 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:06.446450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-20fb589d-bb52-4098-a0ce-9e59fe20a093 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c2943310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:06.601096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-20fb589d-bb52-4098-a0ce-9e59fe20a093 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.165259 Aug 25 13:36:06.602577 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2838/5749] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:06 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:07.625795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e175b6a-71a9-4877-9d03-7427112cea15 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c6c40ee0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:07.819276 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e175b6a-71a9-4877-9d03-7427112cea15 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 200 len: 352 microversion: 2.1 time: 0.201014 Aug 25 13:36:07.820836 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2912/5750] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:07 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:08.850926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fd770f2-86f9-46b1-a3df-26305a852d26 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Calling method '.version_select at 0x7fc6c115adc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:08.963535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-4fd770f2-86f9-46b1-a3df-26305a852d26 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] HTTP exception thrown: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fd770f2-86f9-46b1-a3df-26305a852d26 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Request method failure captured: Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c HTTP/1.1 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3q-_t-Hf4dO70kzdATx113WxnfNPNO2U_4MBpqf3L0hoptwUWuYrJP3IFZCxSMHCvI4aAtbkCrcXC6ks9wBUjBzCr1DSdGRJKwgGgSJjrD5jo2jL7ANrZ10kBh2nNcxOmVwb4l0IWt7qhCDyO0OBMc4BfO1bqlWOjORV-0XbJiksoU Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 91bb30081d3241ee85587ba93c620824 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesGetTestJSON-1855703330 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_91bb30081d3241ee85587ba93c620824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/91bb30081d3241ee85587ba93c620824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91bb30081d3241ee85587ba93c620824"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/91bb30081d3241ee85587ba93c620824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesGetTestJSON-1855703330 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 91bb30081d3241ee85587ba93c620824 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesGetTestJSON-1855703330 Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesGetTestJSON-1855703330-project Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8043858ff13b43328c6faed34ffabd3f Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesGetTestJSON-1855703330-project Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: method: Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: exception: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4f2082e7-781e-4a1f-95dc-e441ea02760c'} Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. (HTTP 404) (Request-ID: req-76e4fb63-de3e-45bb-a000-f54056cc3940) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 13:36:08.969464 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. Aug 25 13:36:08.976499 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:08.985891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fd770f2-86f9-46b1-a3df-26305a852d26 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] Returning 404 to user: Volume 4f2082e7-781e-4a1f-95dc-e441ea02760c could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:36:08.996177 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4fd770f2-86f9-46b1-a3df-26305a852d26 tempest-VolumesGetTestJSON-1855703330 tempest-VolumesGetTestJSON-1855703330-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c" status: 404 len: 109 microversion: 2.1 time: 0.148773 Aug 25 13:36:09.008819 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2839/5751] 10.222.0.60 () {58 vars in 1245 bytes} [Thu Aug 25 13:36:08 2022] GET /compute/v2.1/os-volumes/4f2082e7-781e-4a1f-95dc-e441ea02760c => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:36:13.414871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1884788700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-536620425", "security_groups": [{"name": "tempest-secgroup-smoke-1545881986"}], "block_device_mapping_v2": [{"uuid": "7c59401d-c34d-482d-8c15-ad6da106e4bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:13.455366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:13.457294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:13.803670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:36:15.422752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:36:15.424160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:36:15.424691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:36:15.425119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:36:15.425545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:36:15.449753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:15.450621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:15.456520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:15.458408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:15.459640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:15.460662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:15.502501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:36:15.515422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:36:15.658754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:36:15.663547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c59401d-c34d-482d-8c15-ad6da106e4bc',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:36:16.034004 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c815b374-6205-416c-bdf8-0a1b42ef19bd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.624413 Aug 25 13:36:16.036107 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2913/5752] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:36:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:36:16.062812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3719de48-07ac-4727-8157-52f4b4e6a427 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:16.065571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3719de48-07ac-4727-8157-52f4b4e6a427 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:16.203807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3719de48-07ac-4727-8157-52f4b4e6a427 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:16.220847 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3719de48-07ac-4727-8157-52f4b4e6a427 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1094 microversion: 2.1 time: 0.170018 Aug 25 13:36:16.236927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2840/5753] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:16 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1094 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:17.271521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ff4bc19-c886-40d8-942e-27af0e6f8fa5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:17.272787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ff4bc19-c886-40d8-942e-27af0e6f8fa5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:17.495218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ff4bc19-c886-40d8-942e-27af0e6f8fa5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:17.535028 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ff4bc19-c886-40d8-942e-27af0e6f8fa5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1094 microversion: 2.1 time: 0.268332 Aug 25 13:36:17.556283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2914/5754] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:17 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1094 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:18.607258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:18.615011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:18.651627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:18.659960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:18.668019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:18.669520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:18.670679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:18.671310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:18.997919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:19.033025 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0841c010-6a48-4d70-947d-50bf16b76e03 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1200 microversion: 2.1 time: 0.462163 Aug 25 13:36:19.049178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2841/5755] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:18 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1200 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:20.092459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:20.097561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:20.121399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:20.128667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:20.131283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:20.132683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:20.138579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:20.140902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:20.470479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:20.520266 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b9e75d5-92cd-4e6d-8e51-97ff11706f96 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1210 microversion: 2.1 time: 0.438695 Aug 25 13:36:20.522493 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2915/5756] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:20 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1210 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:21.575972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:21.578814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:21.656710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:21.684330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:21.685555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:21.689085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:21.692430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:21.693594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:22.110558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:22.145957 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8a1e910-6cfb-42d2-b745-70fe9ec21d82 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.582282 Aug 25 13:36:22.155584 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2842/5757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:21 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:23.198663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:23.200594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:23.237148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:23.240854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:23.242129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:23.243764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:23.252989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:23.254196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:23.661922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:23.685499 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0316ef70-c375-4f62-89b8-cd7a7c7a0260 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.494118 Aug 25 13:36:23.717674 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2916/5758] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:23 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:24.495019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4829a5ea-dc2a-430b-9e60-768191508fec", "tag": "2939bc32-d31b-49de-ac93-105057e420b7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:24.525277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:24.526074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:24.527348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:24.559972 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] Creating event network-changed:2939bc32-d31b-49de-ac93-105057e420b7 for instance 4829a5ea-dc2a-430b-9e60-768191508fec on n-h1-850468-18 Aug 25 13:36:24.579101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-fa4d215a-1e32-4691-bd96-68f166c89a58 req-493b5fa0-c29b-455a-be26-a9686b3fe006 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105543 Aug 25 13:36:24.580680 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2843/5759] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:24.731652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:24.734962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:24.767088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:24.768161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:24.769029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:24.770377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:24.771201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:24.772003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:25.389593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:25.438724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56c63969-2a2c-4023-89a8-70388ca13b57 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.709785 Aug 25 13:36:25.442512 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2917/5760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:24 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:26.498652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:26.503187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:26.518106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:26.554145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:26.557763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:26.560735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:26.566678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:26.569286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:26.572347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:27.059642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:27.091854 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fdd5eecd-275a-456d-8a5e-ab224c519f5f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.613581 Aug 25 13:36:27.094932 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2844/5761] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:26 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:28.128221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:28.129641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:28.132885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:28.135904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:28.146330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:28.147350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:28.148320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:28.149918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:28.150990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:28.151928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:28.472543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:28.491273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-343f71bd-bf2c-4f93-8d80-d41b7bd82d62 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.370811 Aug 25 13:36:28.508527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2918/5762] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:28 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:36:29.533110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:29.534213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:29.551520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:29.552497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:29.553513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:29.554942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:29.556900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:29.557877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:30.020705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:30.050189 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca8706eb-2c8a-46a0-81ca-0d5148421381 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.523841 Aug 25 13:36:30.073857 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2845/5763] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:29 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:31.090885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:31.092670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:31.115718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:31.116871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:31.117923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:31.119634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:31.120869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:31.121935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:31.661325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:31.686509 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba9e8f89-3241-4ab2-b197-733f98a8f509 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.602861 Aug 25 13:36:31.708886 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2919/5764] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:31 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:32.728941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:32.729795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:32.765546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:32.767047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:32.767990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:32.769485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:32.770732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:32.771914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:33.145760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:33.176291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-582d17d1-0b08-4897-ad85-0b96bf01f0a2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.454335 Aug 25 13:36:33.178225 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2846/5765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:32 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:34.219173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:34.225423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:34.226491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:34.227523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:34.249917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.251954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.254482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:34.256375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.258977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.259742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.260494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:34.261119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.261709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.262448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.262896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:34.267163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:34.363389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:36:34.686826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:34.719024 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-611d2461-afa6-4fc7-a74a-b5b34539c525 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 204 len: 0 microversion: 2.1 time: 1.033727 Aug 25 13:36:34.720635 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2920/5766] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:36:33 2022] DELETE /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:36:34.724340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d07f98e4-12ff-45f1-b09f-fda228eb00fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1278 microversion: 2.1 time: 0.515423 Aug 25 13:36:34.725816 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2847/5767] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:34 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1278 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:34.755015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:34.760713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:34.787533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.788667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.791432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:34.794528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:34.798474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:34.802566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:35.288285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:35.310882 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63df1c6e-2c93-4cfb-ae5f-f682faae5b0c tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1731 microversion: 2.1 time: 0.582190 Aug 25 13:36:35.327840 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2921/5768] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:34 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1731 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:35.777620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:35.787515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:35.834203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:35.848696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:35.852150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:35.854961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:35.859202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:35.860907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:36.369484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:36.374669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:36.414629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:36.415970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:36.417494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:36.419219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:36.422878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:36.425181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:36.515995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:36.540481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b67b6318-cd4e-456e-972a-e4ec4207ed23 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 0.773180 Aug 25 13:36:36.542282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2848/5769] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:35 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:36.849741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:36.868014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-66bb0622-2b91-4d71-8f37-67d9d7ddf3fe tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1731 microversion: 2.1 time: 0.515803 Aug 25 13:36:36.884280 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2922/5770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:36 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1731 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:37.585615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:37.586936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:37.625310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:37.626496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:37.630518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:37.633156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:37.637208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:37.639742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:37.917963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:37.921451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:37.939609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:37.940962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:37.942005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:37.944283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:37.945584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:37.946700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:38.253802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:38.301147 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9fdf6b1e-e267-4e53-971d-b1da5268feba tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1664 microversion: 2.1 time: 0.396895 Aug 25 13:36:38.302705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2923/5771] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:37 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1664 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:38.469751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:38.489947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-26c8afbb-84b1-4892-aa3a-9e67bf6c2b70 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 0.913778 Aug 25 13:36:38.491406 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2849/5772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:37 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:39.356367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:39.361732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:39.411431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:39.413647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:39.415470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:39.422280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:39.426252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:39.429609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:39.536782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:39.546557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:39.618375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:39.619755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:39.628161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:39.631685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:39.640298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:39.641837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:39.838556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc93f34a658548a1b0878bbfb7e14632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8778c870a0004a338258a9256a5e199f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:39.869067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6b390f78-1c48-476a-98b1-42e74e8932a6 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 200 len: 1664 microversion: 2.1 time: 0.524360 Aug 25 13:36:39.894374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2924/5773] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:39 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 1664 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:39.928432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb", "name": "network-vif-deleted", "tag": "596268a9-b9f2-4ba2-987d-aa679a7013aa"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:39.978019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:39.981308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:39.984269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:40.025809 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] Creating event network-vif-deleted:596268a9-b9f2-4ba2-987d-aa679a7013aa for instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb on n-h1-850468-18 Aug 25 13:36:40.035912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-925916f1-6159-4873-bae6-d0e46f7ee13b req-81da09c3-52d9-4bf4-8361-eb03116ca775 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139515 Aug 25 13:36:40.037581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2925/5774] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:40.459739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:40.490201 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-765d2f8c-e3a1-4c6f-807f-5501d01255f5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 0.965969 Aug 25 13:36:40.496419 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2850/5775] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:39 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:36:40.937014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:40.942290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:40.982043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:40.982993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:40.983880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:40.992679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:40.994073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:41.000952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:41.100383 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] HTTP exception thrown: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Request method failure captured: Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb HTTP/1.1 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3lAZwuvJD-7HD81kHUj9w_HkyFv00YS6RguRrqsNYejXpPNBFuD3fhFzYcxuhdd-6Kg626G6yzpJZyBWbfxQhbqT7LuoJUg3XjkYjygoa0YLgOXgkFTdp6CBkw8XAcffe5Up1f82NA8XmLLFq5r3VGRWwrqtAF43yb6wxWv1pQuARw Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8778c870a0004a338258a9256a5e199f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8778c870a0004a338258a9256a5e199f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestServerBasicOps-67432423 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: bc93f34a658548a1b0878bbfb7e14632 Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb'} Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:41.104097 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Returning 404 to user: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:36:41.117062 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-54af623a-f501-46bc-95ea-5c32c7da45dd tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 404 len: 111 microversion: 2.1 time: 0.202670 Aug 25 13:36:41.126154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2926/5776] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:40 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:36:41.566373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:41.571173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:41.618871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:41.647721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:41.667328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-700e545f-279b-4ee4-99ab-a96ce00adabb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: .version_select at 0x7fc6c292e1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1594643733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKurRtWGGzQ3LKhXJ1in8BcR2OEsHYhU934VKymtUU6IMdY5MWPKyH5fpQYIEAaE8FFNaoEMvyJLSuCKZlmZlmFkC0SxP9VOJHTKdlc6vo2Rb4L0haE9n/StdAV/JauvA=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:41.675120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:41.676509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:41.677308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:41.687029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:41.737686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-700e545f-279b-4ee4-99ab-a96ce00adabb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:36:41.764664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-700e545f-279b-4ee4-99ab-a96ce00adabb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:36:41.871336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-700e545f-279b-4ee4-99ab-a96ce00adabb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.209493 Aug 25 13:36:41.876623 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2927/5777] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:36:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:42.421754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:42.471353 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-216ac9d1-4867-4e17-a99a-48b0bdc624a5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 0.935647 Aug 25 13:36:42.480719 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2851/5778] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:41 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:43.235031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:43.241394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:43.286736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.287564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.289280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.289859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.290641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.291366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.405549 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] HTTP exception thrown: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Request method failure captured: Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb HTTP/1.1 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3lAZwuvJD-7HD81kHUj9w_HkyFv00YS6RguRrqsNYejXpPNBFuD3fhFzYcxuhdd-6Kg626G6yzpJZyBWbfxQhbqT7LuoJUg3XjkYjygoa0YLgOXgkFTdp6CBkw8XAcffe5Up1f82NA8XmLLFq5r3VGRWwrqtAF43yb6wxWv1pQuARw Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8778c870a0004a338258a9256a5e199f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8778c870a0004a338258a9256a5e199f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: bc93f34a658548a1b0878bbfb7e14632 Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb'} Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:36:43.418741 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.427269 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.439919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Returning 404 to user: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:36:43.493671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-94f8b816-f671-4d6f-9b71-e0475f641f53 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 404 len: 111 microversion: 2.1 time: 0.222080 Aug 25 13:36:43.501566 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2928/5779] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:36:43 2022] DELETE /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:36:43.524516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:43.533551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] [instance: 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:43.564886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:43.573852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:43.583560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.587751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.590183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.592712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:43.595771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.597256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.598835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.633722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.636344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.643480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] HTTP exception thrown: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Request method failure captured: Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb HTTP/1.1 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3lAZwuvJD-7HD81kHUj9w_HkyFv00YS6RguRrqsNYejXpPNBFuD3fhFzYcxuhdd-6Kg626G6yzpJZyBWbfxQhbqT7LuoJUg3XjkYjygoa0YLgOXgkFTdp6CBkw8XAcffe5Up1f82NA8XmLLFq5r3VGRWwrqtAF43yb6wxWv1pQuARw Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8778c870a0004a338258a9256a5e199f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8778c870a0004a338258a9256a5e199f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8778c870a0004a338258a9256a5e199f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 8778c870a0004a338258a9256a5e199f Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestServerBasicOps-67432423 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: bc93f34a658548a1b0878bbfb7e14632 Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestServerBasicOps-67432423-project Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb'} Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:36:43.649831 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. Aug 25 13:36:43.670013 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:36:43.673692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.673692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:43.673692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:43.673692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:43.674614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Returning 404 to user: Instance 8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:36:43.676904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b21e2264-1a53-4ed1-b046-106e463c6638 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb" status: 404 len: 111 microversion: 2.1 time: 0.168016 Aug 25 13:36:43.684245 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2852/5780] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:43 2022] GET /compute/v2.1/servers/8bfc850a-04ac-4968-a0c4-4bdbe05ee9bb => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:36:43.697025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:45.617192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:45.696980 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c159a2b8-a9ff-4c8c-b4a5-8e22f77b66bc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 2.178799 Aug 25 13:36:45.702777 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2929/5781] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:43 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:45.768490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-927572d5-d364-414c-adbc-61097a014dd7 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] Calling method '.version_select at 0x7fc6c2c19430>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:45.883679 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-927572d5-d364-414c-adbc-61097a014dd7 tempest-TestServerBasicOps-67432423 tempest-TestServerBasicOps-67432423-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1274602722" status: 202 len: 0 microversion: 2.1 time: 0.125755 Aug 25 13:36:45.891353 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2853/5782] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 13:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1274602722 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:36:46.752976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:46.763599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:46.781266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:46.782927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:46.784258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:46.787221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:46.789244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:46.790989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:47.707045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:47.755927 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-442c0973-17aa-4fd6-8a9c-2fd41c1f6873 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 1.010102 Aug 25 13:36:47.758421 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2930/5783] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:46 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:48.814422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:48.817486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:48.851242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:48.855434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:48.857880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:48.860029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:48.864384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:48.866519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:48.875844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:48.886613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=65 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:49.945910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:49.983026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-23beb2c8-7bf0-4ba4-9e07-4863078bfcf1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 1.182612 Aug 25 13:36:49.985655 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2854/5784] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:48 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:50.269067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-921773673", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "9fd0cdfa-5a58-46ba-bc97-d45b1111d8e8"}], "key_name": "tempest-TestNetworkBasicOps-1594643733", "security_groups": [{"name": "tempest-secgroup-smoke-1281444014"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:50.707757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829a5ea-dc2a-430b-9e60-768191508fec", "name": "network-vif-plugged", "status": "completed", "tag": "2939bc32-d31b-49de-ac93-105057e420b7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:36:50.738332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:50.740175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:50.741953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:50.787807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] Creating event network-vif-plugged:2939bc32-d31b-49de-ac93-105057e420b7 for instance 4829a5ea-dc2a-430b-9e60-768191508fec on n-h1-850468-18 Aug 25 13:36:50.798531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] validate_networks() for [('9fd0cdfa-5a58-46ba-bc97-d45b1111d8e8', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:36:50.823089 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5c2f1919-609e-4324-b748-521f0520a850 req-09477df2-99b3-4016-ad45-660e931a7cba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122708 Aug 25 13:36:50.825082 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2855/5785] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:36:51.039066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:51.042270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:51.071271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:51.102192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:51.103089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:51.107504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:51.108965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:51.110308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:51.796313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:36:51.852707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:51.923695 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-886fe91a-6067-4806-81dc-25c7a7824c9b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1266 microversion: 2.1 time: 0.862993 Aug 25 13:36:51.926500 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2856/5786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:51 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1266 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:52.903409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:36:52.908875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:36:52.910183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:36:52.911670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:36:52.912757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:36:52.940609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:52.942310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:52.943910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:52.946353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:52.947700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:52.948917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:52.969333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:52.970657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:53.013094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:53.019235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:53.022727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:53.027058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:53.028813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:53.030117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:36:53.031677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:53.062104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:36:53.118833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:36:53.140234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:36:53.343093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5802195a-0b7a-4f0e-a1c6-5752f3d124cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.080700 Aug 25 13:36:53.351407 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2931/5787] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:36:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 3093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:36:53.400890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfdf4d19-6499-40dc-b60a-222daf6f0dcb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:53.403612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cfdf4d19-6499-40dc-b60a-222daf6f0dcb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:53.826785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cfdf4d19-6499-40dc-b60a-222daf6f0dcb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:53.859201 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cfdf4d19-6499-40dc-b60a-222daf6f0dcb tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1248 microversion: 2.1 time: 0.491542 Aug 25 13:36:53.864580 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2932/5788] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:53 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1248 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:54.229928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:54.253213 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d427eb5d-180f-4854-b701-bded23bc7a71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1454 microversion: 2.1 time: 1.296235 Aug 25 13:36:54.256038 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2857/5789] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:52 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1454 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:54.303487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:54.309143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:54.335288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:54.336220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:54.336988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:54.345504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:54.346433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:54.349441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:54.906170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f87a8fc-de78-4472-a691-213532f43b81 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:54.907789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f87a8fc-de78-4472-a691-213532f43b81 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:55.070886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:55.103123 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c2b9447-974f-4fe2-b095-3b1a8f3e7896 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1454 microversion: 2.1 time: 0.812724 Aug 25 13:36:55.116254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2933/5790] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:54 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1454 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:55.212303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3f87a8fc-de78-4472-a691-213532f43b81 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:55.242223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f87a8fc-de78-4472-a691-213532f43b81 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1248 microversion: 2.1 time: 0.342865 Aug 25 13:36:55.243262 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2858/5791] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:54 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1248 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:36:56.291074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:56.296380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:56.330408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:56.335556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:56.338232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:56.343812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:56.353371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:56.361337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:56.710998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:56.740724 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f16d1025-5d7b-4085-ad8a-9dbcf927c457 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1300 microversion: 2.1 time: 0.460967 Aug 25 13:36:56.747345 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2934/5792] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:56 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1300 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:36:57.793016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:57.794071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:57.827779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:57.828688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:57.829401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:57.845229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:57.846122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:57.846768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:58.533243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:36:58.590040 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-661d3637-5ae9-4a4c-b9ee-e582f160c337 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1306 microversion: 2.1 time: 0.803356 Aug 25 13:36:58.595801 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2859/5793] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:57 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1306 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:36:59.639673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:36:59.642535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:36:59.677357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:59.682261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:59.686273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:36:59.692454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:36:59.693665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:36:59.694796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:02.066281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:02.109023 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3c0c35b-c0f3-41e3-8211-34fe2bc759cf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 2.477574 Aug 25 13:37:02.133339 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2935/5794] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:36:59 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:03.170572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:03.176948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:03.209520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:03.210361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:03.210850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:03.211843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:03.212486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:03.212956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:03.832362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79855985-e004-402a-b7c0-0cbebcb93f03", "tag": "995b5fca-7ce1-4e9f-95b3-3b73121dc511"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:03.873581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:03.880283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:03.916970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:03.925875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:03.930187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:03.989518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] Creating event network-changed:995b5fca-7ce1-4e9f-95b3-3b73121dc511 for instance 79855985-e004-402a-b7c0-0cbebcb93f03 on n-h1-850468-18 Aug 25 13:37:03.989794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:04.009154 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-47f5d704-490d-48f6-bf7f-29ebd010b3e0 req-f23a5e10-6b4c-4639-bdd9-e6031645ede7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189311 Aug 25 13:37:04.011089 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2936/5795] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:04.013164 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fc6565d8-2863-4c67-9369-e330d95de40b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.861682 Aug 25 13:37:04.014346 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2860/5796] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:03 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:05.077246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:05.080067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:05.106505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:05.114588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:05.116092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:05.118232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:05.120293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:05.125106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:05.785892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:05.834717 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-488db984-87cf-423d-8148-13efce8edd3a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.774921 Aug 25 13:37:05.843462 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2937/5797] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:05 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:06.612477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:06.892458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:06.897327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:06.921570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:06.929115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:06.929923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:06.944621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:06.945384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:06.946697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:07.397451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:07.431251 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-37978430-548d-47c6-b569-eae2cdcf129d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.548245 Aug 25 13:37:07.451779 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2938/5798] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:06 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:07.537244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4829a5ea-dc2a-430b-9e60-768191508fec", "tag": "2939bc32-d31b-49de-ac93-105057e420b7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:07.565314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:07.568794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:07.570445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:07.630118 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] Creating event network-changed:2939bc32-d31b-49de-ac93-105057e420b7 for instance 4829a5ea-dc2a-430b-9e60-768191508fec on n-h1-850468-18 Aug 25 13:37:07.656334 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6a19634e-b1c9-48a5-a69d-97706b808593 req-9350ca4b-6082-46c5-b524-025fc78dd033 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.056702 Aug 25 13:37:07.669025 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2861/5799] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:08.480062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:08.484373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:08.522614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:08.525821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:08.527008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:08.531319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:08.538683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:08.542494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:09.283260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:09.306139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63fbdfbd-7900-421a-a231-36512ff79755 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.839879 Aug 25 13:37:09.343303 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2939/5800] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:08 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:10.359569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:10.367273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:10.401295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:10.402727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:10.406296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:10.407967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:10.409760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:10.412616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:11.284798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:11.320727 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3437002-0ab8-451c-a13b-11302fde41ee tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.970582 Aug 25 13:37:11.348053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2862/5801] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:10 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:37:12.402495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:12.406397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:12.452856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:12.454939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:12.457269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:12.469018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:12.473774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:12.477341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:13.205634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:13.277679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-052db2ca-8b5e-45de-a092-446ff2be1401 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.898210 Aug 25 13:37:13.298187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2940/5802] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:12 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:14.349491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:14.352669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:14.394040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:14.396077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:14.419035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:14.420887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:14.421793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:14.423595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:15.103982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:15.222969 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5ba49877-436f-4250-9fbb-6150fffe855b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.883517 Aug 25 13:37:15.223973 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2863/5803] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:14 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:16.271315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:16.276421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:16.298381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:16.316400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:16.317634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:16.318395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:16.320783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:16.320783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:16.321358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:16.336182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=58 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:16.830475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:16.858321 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6ae0439a-af8c-49b4-b29e-dd8ae7f65e62 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.598390 Aug 25 13:37:16.863285 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2941/5804] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:16 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:17.017748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79855985-e004-402a-b7c0-0cbebcb93f03", "name": "network-vif-plugged", "status": "completed", "tag": "995b5fca-7ce1-4e9f-95b3-3b73121dc511"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:17.056621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:17.057703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:17.058418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:17.120377 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] Creating event network-vif-plugged:995b5fca-7ce1-4e9f-95b3-3b73121dc511 for instance 79855985-e004-402a-b7c0-0cbebcb93f03 on n-h1-850468-18 Aug 25 13:37:17.149623 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-35b71946-15a1-4e0d-a03e-4857d051a756 req-1e2c35a3-80f6-4b4f-9014-babd2e9e119a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152740 Aug 25 13:37:17.152852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2864/5805] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:17.925917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:17.928645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:17.961773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:17.962659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:17.964008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:17.972068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:17.973170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:17.973944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:18.433700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:18.468052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5936e76-930d-41ae-b7e5-343f377ce4e2 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1374 microversion: 2.1 time: 0.560035 Aug 25 13:37:18.477689 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2942/5806] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:17 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1374 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:19.524232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:19.531142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:19.544682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=24 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:19.549545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:19.553635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:19.555456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:19.557425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:19.561377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:19.562765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:19.593391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=48 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:20.014541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:20.039719 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-09a8fa1b-09d0-4b90-adfc-3dfe3b34dbb8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1546 microversion: 2.1 time: 0.528130 Aug 25 13:37:20.042206 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2865/5807] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:19 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1546 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:20.093029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:20.095978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:37:20.113350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:20.115620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:20.116980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:20.119257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:20.130055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:20.140679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:20.543236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:37:20.565035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-377eaa42-7eb3-467b-b362-8885a8af8f3e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1546 microversion: 2.1 time: 0.484307 Aug 25 13:37:20.566713 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2943/5808] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:20 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1546 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:37:56.857147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:56.863321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:56.867455 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:37:56.869693 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:37:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.60) !!! Aug 25 13:37:57.712978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:57.719691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:57.722070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:57.723206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:57.724925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:57.726728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:57.728261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:57.786427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8557e4ce-f1ea-42ed-ac5a-86b2e35d3a2e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.945161 Aug 25 13:37:57.788074 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2866/5809] 10.222.0.60 () {58 vars in 1185 bytes} [Thu Aug 25 13:37:56 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:37:58.059481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1742664814", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "availability_zone": "nova:n-h1-850468-18", "networks": [{"uuid": "95ab2802-78fe-478b-98ae-63e29bee4592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:37:58.094208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:58.095965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=17 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:37:58.220977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] validate_networks() for [('95ab2802-78fe-478b-98ae-63e29bee4592', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:37:59.523706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:37:59.524766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:37:59.525624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:37:59.526736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:37:59.527913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:37:59.579773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:59.583624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:59.585203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:59.587710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:37:59.592691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:37:59.594356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:37:59.671686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Getting quotas for project a994af9a7e1a4af4b415208e5f2c41b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:37:59.701003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Getting quotas for user 854356347c9a48568a34072107bc84fd and project a994af9a7e1a4af4b415208e5f2c41b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:37:59.751495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:37:59.758754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:37:59.878555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50f38599-7b4c-44a5-91aa-b2a44186fce4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.826483 Aug 25 13:37:59.890903 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2944/5810] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:37:59.910660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4f14ce91-9c33-487e-b6da-c9921844e57b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:37:59.921767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4f14ce91-9c33-487e-b6da-c9921844e57b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:00.128312 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4f14ce91-9c33-487e-b6da-c9921844e57b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1329 microversion: 2.1 time: 0.235105 Aug 25 13:38:00.131120 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2867/5811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:37:59 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1329 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:01.168024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32bb76fd-d0a4-4cfd-9d6f-562242760fa2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:01.177585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32bb76fd-d0a4-4cfd-9d6f-562242760fa2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:01.379698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32bb76fd-d0a4-4cfd-9d6f-562242760fa2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1329 microversion: 2.1 time: 0.218593 Aug 25 13:38:01.393923 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2945/5812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:01 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1329 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:02.433530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:02.434780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:02.499426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:02.500320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:02.511444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:02.513036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:02.519496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:02.520484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:02.854202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd99a78a-7481-4e73-b77f-013a02b4b9b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1338 microversion: 2.1 time: 0.427246 Aug 25 13:38:02.871522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2868/5813] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:02 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1338 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:03.938010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:03.941879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:04.037135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:04.051203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:04.052634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:04.054374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:04.055856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:04.057478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:04.902296 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcc99dd6-f020-4d84-8380-b28ce1feaeed tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1424 microversion: 2.1 time: 0.989273 Aug 25 13:38:04.903951 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2946/5814] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:03 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1424 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:05.946824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:05.956403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:06.007015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:06.010189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:06.018492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:06.023202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:06.027590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:06.030604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:06.319364 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-81315391-020e-4c1a-bfb2-3617dab3da76 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1424 microversion: 2.1 time: 0.376183 Aug 25 13:38:06.320500 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2869/5815] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:05 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1424 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:07.357918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:07.358881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:07.382216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:07.389799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:07.393107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:07.397899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:07.399421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:07.400637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:07.946719 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eaba9fdb-0b6e-4ba7-9bf9-3f02e1797bdf tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.594376 Aug 25 13:38:07.968841 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2947/5816] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:07 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:09.001903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:09.004284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:09.024535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:09.037872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:09.039445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:09.040458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:09.041999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:09.042927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:09.045128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:09.994318 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-910368a8-8f45-41d2-bdb9-12749b8ff1c2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 1.000790 Aug 25 13:38:09.999114 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2870/5817] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:08 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:10.354034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:10.384007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:10.385075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:10.418801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:10.424912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:10.426585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:10.429491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:10.434257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:10.436339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:10.579746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:38:10.998670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d595bcb0-89e9-4ce0-a683-81929758892f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 204 len: 0 microversion: 2.1 time: 0.647530 Aug 25 13:38:10.999966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2948/5818] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:38:10 2022] DELETE /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:38:11.019168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:11.031104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:11.047927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:11.048346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:11.052216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:11.083966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:11.086239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:11.087536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:11.088931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:11.093344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:11.098734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:11.100134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:11.101064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:11.102960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:11.109002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:11.109312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:11.110337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:11.364387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:12.011586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:12.037354 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2129bd38-2649-4bd9-9119-eb4dc0d579e8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1552 microversion: 2.1 time: 1.029740 Aug 25 13:38:12.040685 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2871/5819] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:11 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1552 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:12.112761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0cb78b4-6ba5-43ad-af44-c78426cd5593", "tag": "d0c50d60-f644-4390-90c4-0c4cf4d9bacd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:12.176258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:12.181061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:12.185365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:12.224039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] Creating event network-changed:d0c50d60-f644-4390-90c4-0c4cf4d9bacd for instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 on n-h1-850468-18 Aug 25 13:38:12.234905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d201953f-a7b7-4ac8-b808-cf3c56f90682 req-0bc92773-440f-4a12-afc7-9599b737595a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134770 Aug 25 13:38:12.236370 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2872/5820] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:12.649589 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0697301a-0614-4fcf-9ec0-eccbd86fd89f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 1.617308 Aug 25 13:38:12.653568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2949/5821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:11 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:13.088949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:13.090302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:13.124634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:13.126003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:13.129069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:13.132963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:13.137198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:13.141277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:13.667342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:13.695018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:13.696951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:13.697141 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1cf89ca5-1b29-458e-8e6e-a2ae4b85c833 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1552 microversion: 2.1 time: 0.615494 Aug 25 13:38:13.698624 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2873/5822] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:13 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1552 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:13.779054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:13.785957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:13.786460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:13.798333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:13.799223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:13.800019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:14.492684 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a1a93f48-4b7f-4171-922e-7b0f7a5afc83 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.805193 Aug 25 13:38:14.494244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2950/5823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:13 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:14.694058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79855985-e004-402a-b7c0-0cbebcb93f03", "name": "network-vif-deleted", "tag": "995b5fca-7ce1-4e9f-95b3-3b73121dc511"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:14.717961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:14.719890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:14.720263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:14.759644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:14.760842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:14.768104 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] Creating event network-vif-deleted:995b5fca-7ce1-4e9f-95b3-3b73121dc511 for instance 79855985-e004-402a-b7c0-0cbebcb93f03 on n-h1-850468-18 Aug 25 13:38:14.791523 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c079ea61-0c6e-4831-8132-99a2ff188119 req-2cfdc4b2-af3f-4845-a401-7f452e4999e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104424 Aug 25 13:38:14.797402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2874/5824] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:14.798574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:14.801379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:14.802459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:14.808955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:14.812890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:14.821088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:14.974389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:15.003597 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb59eb2d-3c39-413c-98f2-04faeaf2b029 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1484 microversion: 2.1 time: 0.260645 Aug 25 13:38:15.005509 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2951/5825] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:14 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1484 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:15.541499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:15.549210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:15.573837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:15.582086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:15.588756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:15.597055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:15.598912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:15.605735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:16.063624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:16.067801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:16.097552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:16.100740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:16.101634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:16.102959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:16.115899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:16.116698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:16.120138 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d762f72-2ced-4a5e-bb84-d5cb5712634b tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.588007 Aug 25 13:38:16.123826 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2875/5826] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:15 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:16.289933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:16.315311 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72ec26b5-e4a3-4133-8b57-a5b2bc8f95df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1484 microversion: 2.1 time: 0.260494 Aug 25 13:38:16.322537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2952/5827] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:16 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1484 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:17.171690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:17.177557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:17.214541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:17.217352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:17.218882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:17.234826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:17.243989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:17.246708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:17.370628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:17.378669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:17.402635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:17.409464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:17.410031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:17.411411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:17.412314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:17.420155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:17.562454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:17.563771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:17.564939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:17.566172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lazy-loading 'fault' on Instance uuid 79855985-e004-402a-b7c0-0cbebcb93f03 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:38:17.736138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:17.784362 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-49fd28e2-6d59-4383-8eba-b573a46131cc tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 200 len: 1338 microversion: 2.1 time: 0.419897 Aug 25 13:38:17.786283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2953/5828] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:17 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:18.138264 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6614a571-b5b9-42be-b2d5-87de1d99a9a5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.977656 Aug 25 13:38:18.152169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2876/5829] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:17 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:18.845751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:18.847153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 79855985-e004-402a-b7c0-0cbebcb93f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:18.929376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:18.935532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:18.950575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:18.961852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:18.963226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:18.964202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:19.093847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] HTTP exception thrown: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Request method failure captured: Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 HTTP/1.1 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3pImxBGt0fz5pNz5dileWSbgOznxc2Qe83-yeJfDts_vxcg4VbCsiIgsvP9UD8yE0QvpVswsMXcqnOGGs6yKfj2b9tXjKnT8DJ87aGa1DhUAbcy0hsMXDtk7LXsM_7QIrALbKZ-Q-v8-LgtmGlFOrmbzmcaMy3PU4WWEjSka12cmmA Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4be43d8bcae44f3cad6c948cd911221e Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '79855985-e004-402a-b7c0-0cbebcb93f03'} Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:19.097735 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Returning 404 to user: Instance 79855985-e004-402a-b7c0-0cbebcb93f03 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba1722f4-5188-4669-918b-2db5b066ed32 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03" status: 404 len: 111 microversion: 2.1 time: 0.281517 Aug 25 13:38:19.122588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2954/5830] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:18 2022] GET /compute/v2.1/servers/79855985-e004-402a-b7c0-0cbebcb93f03 => generated 111 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:38:19.196473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:19.209945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:19.283724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:19.299572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:19.304264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:19.316739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:19.318460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:19.321050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:20.011696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e65ca44-edc8-4fc6-8ce0-25885f1ea453 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '.version_select at 0x7fc6c2a1b1f0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:20.018168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a93dd38-1786-4a03-bca0-b3f983c51703 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.830343 Aug 25 13:38:20.024901 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2877/5831] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:19 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:20.129480 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e65ca44-edc8-4fc6-8ce0-25885f1ea453 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1594643733" status: 202 len: 0 microversion: 2.1 time: 0.154156 Aug 25 13:38:20.132703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2955/5832] 10.222.0.60 () {58 vars in 1257 bytes} [Thu Aug 25 13:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1594643733 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:38:21.085572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:21.090779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:21.129000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:21.140295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:21.149894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:21.160451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:21.161930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:21.169040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:21.828428 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-acb17657-fd85-410e-8a5e-0b7e9af47981 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.760567 Aug 25 13:38:21.835564 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2878/5833] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:21 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:22.960618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:22.961509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:23.000224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:23.023038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:23.036166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:23.038962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:23.048758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:23.054033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:23.165379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0cb78b4-6ba5-43ad-af44-c78426cd5593", "name": "network-vif-plugged", "status": "completed", "tag": "d0c50d60-f644-4390-90c4-0c4cf4d9bacd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:23.239343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:23.241172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:23.250370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:23.368907 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] Creating event network-vif-plugged:d0c50d60-f644-4390-90c4-0c4cf4d9bacd for instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 on n-h1-850468-18 Aug 25 13:38:23.410582 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bd489842-6099-4ce0-80df-2df313e26232 req-d46951ad-3074-45d4-9d11-b6a55be76a8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256809 Aug 25 13:38:23.429877 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2879/5834] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:23.573099 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5997a64b-f177-4192-833f-663e19313048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.642882 Aug 25 13:38:23.578370 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2956/5835] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:22 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:24.630891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:24.632209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:24.665941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:24.667434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:24.669216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:24.676819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:24.678380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:24.679730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:25.502544 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9fff4a19-b90e-4f73-88d2-6e4b33654048 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1466 microversion: 2.1 time: 0.880623 Aug 25 13:38:25.524185 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2880/5836] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:24 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1466 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:26.573258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:26.574402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:26.595014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:26.602017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:26.603102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:26.604615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:26.610505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:26.611786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.153247 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e8492dbf-5231-4d24-9f50-0f94ea025383 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1652 microversion: 2.1 time: 0.581824 Aug 25 13:38:27.157685 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2957/5837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:26 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1652 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:27.201986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:27.206733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:27.223395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:27.229434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.230904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.233934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.237717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.239575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.241557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.274884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=69 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:27.365066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:27.367664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:27.392718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.394115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.395261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.396999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.398220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.400185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.470421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:38:27.852637 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef17d248-3b3f-434c-ba0d-bcb1e31e4037 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1652 microversion: 2.1 time: 0.656971 Aug 25 13:38:27.857014 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2881/5838] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:27 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1652 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:27.863845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4dd4bbf5-3d4a-4863-a452-50584d61671d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 204 len: 0 microversion: 2.1 time: 0.502251 Aug 25 13:38:27.870522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2958/5839] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:38:27 2022] DELETE /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:38:27.887168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0c0c40-0638-45f6-9ad5-501b32f493f1", "tag": "fea494dd-d600-4269-885f-c69cd057bc0c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:27.906407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:27.912685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:27.921568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.924636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.928380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.937879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.938793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.939629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.942396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:27.945075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:27.946255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:27.966808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] Creating event network-changed:fea494dd-d600-4269-885f-c69cd057bc0c for instance db0c0c40-0638-45f6-9ad5-501b32f493f1 on n-h1-850468-18 Aug 25 13:38:27.983858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c3b25e82-20ca-446e-86c8-5fe49c598331 req-a860ad4e-a3f9-4bea-a1e6-0d72b9d9255a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112947 Aug 25 13:38:27.991484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2882/5840] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:28.007413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:28.028662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:28.046196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:28.049341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:28.050654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:28.060149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:28.065401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:28.069821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:28.540346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:28.554371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:28.572616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c4b4cc5f-8b95-43d6-b273-f0ee40f79327 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1666 microversion: 2.1 time: 0.692815 Aug 25 13:38:28.575757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2959/5841] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:27 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1666 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:28.711751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d70f8074-60a6-443d-877b-1d2001fab652 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1652 microversion: 2.1 time: 0.717555 Aug 25 13:38:28.712712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2883/5842] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:27 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1652 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:29.112670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1521082455", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "availability_zone": "nova:n-h2-850468-18", "networks": [{"uuid": "95ab2802-78fe-478b-98ae-63e29bee4592"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:29.160102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:29.389222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] validate_networks() for [('95ab2802-78fe-478b-98ae-63e29bee4592', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:38:29.617507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:29.622853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:29.654543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:29.659064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:29.660638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:29.664802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:29.666105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:29.671287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:30.458153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:30.491337 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-15ac19f2-d811-4694-8344-8e8e9d043124 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1666 microversion: 2.1 time: 0.881153 Aug 25 13:38:30.494669 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2884/5843] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:29 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1666 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:31.556971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:31.561205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:31.639151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:31.644712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:31.646795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:31.654818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:31.658897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:31.663083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:32.474544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:38:32.477234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:38:32.478134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:38:32.478838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:38:32.479387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:38:32.553181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:32.557141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:32.558215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:32.561977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:32.577554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:32.578763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:32.662504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Getting quotas for project a994af9a7e1a4af4b415208e5f2c41b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:38:32.680237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Getting quotas for user 854356347c9a48568a34072107bc84fd and project a994af9a7e1a4af4b415208e5f2c41b3. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:38:32.724448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:38:32.730721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:38:32.866314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4034f3db-12de-4284-9d9e-1346188ac009 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.767435 Aug 25 13:38:32.869431 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2960/5844] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:38:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:38:32.891906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6aae09d2-54ac-4c7a-bb2f-20c2487c1b2a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:32.894198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6aae09d2-54ac-4c7a-bb2f-20c2487c1b2a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:33.038805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:33.057945 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18c13579-e0f6-4ca3-a176-ecaff3f9cfa9 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1548 microversion: 2.1 time: 1.518400 Aug 25 13:38:33.059922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2885/5845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:31 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1548 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:33.190429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0c0c40-0638-45f6-9ad5-501b32f493f1", "name": "network-vif-deleted", "tag": "fea494dd-d600-4269-885f-c69cd057bc0c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:33.243170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:33.256850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:33.263673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:33.271527 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6aae09d2-54ac-4c7a-bb2f-20c2487c1b2a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1329 microversion: 2.1 time: 0.385182 Aug 25 13:38:33.275575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2961/5846] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:32 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1329 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:33.304960 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] Creating event network-vif-deleted:fea494dd-d600-4269-885f-c69cd057bc0c for instance db0c0c40-0638-45f6-9ad5-501b32f493f1 on n-h1-850468-18 Aug 25 13:38:33.316188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-89e51cad-f31f-40cd-b811-7066bba9e835 req-b748c2cf-d9f2-440e-be32-b98441ac7033 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133284 Aug 25 13:38:33.318302 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2886/5847] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:38:34.122490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:34.127506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:34.162834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:34.166817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:34.168078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:34.172662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:34.174249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:34.176973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:34.305410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:34.306400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:34.307012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:34.307928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lazy-loading 'fault' on Instance uuid db0c0c40-0638-45f6-9ad5-501b32f493f1 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:38:34.313257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:34.314604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:34.346663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:34.347527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:34.348363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:34.349882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:34.353937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:34.355054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:34.443274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:38:34.476474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e683e890-7696-482c-a8cc-e56c01d1f895 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 200 len: 1337 microversion: 2.1 time: 0.363337 Aug 25 13:38:34.478549 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2962/5848] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:34 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 1337 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:34.565054 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69c8f9b0-8ec7-4075-847c-b9fe3a989a11 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1346 microversion: 2.1 time: 0.261624 Aug 25 13:38:34.576522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2887/5849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:34 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1346 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:35.517407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:35.518618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: db0c0c40-0638-45f6-9ad5-501b32f493f1] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:35.549039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:35.549870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:35.551386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:35.552803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:35.553652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:35.554478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:35.597384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:35.603306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:35.604367 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] HTTP exception thrown: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Request method failure captured: Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 HTTP/1.1 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3pImxBGt0fz5pNz5dileWSbgOznxc2Qe83-yeJfDts_vxcg4VbCsiIgsvP9UD8yE0QvpVswsMXcqnOGGs6yKfj2b9tXjKnT8DJ87aGa1DhUAbcy0hsMXDtk7LXsM_7QIrALbKZ-Q-v8-LgtmGlFOrmbzmcaMy3PU4WWEjSka12cmmA Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 4be43d8bcae44f3cad6c948cd911221e Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'db0c0c40-0638-45f6-9ad5-501b32f493f1'} Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:38:35.608826 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. Aug 25 13:38:35.617295 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:38:35.619899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Returning 404 to user: Instance db0c0c40-0638-45f6-9ad5-501b32f493f1 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:38:35.622938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a269b59f-59e5-4dc7-9af7-a1d235871b2b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1" status: 404 len: 111 microversion: 2.1 time: 0.113384 Aug 25 13:38:35.631051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2963/5850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:35 2022] GET /compute/v2.1/servers/db0c0c40-0638-45f6-9ad5-501b32f493f1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:38:35.661486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:35.665366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:35.676239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:35.678605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:35.682959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:35.685378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:35.927869 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64e55f4c-80a2-451c-9989-51b07c79c4a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1424 microversion: 2.1 time: 0.342955 Aug 25 13:38:35.928986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2888/5851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:35 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1424 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:36.171612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab7e80fa-ea1a-417c-bd82-d4d273876972 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '.version_select at 0x7fc6c1d5c700>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:36.253892 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab7e80fa-ea1a-417c-bd82-d4d273876972 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-224760319" status: 202 len: 0 microversion: 2.1 time: 0.112551 Aug 25 13:38:36.254927 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2964/5852] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 13:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-224760319 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:38:36.979810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:36.990098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:37.035317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:37.043705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:37.046044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:37.051093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:37.060475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:37.061764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:37.974091 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b08d7793-7fd2-4a4a-8a2b-bb0694ae3e8d tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.001579 Aug 25 13:38:37.995476 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2889/5853] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:36 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:39.055863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:39.057967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:39.083403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:39.085361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:39.088558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:39.090348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:39.091309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:39.093772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:39.769632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4", "tag": "f000f126-0056-42cd-a0e2-2a6bc0bb549a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:39.853122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:39.860174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:39.861087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:39.962380 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] Creating event network-changed:f000f126-0056-42cd-a0e2-2a6bc0bb549a for instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 on n-h2-850468-18 Aug 25 13:38:40.010070 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9fdea70e-e8d9-419a-a897-b44959b3e0f0 req-7b0a30c1-914e-475f-8882-63e2c9ab21bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250806 Aug 25 13:38:40.016839 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2890/5854] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:40.281764 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b586a617-48f0-4950-8032-4d6d24e7c941 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.223903 Aug 25 13:38:40.284276 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2965/5855] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:39 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:41.327977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:41.331402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:41.366864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:41.368093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:41.371825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:41.373980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:41.377513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:41.381545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:42.617403 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-263a55bf-9bb7-4d24-ad0d-10f2aba707d7 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.295757 Aug 25 13:38:42.632897 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2891/5856] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:41 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:43.677583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:43.680081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:43.708473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:43.712988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:43.720690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:43.723248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:43.726288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:43.729327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:43.730646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:43.732488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:44.240888 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a479314a-2196-4013-96e3-5f7f6b9f6f4e tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 0.578491 Aug 25 13:38:44.241965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2966/5857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:43 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:45.282535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:45.283408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:45.295475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:45.296941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:45.297864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:45.301101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:45.302556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:45.303749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:47.043055 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7805e29-eaaf-464b-864e-e06df3172b9a tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.763007 Aug 25 13:38:47.065583 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2892/5858] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:45 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:48.090308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:48.095119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:48.132245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:48.134749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:48.138836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:48.143178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:48.148517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:48.149561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:49.555617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-debcfc52-e9e2-476e-9d0f-4655e78c4d69 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.472520 Aug 25 13:38:49.565691 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2967/5859] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:48 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:38:50.611627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:50.618775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:50.677091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4", "name": "network-vif-plugged", "status": "completed", "tag": "f000f126-0056-42cd-a0e2-2a6bc0bb549a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:38:50.686877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:50.738181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:50.741916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:50.748153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.059s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:50.750270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:50.753395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:50.753661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:50.754695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:50.755578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:50.837880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] Creating event network-vif-plugged:f000f126-0056-42cd-a0e2-2a6bc0bb549a for instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 on n-h2-850468-18 Aug 25 13:38:50.898476 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fb3b22e3-01ac-4a14-9217-53c3878d65d1 req-339cae28-6f8b-40c8-8208-2e69cd9ab900 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234179 Aug 25 13:38:50.913411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2968/5860] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:38:51.692741 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af146850-2408-4833-af6c-7ca5d3c00db0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 1.086959 Aug 25 13:38:51.695854 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2893/5861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:50 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:52.741451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:52.744155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:52.783504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.785789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.787814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:52.790080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:52.794276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:52.795699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:53.512688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5958b677-3d4c-4958-823a-30df6f03e940 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1466 microversion: 2.1 time: 0.780455 Aug 25 13:38:53.514194 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2969/5862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:52 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1466 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:54.557849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:54.559959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:54.595245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:54.596218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:54.597101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:54.598758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:54.599400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:54.600059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:55.457301 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6312e05-071d-4f8c-88ec-74985eedf6a4 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1651 microversion: 2.1 time: 0.906133 Aug 25 13:38:55.472206 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2894/5863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:54 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1651 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:55.504823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:55.506885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:55.530161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:55.531559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:55.532640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:55.534357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:55.536002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:55.536929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.014519 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7b0ebbb-6c2b-4aa7-a0b8-12539c60da57 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1651 microversion: 2.1 time: 0.516908 Aug 25 13:38:56.018629 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2970/5864] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:55 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1651 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:56.061478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:56.064490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:56.080561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.082495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.083773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.086790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.088086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.089429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.814453 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebf1c3ab-7fa5-494f-bacc-0ee20451e5b5 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1651 microversion: 2.1 time: 0.764688 Aug 25 13:38:56.816153 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2895/5865] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:56 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1651 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:56.873123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:56.874103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:56.895493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.896792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.897903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.899552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:56.901089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:56.902076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:56.982135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:38:57.448284 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65771da8-124f-40e0-ba7c-553f062dd59c tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 204 len: 0 microversion: 2.1 time: 0.589253 Aug 25 13:38:57.450830 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2971/5866] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:38:56 2022] DELETE /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:38:57.468163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:57.475945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:57.485880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=30 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:57.516182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:57.518468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:57.520190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:57.523667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:57.525101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:57.526475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:57.539038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=78 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:57.911096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-23bd5cfc-6030-425c-8ef0-deddc61d5785 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1657 microversion: 2.1 time: 0.451287 Aug 25 13:38:57.913169 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2896/5867] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:57 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1657 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:38:58.957835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:38:58.960838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:38:58.993215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:58.994131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:58.995095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:58.996986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:38:59.003635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:38:59.006445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:38:59.576678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:38:59.611019 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb675fa0-92cc-4612-9113-0b9009c2c449 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1657 microversion: 2.1 time: 0.661889 Aug 25 13:38:59.614963 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2972/5868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:38:58 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1657 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:00.657523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:00.658250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:00.709084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:00.717144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:00.721902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:00.729812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:00.732233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:00.733130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:01.318316 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-86b8989c-02e7-4b84-b1df-0e1b6444e2fb tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1657 microversion: 2.1 time: 0.667057 Aug 25 13:39:01.333922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2897/5869] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:00 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1657 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:02.187478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4", "name": "network-vif-deleted", "tag": "f000f126-0056-42cd-a0e2-2a6bc0bb549a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:02.256626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.257584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.258417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.409757 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] Creating event network-vif-deleted:f000f126-0056-42cd-a0e2-2a6bc0bb549a for instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 on n-h2-850468-18 Aug 25 13:39:02.457118 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bed35815-fd74-474f-8c7c-e9e7f450efc0 req-c5813a29-5bee-4b83-84de-6cb3b8b626c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269288 Aug 25 13:39:02.462584 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2898/5870] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:39:02.499260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:02.518016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:02.580255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.599904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.601087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.606391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.625438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.626320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.883793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:02.885290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:02.886556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:02.887920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lazy-loading 'fault' on Instance uuid fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:39:03.072381 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ec1c258-a403-4ccc-bcfb-ff447beb04b2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 200 len: 1456 microversion: 2.1 time: 0.602554 Aug 25 13:39:03.079733 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2899/5871] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:02 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 1456 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:03.139026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:03.152595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:03.202949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:03.224027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:03.231389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:03.236289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:03.243274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:03.247548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:03.255733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:03.523443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:39:03.962489 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb0c0386-cd2a-43f9-8564-e930522a3e8d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 204 len: 0 microversion: 2.1 time: 2.191841 Aug 25 13:39:03.966353 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2973/5872] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:39:01 2022] DELETE /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 0 bytes in 2197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:39:03.994663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:04.001701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:04.049958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.053027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.057316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.060885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.064232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.070152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.127366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:04.132468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:04.159757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.163037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.165630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.181398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.183037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.189058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.262337 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] HTTP exception thrown: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Request method failure captured: Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 HTTP/1.1 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3s0vUzfOcxUikEWx0cFyfhe7t99WcljJna02gD2KGjEjCDWwbp6b03HX1bvh7t5qYmGp8CSxZ2KELeQaXWyBXhAd7rBBYojQM6Ytt7nli6RxOOuQZ1e3beZhh6nalikGi2_P4xFY6-xS8EV7QXcihQoGPoeCkOhU72Q1xmLFnMQmV8 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a994af9a7e1a4af4b415208e5f2c41b3 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestServerMultinode-970865551 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestServerMultinode-970865551 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a994af9a7e1a4af4b415208e5f2c41b3 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestServerMultinode-970865551 Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestServerMultinode-970865551-project-admin Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 854356347c9a48568a34072107bc84fd Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestServerMultinode-970865551-project-admin Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4'} Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:04.267772 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. Aug 25 13:39:04.281557 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:04.285576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Returning 404 to user: Instance fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:39:04.287779 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cccf0f00-9573-4530-8746-47059fe816a0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4" status: 404 len: 111 microversion: 2.1 time: 0.168059 Aug 25 13:39:04.295552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2974/5873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:04 2022] GET /compute/v2.1/servers/fbe9d66a-6f4a-45b8-9b74-2ab9b2e370b4 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:39:04.304870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:04.309934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:04.369701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.380877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.384275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.391254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:04.393208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:04.397207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:04.611997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:39:04.951296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:04.975361 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1ff8824-60b4-4bd1-8a73-0c1e24e271bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1578 microversion: 2.1 time: 1.001488 Aug 25 13:39:04.985698 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2900/5874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:03 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1578 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:05.226033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de0aa538-37bb-4d0a-b14e-ba6da564969f tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "DELETE /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 204 len: 0 microversion: 2.1 time: 0.927701 Aug 25 13:39:05.248909 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2975/5875] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:39:04 2022] DELETE /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:39:05.257856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:05.259960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:05.346994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:05.347926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.350640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:05.352800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:05.354068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:05.355587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:05.975526 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c9733812-f409-4916-a586-bc383209c505 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1658 microversion: 2.1 time: 0.724630 Aug 25 13:39:05.978052 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2901/5876] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:05 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1658 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:06.054496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:06.063582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:06.108836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:06.109742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:06.110521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:06.111823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:06.122305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:06.126249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:06.839603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:06.876972 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8bbe3ef0-4c37-495a-9d75-ae8b30177469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1578 microversion: 2.1 time: 0.849995 Aug 25 13:39:06.880536 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2976/5877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:06 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1578 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:07.026275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:07.032310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:07.053210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.061178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.064849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:07.071561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.074223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.078464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:07.932290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:07.933036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:07.972328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.976633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.977600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:07.979417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:07.983092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:07.984414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:08.181288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5abc934-d7c0-4999-96c1-913e679deeb0 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1658 microversion: 2.1 time: 1.168450 Aug 25 13:39:08.213077 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2902/5878] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:07 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1658 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:09.035645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:09.110424 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3a49791-319d-41e5-aa87-2e1af8501dce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1578 microversion: 2.1 time: 1.183088 Aug 25 13:39:09.134572 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2977/5879] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:07 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1578 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:09.234495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:09.237238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:09.252808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:09.254608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:09.256289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:09.258897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:09.265173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:09.266667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:09.676287 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-656a160b-490c-4221-81b6-d11964c52aba tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1616 microversion: 2.1 time: 0.450737 Aug 25 13:39:09.688587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2903/5880] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:09 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1616 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:09.943634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0cb78b4-6ba5-43ad-af44-c78426cd5593", "name": "network-vif-deleted", "tag": "d0c50d60-f644-4390-90c4-0c4cf4d9bacd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:09.985640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:09.986736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:09.988240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.034190 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] Creating event network-vif-deleted:d0c50d60-f644-4390-90c4-0c4cf4d9bacd for instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 on n-h1-850468-18 Aug 25 13:39:10.065981 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8bd38a54-1129-4cfa-a181-e86ae77c924a req-55429db8-7f83-456d-b7f8-4552ebf57d06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117154 Aug 25 13:39:10.067085 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2978/5881] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:39:10.161880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:10.169178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:10.217101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:10.228051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:10.232254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.233492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:10.271498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:10.272504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.717306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:10.718606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:10.754791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:10.755549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:10.756346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.757470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:10.758209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:10.758934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.876367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:10.881811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:10.883932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:10.884965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lazy-loading 'fault' on Instance uuid b0cb78b4-6ba5-43ad-af44-c78426cd5593 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:39:12.133859 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd195605-3189-4083-9d92-d92c4e2f6b99 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 200 len: 1456 microversion: 2.1 time: 1.424923 Aug 25 13:39:12.136244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2979/5882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:10 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 1456 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:12.175020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829a5ea-dc2a-430b-9e60-768191508fec", "name": "network-vif-unplugged", "status": "completed", "tag": "2939bc32-d31b-49de-ac93-105057e420b7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:12.206336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:12.207691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:12.209114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:12.234403 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] Creating event network-vif-unplugged:2939bc32-d31b-49de-ac93-105057e420b7 for instance 4829a5ea-dc2a-430b-9e60-768191508fec on n-h1-850468-18 Aug 25 13:39:12.241297 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a27b5e9f-b550-40b7-a920-961b91a52549 req-54810faa-8857-403d-9dee-1ad90ef9c538 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101702 Aug 25 13:39:12.242965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2980/5883] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:12.673628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:12.705495 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f55c25f1-54a9-4fa3-9166-d77f64549b1d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1578 microversion: 2.1 time: 2.551122 Aug 25 13:39:12.712181 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2904/5884] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:10 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1578 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:13.201651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:13.203192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] [instance: b0cb78b4-6ba5-43ad-af44-c78426cd5593] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:13.254955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:13.255871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:13.267272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:13.268834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:13.269725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:13.270539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:13.367492 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] HTTP exception thrown: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Request method failure captured: Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 HTTP/1.1 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3s0vUzfOcxUikEWx0cFyfhe7t99WcljJna02gD2KGjEjCDWwbp6b03HX1bvh7t5qYmGp8CSxZ2KELeQaXWyBXhAd7rBBYojQM6Ytt7nli6RxOOuQZ1e3beZhh6nalikGi2_P4xFY6-xS8EV7QXcihQoGPoeCkOhU72Q1xmLFnMQmV8 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a994af9a7e1a4af4b415208e5f2c41b3 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestServerMultinode-970865551 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a994af9a7e1a4af4b415208e5f2c41b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestServerMultinode-970865551 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a994af9a7e1a4af4b415208e5f2c41b3 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestServerMultinode-970865551 Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestServerMultinode-970865551-project-admin Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 854356347c9a48568a34072107bc84fd Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestServerMultinode-970865551-project-admin Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'b0cb78b4-6ba5-43ad-af44-c78426cd5593'} Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:13.374248 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. Aug 25 13:39:13.384333 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:13.389105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] Returning 404 to user: Instance b0cb78b4-6ba5-43ad-af44-c78426cd5593 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:39:13.392604 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1cf1982e-1feb-4182-8e5c-4683c1b1d1d2 tempest-TestServerMultinode-970865551 tempest-TestServerMultinode-970865551-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593" status: 404 len: 111 microversion: 2.1 time: 0.212958 Aug 25 13:39:13.398477 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2981/5885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:13 2022] GET /compute/v2.1/servers/b0cb78b4-6ba5-43ad-af44-c78426cd5593 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:39:13.757141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:13.761987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:13.794645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:13.795703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:13.796625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:13.798153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:13.799190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:13.813114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:14.137909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:14.160955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-576d8247-6397-47ef-b1b8-918bab6d4886 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1510 microversion: 2.1 time: 0.411430 Aug 25 13:39:14.178929 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2905/5886] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:13 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:14.587277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829a5ea-dc2a-430b-9e60-768191508fec", "name": "network-vif-deleted", "tag": "2939bc32-d31b-49de-ac93-105057e420b7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:14.650734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:14.654401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:14.658249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:14.743530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] Creating event network-vif-deleted:2939bc32-d31b-49de-ac93-105057e420b7 for instance 4829a5ea-dc2a-430b-9e60-768191508fec on n-h1-850468-18 Aug 25 13:39:14.773404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d2b0c139-853e-44b4-8e45-ef38e6c64498 req-0019a4af-0c9f-4d03-82fd-f8c1ddb24682 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210184 Aug 25 13:39:14.816179 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2906/5887] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:39:14.991241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cf99c15-025a-440b-8970-bfb49c089092 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: .version_select at 0x7fc6c17e9820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1775824943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlP/9VATtkrzZrjOsePidnFBIlUxU9FMngmFsu0gIxnGDieiC3+uUOa8/28SLpbNDqjMpOf3eXTPN9FkH0OgBodLKUhKumxukbZOEtDHgufat/HDs+meMqJlmnBUyG64Q=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:15.073944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4cf99c15-025a-440b-8970-bfb49c089092 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:39:15.105221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4cf99c15-025a-440b-8970-bfb49c089092 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:39:15.209303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:15.210662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:15.250880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4cf99c15-025a-440b-8970-bfb49c089092 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.180024 Aug 25 13:39:15.253548 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2982/5888] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:39:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:39:15.303235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:15.304844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:15.312563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:15.320572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:15.327877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:15.330096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:15.722700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:15.779442 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac5c2e2c-340a-409b-801c-0663f988bb52 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.575178 Aug 25 13:39:15.811816 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2907/5889] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:15 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:16.825712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:16.831375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:16.889949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:16.891299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:16.892581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:16.894387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:16.907890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:16.909523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:17.969674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:18.024605 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65e59cff-acde-40a3-8c45-c094edafacd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 1.207863 Aug 25 13:39:18.040059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2983/5890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:16 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:19.089969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:19.091164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:19.109260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:19.110294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:19.118947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:19.120853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:19.130344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:19.131271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:19.584602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:19.647031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28d06c64-8772-48e6-bf17-9dfcc7ce471c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.563988 Aug 25 13:39:19.649890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2908/5891] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:19 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:20.692813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:20.693975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:20.715116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:20.715682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:20.721746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:20.722694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:20.723544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:20.728622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:20.925927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:20.952664 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3252abff-fe23-43a2-9fc5-e12928937c04 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.273284 Aug 25 13:39:20.953913 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2984/5892] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:20 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:21.989741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:21.992716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:22.010291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:22.014086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:22.015654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:22.018060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:22.020641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:22.022327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:22.272042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:22.331443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c89fecdc-d53b-4b33-b85f-58f91bc229fc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.351780 Aug 25 13:39:22.353025 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2909/5893] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:21 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:23.390235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:23.396630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:23.440988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:23.448934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:23.456879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:23.458959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:23.460348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:23.465957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:24.372620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:24.423283 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0311cebf-6952-4b32-8250-ce9cd928d6f6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 1.036426 Aug 25 13:39:24.430444 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2985/5894] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:23 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:25.488788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:25.493911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:25.540936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:25.545497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:25.546352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:25.547760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:25.556165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:25.557448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:25.883813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:25.911082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e46faf3-e0ec-4e5d-aef2-b44bd11aff8a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.436468 Aug 25 13:39:25.912978 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2910/5895] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:25 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:26.597483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1932148451", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1567311a-067b-4897-862b-77d2f8ffcda5"}], "key_name": "tempest-TestNetworkBasicOps-1775824943", "security_groups": [{"name": "tempest-secgroup-smoke-1459951172"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:26.722715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:26.963069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:26.964071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:27.005752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:27.007732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:27.014718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:27.022533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:27.023974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:27.037719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:27.505176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:27.581577 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-149f1ce1-1ad9-4eaa-8753-c58f4438bbe5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.627880 Aug 25 13:39:27.589150 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2911/5896] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:26 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:27.967120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] validate_networks() for [('1567311a-067b-4897-862b-77d2f8ffcda5', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:39:28.645591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:28.648277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:28.682843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=34 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:28.693664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:28.695109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:28.699326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:28.704661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:28.707413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:28.711025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:28.805147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=90 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:29.037188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:29.064708 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-faa355ef-9f3c-4e91-9b43-c5e21ea026f4 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.437249 Aug 25 13:39:29.081030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2912/5897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:28 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:30.116729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:30.119814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:30.150863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.151790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.161681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:30.163401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.164353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.170523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:30.528470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:30.575275 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e847371b-162e-47b9-a625-9a250e695b49 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1225 microversion: 2.1 time: 0.467243 Aug 25 13:39:30.582920 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2913/5898] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:30 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1225 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:30.850007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:39:30.850780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:39:30.852560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:39:30.853669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:39:30.855123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:39:30.912842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.919117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.919878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:30.921971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:30.924294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:30.929338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:31.004467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:39:31.044064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Getting quotas for user 4be43d8bcae44f3cad6c948cd911221e and project d2021ce7e759432d9b52ceffeb30bd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:39:31.112959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:39:31.130371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:39:31.355595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec550e55-747e-468f-8a25-50e32cd5b213 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.786395 Aug 25 13:39:31.370216 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2986/5899] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:39:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 4803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:39:31.384509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-690867ce-0a65-4d51-81cd-9c8b494fd931 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:31.387554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-690867ce-0a65-4d51-81cd-9c8b494fd931 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:31.642280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:31.654380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:31.711380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:31.715293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-690867ce-0a65-4d51-81cd-9c8b494fd931 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:31.716468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:31.720487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:31.728666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:31.734151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:31.740602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:31.753079 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-690867ce-0a65-4d51-81cd-9c8b494fd931 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1249 microversion: 2.1 time: 0.372993 Aug 25 13:39:31.757947 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2914/5900] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:31 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1249 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:31.863169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:32.804924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a99d5708-ce22-446d-9a8b-cbe27c845e25 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:32.807195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a99d5708-ce22-446d-9a8b-cbe27c845e25 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:33.056359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a99d5708-ce22-446d-9a8b-cbe27c845e25 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:33.087746 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a99d5708-ce22-446d-9a8b-cbe27c845e25 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1249 microversion: 2.1 time: 0.295972 Aug 25 13:39:33.092470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2915/5901] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:32 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1249 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:33.211577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:33.249942 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25391e5a-fc8e-423c-a2e6-3fa57ea85b79 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 200 len: 1179 microversion: 2.1 time: 1.626446 Aug 25 13:39:33.255281 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2987/5902] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:31 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 1179 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:34.144623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:34.156784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:34.211700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.219530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.227018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.235354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.235354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.235354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.312959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:34.314352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:34.362366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:34.379652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.385511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.388437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.390167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:34.396371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:34.397216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:34.473366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec HTTP/1.1 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '4829a5ea-dc2a-430b-9e60-768191508fec'} Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:39:34.479647 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:39:34.489063 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:39:34.491303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:39:34.494172 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a61e276-1ec8-4534-adeb-04478d241dc2 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 404 len: 111 microversion: 2.1 time: 0.192029 Aug 25 13:39:34.513469 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2988/5903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:34 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:39:34.701724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:34.734406 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3a22dc2b-4f4a-4161-9aaa-80bf7dfa1e4b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1301 microversion: 2.1 time: 0.606461 Aug 25 13:39:34.735666 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2916/5904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:34 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1301 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:34.984249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1596546187", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-536620425", "security_groups": [{"name": "tempest-secgroup-smoke-1545881986"}], "block_device_mapping_v2": [{"uuid": "7c59401d-c34d-482d-8c15-ad6da106e4bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:35.566092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:39:35.778516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:35.782063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:35.810248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:35.815324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:35.817722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:35.819854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:35.821750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:35.823255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:36.132540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:36.169278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d820b1f-f124-4715-9565-50dc8265670d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1307 microversion: 2.1 time: 0.397734 Aug 25 13:39:36.194017 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2917/5905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:35 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:37.229468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:37.232706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:37.248924 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:39:37.249264 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:39:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c (ip 10.222.0.60) !!! Aug 25 13:39:37.278261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:37.279345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:37.280234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:37.285254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:37.286300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:37.301151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:37.647652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:37.668413 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f7f23f55-6b55-4988-94b6-4bad629e6e76 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1307 microversion: 2.1 time: 0.449400 Aug 25 13:39:37.670032 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2918/5906] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:37 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:38.244502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:39:38.245261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:39:38.247454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:39:38.248255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:39:38.249325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:39:38.300771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.302272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.303479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:38.305783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.307085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.308300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:38.396416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:39:38.419737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:39:38.660587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:39:38.665555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c59401d-c34d-482d-8c15-ad6da106e4bc',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:39:38.718619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:38.735795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:38.768033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.769041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.774121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:38.802816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:38.810750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:38.812571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:39.195773 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7af45251-d3a6-4788-a6f6-52750051a2eb tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.220832 Aug 25 13:39:39.245999 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2989/5907] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:39:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 4272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:39:39.272350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70c4cb89-b103-4a70-b238-c38f66a2aa4a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:39.272350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70c4cb89-b103-4a70-b238-c38f66a2aa4a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:39.586959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70c4cb89-b103-4a70-b238-c38f66a2aa4a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:39.611918 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70c4cb89-b103-4a70-b238-c38f66a2aa4a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1094 microversion: 2.1 time: 0.362480 Aug 25 13:39:39.614764 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2990/5908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:39 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1094 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:39.757630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:39.792191 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31242c76-f03a-4397-b298-9b416dd45eaf tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 1.081151 Aug 25 13:39:39.808889 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2919/5909] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:38 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:40.674130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f4c9da9-5acd-4c4a-8b53-7e8c1940cbd7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:40.677675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f4c9da9-5acd-4c4a-8b53-7e8c1940cbd7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:40.845044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:40.849384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:40.882985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:40.897884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:40.906586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:40.908528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:40.921530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:40.922903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:41.227969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f4c9da9-5acd-4c4a-8b53-7e8c1940cbd7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:41.259871 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f4c9da9-5acd-4c4a-8b53-7e8c1940cbd7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1094 microversion: 2.1 time: 0.607768 Aug 25 13:39:41.261958 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2991/5910] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:40 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1094 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:41.629597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:41.669469 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-118ad447-abd2-486d-a5c9-c8e667175b4d tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 0.836451 Aug 25 13:39:41.671034 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2920/5911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:40 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:42.301986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:42.305987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:42.338248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:42.340855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:42.343215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:42.349975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:42.350867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:42.358180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:42.572792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:42.630011 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a58c10f4-19f1-4cd0-9d04-07d4acd0fec9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1136 microversion: 2.1 time: 0.335821 Aug 25 13:39:42.631038 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2992/5912] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:42 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1136 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:42.733847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:42.737169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:42.754181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:42.756200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:42.757586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:42.759556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:42.766092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:42.769692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:43.087260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:43.318381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990ef78b-7c5d-4fc4-9138-7e31310d8a6c", "tag": "89d41a99-36d7-4e40-9a54-99c5ed532779"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:43.428404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:43.434029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:43.437036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:43.506622 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] Creating event network-changed:89d41a99-36d7-4e40-9a54-99c5ed532779 for instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c on n-h2-850468-18 Aug 25 13:39:43.533950 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5a2f6c92-cbd7-4ff2-a583-c86a765002ba req-9214454d-a039-4756-a071-7d36b7b7099c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238061 Aug 25 13:39:43.536265 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2993/5913] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:39:43.692726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:43.694086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:43.757311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:43.766427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:43.767720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:43.771267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:43.780398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:43.784409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:44.464104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:44.538495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14175e7c-f3cb-4783-9a00-c2c9aa4253e8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1200 microversion: 2.1 time: 0.863230 Aug 25 13:39:44.542935 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2994/5914] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:43 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1200 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:45.096460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:45.132371 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97b9979b-68f3-4a09-ac49-1b48ae76ec06 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 2.416329 Aug 25 13:39:45.136821 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2921/5915] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:42 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 2425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:45.600687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:45.602163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:45.654137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:45.655120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:45.655917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:45.657347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:45.658220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:45.659023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:45.973338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:46.009498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1b95e9a9-141b-4b0a-9ea3-5d54f7783f35 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1210 microversion: 2.1 time: 0.421444 Aug 25 13:39:46.023862 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2995/5916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:45 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1210 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:46.209947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:46.218632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:46.272493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:46.272493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:46.272493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:46.274402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:46.278849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:46.280139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:46.724311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:46.747444 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e9a5af8-f995-4fd1-bb39-656a7eb704df tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 0.546387 Aug 25 13:39:46.754996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2922/5917] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:46 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:47.070711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:47.074846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:47.104247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.106899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.109832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:47.111981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.114093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.117174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:47.715728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:47.770952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6c30185-4b70-4977-be08-7dd34ebf267c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1210 microversion: 2.1 time: 0.713571 Aug 25 13:39:47.772401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2996/5918] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:47 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1210 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:47.801280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:47.806958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:47.842596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.844353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.845529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:47.847170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:47.849757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:47.853412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:48.826776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:48.833792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:48.846432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:48.892629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:48.893924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:48.894893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:48.896554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:48.899614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:48.901013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:48.986916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:49.009156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce8edb3e-705c-4f0d-b0c8-8778b378a53f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 1.216282 Aug 25 13:39:49.025019 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2923/5919] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:47 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:49.938504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:49.981991 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60f6147a-096e-4c6b-9c24-a8e62893755f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1278 microversion: 2.1 time: 1.163748 Aug 25 13:39:49.986231 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2997/5920] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:48 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1278 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:50.049684 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:50.064702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:50.108447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:50.113576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:50.126987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:50.129264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:50.137153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:50.138417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:51.034493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:51.041391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:51.068271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:51.081102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:51.082538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:51.085202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:51.090097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:51.091218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:51.266656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:39:52.868736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:52.906409 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bd8fc4d-c926-42e6-a77b-4e2093ee7ce4 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 2.865252 Aug 25 13:39:52.908837 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2924/5921] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:50 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:53.484857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:53.502167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-11d5006d-b707-4d6e-a434-6cebf19af161 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1278 microversion: 2.1 time: 2.484910 Aug 25 13:39:53.509914 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2998/5922] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:51 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1278 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:53.951801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:53.957191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:53.989555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:53.991065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:53.993137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:53.999566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.000515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.001212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:54.551549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:54.559964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:54.582104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.583075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.583768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:54.585004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.585792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.586377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:54.755791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:54.794286 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9af7d5fe-85dd-45a5-b536-1cca31604d44 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 0.848351 Aug 25 13:39:54.795992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2925/5923] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:53 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:54.829898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990ef78b-7c5d-4fc4-9138-7e31310d8a6c", "name": "network-vif-plugged", "status": "completed", "tag": "89d41a99-36d7-4e40-9a54-99c5ed532779"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:54.885813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:54.919878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:54.920931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:54.978774 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] Creating event network-vif-plugged:89d41a99-36d7-4e40-9a54-99c5ed532779 for instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c on n-h2-850468-18 Aug 25 13:39:54.991282 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-aa1e2412-244f-4ec6-a7ea-60109a16ff72 req-758ad515-3e39-430c-a794-d4405a54e1b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185161 Aug 25 13:39:55.013249 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2926/5924] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:55.035771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab21daa-b870-4d92-bb5f-f47b9403dbc3", "tag": "1878b03f-356c-4fa4-a593-63568a450ef4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:39:55.059047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:55.060514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:55.062987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:55.124800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] Creating event network-changed:1878b03f-356c-4fa4-a593-63568a450ef4 for instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 on n-h1-850468-18 Aug 25 13:39:55.138183 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9221fb35-be92-4d33-b34a-0a124d9db53e req-69f38564-49d1-4ccc-9178-7b1e2f8267f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115357 Aug 25 13:39:55.139743 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2927/5925] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:39:55.679868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:55.757727 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-76fd5367-1afa-488c-bc5c-9a898ab76934 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1278 microversion: 2.1 time: 1.213752 Aug 25 13:39:55.765959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 2999/5926] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:54 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1278 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:55.827951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:55.828839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:55.838575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:55.839155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:55.840879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:55.841795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:55.842606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:55.845718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:56.546190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:56.612098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-345db174-8e7a-4e81-9f8a-cbfc288fcf9f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1375 microversion: 2.1 time: 0.790035 Aug 25 13:39:56.623576 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2928/5927] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:55 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1375 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:39:56.822493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:56.834928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:56.887909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:56.891127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:56.895357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:56.899346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:56.903409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:56.906434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:57.669292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:57.671595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:57.692863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:57.693720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:57.694383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:57.695340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:57.696048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:57.696789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:58.113812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:39:58.155566 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-823244f9-200a-4c78-8d80-83432efbac3d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1278 microversion: 2.1 time: 1.360457 Aug 25 13:39:58.158993 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3000/5928] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:56 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1278 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:39:59.213565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:39:59.216580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:39:59.240590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:59.243623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:59.244976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:39:59.247886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:39:59.262247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:39:59.267369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:00.773261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:00.802032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=86 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:00.814629 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-498b51db-378c-4725-b86d-f6a667569bd8 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1547 microversion: 2.1 time: 3.149914 Aug 25 13:40:00.815798 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2929/5929] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:57 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1547 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:00.853400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:00.855565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:00.887686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:00.907227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:00.921581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:00.922835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:00.924595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:00.925858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:00.926999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:01.601258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:01.625705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41d235b1-e20e-4de8-a962-7823bd05527c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1278 microversion: 2.1 time: 2.418019 Aug 25 13:40:01.632720 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3001/5930] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:39:59 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1278 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:01.800939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:01.830714 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a268cc42-fb27-48df-8333-20132be6cb96 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1547 microversion: 2.1 time: 0.995208 Aug 25 13:40:01.844174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2930/5931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:00 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1547 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:02.674560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:02.675359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:02.697421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:02.698066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:02.699014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:02.701379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:02.702105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:02.702797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:02.740365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=66 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:02.962567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:02.989707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-81770499-dd54-4de5-926a-cb1386fa52dd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.318627 Aug 25 13:40:03.004153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3002/5932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:02 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:04.021065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:04.021986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:04.052154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:04.053378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:04.055913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:04.060442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:04.077303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:04.078059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:04.529889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:04.587754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d0f284c-c8e9-438f-9914-8502784a09df tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.571091 Aug 25 13:40:04.590779 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2931/5933] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:04 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:40:05.650261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:05.653717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:05.681041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:05.696007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:05.699203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:05.703105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:05.707164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:05.708652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:05.710284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:06.064007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:06.082562 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96159dba-a5d5-4be3-97e8-ad782d790fee tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.439841 Aug 25 13:40:06.084194 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3003/5934] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:05 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:07.134498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:07.143274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:07.204644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:07.206963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:07.211279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:07.225171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:07.243076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:07.248239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:07.618377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990ef78b-7c5d-4fc4-9138-7e31310d8a6c", "tag": "89d41a99-36d7-4e40-9a54-99c5ed532779"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:07.648404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:07.650910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:07.653621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:07.687303 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] Creating event network-changed:89d41a99-36d7-4e40-9a54-99c5ed532779 for instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c on n-h2-850468-18 Aug 25 13:40:07.702030 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-bebbc143-683f-4573-8a73-620089dd9043 req-1b7c633d-b7d5-4375-bf7f-dbf4cbb4b1df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.467411 Aug 25 13:40:07.708766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3004/5935] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:40:07.886263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:07.934278 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6198638-bdda-4e66-8813-5b5dc4181670 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.801582 Aug 25 13:40:07.935418 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2932/5936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:07 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:08.974520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:08.978592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:09.011943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:09.018952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:09.019789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:09.021452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:09.022086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:09.022915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:10.065577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:10.104715 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a44fec61-9607-4553-87e7-a6fdc032d2a8 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 1.143224 Aug 25 13:40:10.111884 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3005/5937] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:08 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:11.157449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:11.165406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:11.192766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:11.195013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:11.196602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:11.198918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:11.200442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:11.202202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:11.927703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:11.951300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fea21817-708e-4451-ac81-4d145eb2fa14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.814875 Aug 25 13:40:11.971773 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2933/5938] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:11 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:12.994019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:12.995154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:13.023404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:13.024347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:13.028212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:13.035657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:13.036959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:13.038012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:13.473238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:13.501577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-38e71bc2-b074-4555-917f-89f4eb406e25 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.514435 Aug 25 13:40:13.520298 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3006/5939] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:12 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:14.553574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:14.556065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:14.585325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:14.587254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:14.588149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:14.591192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:14.592184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:14.593295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:15.405000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:15.427875 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c58546fb-b70a-4ff5-a677-630a3b10a923 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.882123 Aug 25 13:40:15.428682 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2934/5940] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:14 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:16.468899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:16.470120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:16.497164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:16.497900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:16.498702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:16.503853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:16.503853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:16.503853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:16.968788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:16.983761 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b7e6cbbb-006a-43b2-a1e8-4a30338ad916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 0.521210 Aug 25 13:40:16.985736 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3007/5941] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:16 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:18.033844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:18.038652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:18.064974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:18.066719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:18.070169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:18.077353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:18.078433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:18.079644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:18.502503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab21daa-b870-4d92-bb5f-f47b9403dbc3", "name": "network-vif-plugged", "status": "completed", "tag": "1878b03f-356c-4fa4-a593-63568a450ef4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:18.537210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:18.539192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:18.540195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:18.575641 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] Creating event network-vif-plugged:1878b03f-356c-4fa4-a593-63568a450ef4 for instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 on n-h1-850468-18 Aug 25 13:40:18.597600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-23764ca1-5356-4bc5-b409-26f86a313c70 req-c40d3891-29cd-4c31-99ca-f2c2289263f5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.726776 Aug 25 13:40:18.599382 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2935/5942] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:40:19.271962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:19.362861 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ead2724-3980-4a88-b32b-045c0acc86fa tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 1.333801 Aug 25 13:40:19.377875 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3008/5943] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:18 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:20.443012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:20.447084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:20.502118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:20.503501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:20.504752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:20.508279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:20.509935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:20.517796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:21.531024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:21.629854 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e642305-73dd-4ced-80bb-af18440ba4bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1266 microversion: 2.1 time: 1.210661 Aug 25 13:40:21.632959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2936/5944] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:20 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1266 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:21.895533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:21.917964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:21.954906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:21.957553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:21.959523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:21.962829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:21.965323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:21.966977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:22.079729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35fbea6b-4671-4f94-9b80-ec98649e3a4c tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c/action" status: 200 len: 24563 microversion: 2.1 time: 0.192790 Aug 25 13:40:22.081428 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3009/5945] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:21 2022] POST /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c/action => generated 24563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:40:22.693118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:22.699376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:22.728240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:22.730900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:22.730900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:22.730900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:22.731755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:22.737275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:23.518610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:23.547221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c650213-5d7d-4ae3-b87a-6787ad85812e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1453 microversion: 2.1 time: 0.874443 Aug 25 13:40:23.549251 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2937/5946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:22 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1453 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:23.602776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:23.610294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:23.638491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:23.639427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:23.640081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:23.652459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:23.657114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:23.658298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:24.857666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:24.909315 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-be94eeae-59e9-4f1a-8aad-cd7a42092460 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1453 microversion: 2.1 time: 1.314080 Aug 25 13:40:24.918728 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3010/5947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:23 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1453 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:31.369754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab21daa-b870-4d92-bb5f-f47b9403dbc3", "tag": "1878b03f-356c-4fa4-a593-63568a450ef4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:31.411942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:31.421701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:31.428496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:31.429957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:31.453078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=46 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:31.497214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] Creating event network-changed:1878b03f-356c-4fa4-a593-63568a450ef4 for instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 on n-h1-850468-18 Aug 25 13:40:31.527891 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ba3b83b0-1fa8-4fda-ba4a-123464567702 req-35515b70-9a01-4bfb-8490-d26d6ec9eb42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165874 Aug 25 13:40:31.530282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2938/5948] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:40:33.438288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:33.442424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:33.476991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:33.477936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:33.478778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:33.480271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:33.481391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:33.482178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:33.556273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=48 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:33.615340 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ab1a63c3-b340-4a5d-9f9f-43c902e1443b tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "POST /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c/action" status: 200 len: 32641 microversion: 2.1 time: 0.184846 Aug 25 13:40:33.618504 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3011/5949] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:40:33 2022] POST /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c/action => generated 32641 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:40:36.341679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:36.343624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:36.372580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.374023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.375186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.376221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990ef78b-7c5d-4fc4-9138-7e31310d8a6c", "tag": "89d41a99-36d7-4e40-9a54-99c5ed532779"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:36.377997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.379225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.380943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.426627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:36.452435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.453085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.453608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.458846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:40:36.493345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] Creating event network-changed:89d41a99-36d7-4e40-9a54-99c5ed532779 for instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c on n-h2-850468-18 Aug 25 13:40:36.512803 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-47e42818-daa6-4317-93e6-5d5daa307fc1 req-7ce04c61-7fad-4442-9892-706a0edc5e83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145265 Aug 25 13:40:36.519842 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3012/5950] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:40:36.811836 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14f5b5af-a58b-430a-ba6c-b0879a23b23f tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 204 len: 0 microversion: 2.1 time: 0.479622 Aug 25 13:40:36.819554 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2939/5951] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:40:36 2022] DELETE /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:40:36.833294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:36.835094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:36.866809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.867335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.867843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:36.868814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:36.869348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:36.870713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:37.395028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:37.424059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6438abce-8ee1-44e4-895f-6ca70ceb3ead tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1672 microversion: 2.1 time: 0.596242 Aug 25 13:40:37.427148 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3013/5952] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:36 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1672 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:38.477390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:38.485142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:38.523005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:38.523852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:38.524612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:38.536528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:38.537744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:38.538655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:39.718207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:39.757671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1478b47d-c32f-43fe-ba68-83abaf04324a tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1672 microversion: 2.1 time: 1.292675 Aug 25 13:40:39.764903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2940/5953] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:38 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1672 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:40.839101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:40.841454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:40.876393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.879654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.884275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:40.887940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:40.892033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:40.894039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:41.139025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990ef78b-7c5d-4fc4-9138-7e31310d8a6c", "name": "network-vif-deleted", "tag": "89d41a99-36d7-4e40-9a54-99c5ed532779"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:41.270209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:41.273768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:41.286119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:41.343737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be43d8bcae44f3cad6c948cd911221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2021ce7e759432d9b52ceffeb30bd3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:41.353022 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] Creating event network-vif-deleted:89d41a99-36d7-4e40-9a54-99c5ed532779 for instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c on n-h2-850468-18 Aug 25 13:40:41.376661 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f933e984-1f9f-4989-bce6-423197d92e49 req-2e85c42b-c438-4a26-b3c4-2bbf746d1d23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241982 Aug 25 13:40:41.383199 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2941/5954] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:40:41.415215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2efc311-d153-4aca-a378-26264c00b6ad tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 200 len: 1604 microversion: 2.1 time: 0.593240 Aug 25 13:40:41.418190 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3014/5955] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:40 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 1604 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:42.468858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:42.478678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] [instance: 990ef78b-7c5d-4fc4-9138-7e31310d8a6c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:42.509309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:42.514450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:42.518215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:42.523748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:42.527880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:42.531220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:42.616476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] HTTP exception thrown: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Request method failure captured: Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c HTTP/1.1 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3pImxBGt0fz5pNz5dileWSbgOznxc2Qe83-yeJfDts_vxcg4VbCsiIgsvP9UD8yE0QvpVswsMXcqnOGGs6yKfj2b9tXjKnT8DJ87aGa1DhUAbcy0hsMXDtk7LXsM_7QIrALbKZ-Q-v8-LgtmGlFOrmbzmcaMy3PU4WWEjSka12cmmA Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d2021ce7e759432d9b52ceffeb30bd3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestNetworkBasicOps-147762376 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d2021ce7e759432d9b52ceffeb30bd3b Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestNetworkBasicOps-147762376 Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 4be43d8bcae44f3cad6c948cd911221e Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestNetworkBasicOps-147762376-project Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '990ef78b-7c5d-4fc4-9138-7e31310d8a6c'} Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:40:42.626873 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. Aug 25 13:40:42.637262 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:40:42.643555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Returning 404 to user: Instance 990ef78b-7c5d-4fc4-9138-7e31310d8a6c could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:40:42.647243 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f29001cd-09af-4ad6-938b-9602415d9266 tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c" status: 404 len: 111 microversion: 2.1 time: 0.196154 Aug 25 13:40:42.651639 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2942/5956] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:42 2022] GET /compute/v2.1/servers/990ef78b-7c5d-4fc4-9138-7e31310d8a6c => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:40:43.335912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db9db5f5-3ed9-4d2a-b635-86a4a3390b1e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] Calling method '.version_select at 0x7fc6c18854c0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:43.420821 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db9db5f5-3ed9-4d2a-b635-86a4a3390b1e tempest-TestNetworkBasicOps-147762376 tempest-TestNetworkBasicOps-147762376-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1775824943" status: 202 len: 0 microversion: 2.1 time: 0.094088 Aug 25 13:40:43.433237 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3015/5957] 10.222.0.60 () {58 vars in 1257 bytes} [Thu Aug 25 13:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1775824943 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:40:44.475190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2091737625", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:44.724165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] validate_networks() for None {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:40:45.809476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:40:45.811516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:40:45.812481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:40:45.813131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:40:45.813770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:40:45.859855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:45.860746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:45.861876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:45.863874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:45.865472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:45.867043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:45.910792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Getting quotas for project ca3a5bcd0b3d4e30977b642f93cd64cd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:40:45.927934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Getting quotas for user 27c1dbed94ce40d8b08c1379f8a0af18 and project ca3a5bcd0b3d4e30977b642f93cd64cd. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:40:45.973225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:40:45.986305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:40:46.179234 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ceea6839-7c9d-49e3-955d-ddea40790bf4 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711706 Aug 25 13:40:46.190174 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2943/5958] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:40:46.211205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9701a9d5-25f7-4e4d-b6d9-fa182eb0965c tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:46.214338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9701a9d5-25f7-4e4d-b6d9-fa182eb0965c tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:46.424297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9701a9d5-25f7-4e4d-b6d9-fa182eb0965c tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:46.455228 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9701a9d5-25f7-4e4d-b6d9-fa182eb0965c tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1214 microversion: 2.1 time: 0.261383 Aug 25 13:40:46.456695 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3016/5959] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:46 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:47.520425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a506be9f-fa35-4ae6-8609-b646bd424f22 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:47.529142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a506be9f-fa35-4ae6-8609-b646bd424f22 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:47.754860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a506be9f-fa35-4ae6-8609-b646bd424f22 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:47.781052 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a506be9f-fa35-4ae6-8609-b646bd424f22 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1214 microversion: 2.1 time: 0.271919 Aug 25 13:40:47.786259 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2944/5960] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:47 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:48.831127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:48.832375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:48.863673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:48.872852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:48.873875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:48.875403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:48.876321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:48.877157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:49.099522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:49.123344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7209087-6865-45e7-bc91-76a5380524e0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1266 microversion: 2.1 time: 0.300100 Aug 25 13:40:49.125090 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3017/5961] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:48 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:50.171021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:50.173284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:50.190288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.191787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.192983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.194648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:50.196502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:50.197552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:50.334838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:50.357270 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dc12cfef-e531-4a44-af41-b33e23881466 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1272 microversion: 2.1 time: 0.196411 Aug 25 13:40:50.358713 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2945/5962] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:50 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:51.408981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:51.421181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:51.443540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:51.450419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:51.451873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:51.453558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:51.469442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:51.470534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:51.690916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:51.712874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e434e5f4-75f4-46de-b2a3-6b450b538170 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1272 microversion: 2.1 time: 0.313261 Aug 25 13:40:51.721030 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3018/5963] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:51 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:52.769960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:52.774189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:52.821500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:52.827309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:52.842526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:52.858397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:52.866974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:52.868274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:53.670510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:53.708051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8dda80c8-23b7-4281-8b53-ff1ce78b8b7b tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 0.955620 Aug 25 13:40:53.709644 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2946/5964] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:52 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:54.754174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:54.755324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:54.778508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.779373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.780072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:54.784249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:54.785013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:54.785951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:55.433994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b74913c-4164-4874-aa26-86edb6cfa42f", "tag": "87547e7d-2b70-48e5-afed-c8c014c79b54"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:40:55.495659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:55.504092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:55.505449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:55.540272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:55.555480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] Creating event network-changed:87547e7d-2b70-48e5-afed-c8c014c79b54 for instance 4b74913c-4164-4874-aa26-86edb6cfa42f on n-h2-850468-18 Aug 25 13:40:55.585919 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a15c90c4-ba70-4c67-8bfc-7de224cc5ab8 req-bed890d5-5811-4515-835b-ffab21c4ded2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173285 Aug 25 13:40:55.588025 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2947/5965] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:40:55.591844 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c637ba8b-b8ca-42cd-a629-c43333d30342 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 0.847973 Aug 25 13:40:55.593568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3019/5966] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:54 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:56.639781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:56.653750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:56.662664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:56.680771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:56.682158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:56.683372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:56.684028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:56.684570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:56.685022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:57.058592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:57.077215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e563b71d-0bf7-4711-bf2a-8554d8c29fbc tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 0.438482 Aug 25 13:40:57.078453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2948/5967] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:56 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:40:58.119362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:40:58.121272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:40:58.153481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:40:58.165001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:58.181653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:58.183661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:58.185439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:40:58.186689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:40:58.187827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:40:59.108632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:40:59.138522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a931aba9-88d2-4455-ae89-e642e66128eb tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 1.026525 Aug 25 13:40:59.143602 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3020/5968] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:40:58 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:00.179683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:00.195619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:00.200070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:00.236034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:00.237825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:00.239066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:00.240834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:00.242757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:00.244361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:00.762937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:00.794734 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d0134f0-0128-41f4-a7ef-d74287951b96 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 0.617024 Aug 25 13:41:00.796838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2949/5969] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:00 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:00.993453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b74913c-4164-4874-aa26-86edb6cfa42f", "name": "network-vif-plugged", "status": "completed", "tag": "87547e7d-2b70-48e5-afed-c8c014c79b54"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:01.033761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:01.034617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:01.035450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:01.082727 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] Creating event network-vif-plugged:87547e7d-2b70-48e5-afed-c8c014c79b54 for instance 4b74913c-4164-4874-aa26-86edb6cfa42f on n-h2-850468-18 Aug 25 13:41:01.114112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d558a926-d22a-4e97-b845-022d4e961e77 req-0c28696e-955b-4b6f-9bbc-e249e175ba26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147896 Aug 25 13:41:01.115520 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3021/5970] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:01.834924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:01.841574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:01.877978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:01.885091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:01.887648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:01.889461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:01.896447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:01.897898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:01.899509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:01.928771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:03.180039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:03.211613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-32963d80-4e45-4502-9b76-bf02ef1c6c16 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1314 microversion: 2.1 time: 1.383564 Aug 25 13:41:03.212727 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2950/5971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:01 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1314 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:04.273749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:04.275385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:04.292875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:04.294230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:04.294936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:04.296397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:04.297469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:04.298122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:04.304528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=44 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:04.621913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:04.633742 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-925afd25-e9ba-416b-8f62-1dc5faec7899 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1463 microversion: 2.1 time: 0.386342 Aug 25 13:41:04.634916 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3022/5972] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:04 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:04.673011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bf1e762-9ef9-462f-be91-f5c5807390ba", "device": "/dev/sdb"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:04.678899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:04.693066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:04.694086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:04.695365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:04.696775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:04.706242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:04.707189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:05.525576 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea51c4ed-b7ad-423b-80d2-11fb02aaa419 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "POST /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859217 Aug 25 13:41:05.531049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2951/5973] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:41:04 2022] POST /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:09.955630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1261667748", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1ad119ef-52eb-4c67-968b-e497d6985aae"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:09.994093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:10.090505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] validate_networks() for [('1ad119ef-52eb-4c67-968b-e497d6985aae', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:41:11.077610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:41:11.079408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:41:11.080561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:41:11.081447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:41:11.082308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:41:11.102929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:11.104451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:11.105685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:11.107937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:11.109698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:11.110570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:11.155951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Getting quotas for project a6252eecb600470ca940564fe9d8c778. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:41:11.180882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Getting quotas for user 2b4543d52c3b4a18954f0b3eb0c8d4af and project a6252eecb600470ca940564fe9d8c778. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:41:11.225089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:41:11.230475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:41:11.371660 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef85ed48-05e4-40ff-a8f6-f517633de9a0 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793128 Aug 25 13:41:11.398478 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3023/5974] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:41:11.426915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-83dc7132-e454-4b89-8ec7-a69288272033 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:11.427862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-83dc7132-e454-4b89-8ec7-a69288272033 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:11.521259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-83dc7132-e454-4b89-8ec7-a69288272033 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:11.538355 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-83dc7132-e454-4b89-8ec7-a69288272033 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1215 microversion: 2.1 time: 0.125167 Aug 25 13:41:11.558255 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2952/5975] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:11 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:12.581599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21e90cf6-00c2-4a52-ad09-67e4a008e5e1 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:12.585407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21e90cf6-00c2-4a52-ad09-67e4a008e5e1 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:12.769144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21e90cf6-00c2-4a52-ad09-67e4a008e5e1 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:12.790638 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21e90cf6-00c2-4a52-ad09-67e4a008e5e1 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1215 microversion: 2.1 time: 0.215034 Aug 25 13:41:12.794743 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3024/5976] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:12 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:13.834185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:13.835365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:13.867980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:13.869959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:13.871101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:13.872932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:13.874523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:13.875729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:14.132108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:14.168538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d2e7660-89d8-4b26-8c3b-467ecba2844b tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1267 microversion: 2.1 time: 0.337160 Aug 25 13:41:14.170236 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2953/5977] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:13 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:15.222595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:15.223843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:15.252918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:15.254605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:15.255783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:15.261148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:15.262522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:15.263596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:15.491012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:15.516014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd190418-90fc-4b46-9a70-cd78d86f0cf3 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1273 microversion: 2.1 time: 0.307091 Aug 25 13:41:15.519258 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3025/5978] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:15 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:16.570973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:16.574242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:16.616516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:16.618493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:16.620258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:16.625544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:16.627145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:16.628688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:17.963936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:17.988196 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29e33135-95a1-4779-843c-9db76d63af11 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 1.432056 Aug 25 13:41:17.989385 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2954/5979] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:16 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:19.000875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c083fa-1cf5-4c10-9285-32162892dcd5", "tag": "4fe86620-4661-49c1-a036-126ec2693cda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:19.044560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:19.049357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:19.055198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:19.056165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:19.082275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:19.105497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:19.106760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:19.107860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:19.109889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:19.110716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:19.111939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:19.153095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] Creating event network-changed:4fe86620-4661-49c1-a036-126ec2693cda for instance f0c083fa-1cf5-4c10-9285-32162892dcd5 on n-h1-850468-18 Aug 25 13:41:19.167786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-db948b66-6c63-4c47-b0d3-1c6c6cc6bcc6 req-1adfce50-17f6-46b1-b669-b82d239efca0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176344 Aug 25 13:41:19.172694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3026/5980] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:41:19.622780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:19.642944 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2aeb39f1-ccc2-445a-a318-af143e6ae26c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.616744 Aug 25 13:41:19.644598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2955/5981] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:19 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:20.683246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:20.685233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:20.702690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:20.704208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:20.705341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:20.708277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:20.709582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:20.710535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:21.098843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:21.116287 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ad1a821b-aa6b-4cfe-bdff-301103b1997c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.440429 Aug 25 13:41:21.117999 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3027/5982] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:20 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:22.157721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:22.167864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:22.169525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:22.181053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:22.182174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:22.183738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:22.185523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:22.186800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:22.188222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:22.733645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:22.755897 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1c006fa-7ff7-44c7-9a06-dcb14770d91f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.602299 Aug 25 13:41:22.758305 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2956/5983] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:22 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:23.797049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:23.804053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:23.842247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:23.848440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:23.852593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:23.854597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:23.855546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:23.857169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:23.857937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:23.859029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:24.235674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:24.249067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-df5a02f6-0ecf-4682-abc6-772e1bed5021 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.462547 Aug 25 13:41:24.268095 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3028/5984] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:23 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:25.304724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:25.311761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:25.366296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:25.373494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:25.374733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:25.381912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:25.389734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:25.390242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:25.623343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c083fa-1cf5-4c10-9285-32162892dcd5", "name": "network-vif-plugged", "status": "completed", "tag": "4fe86620-4661-49c1-a036-126ec2693cda"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:25.701020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:25.704724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:25.707552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:25.754308 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] Creating event network-vif-plugged:4fe86620-4661-49c1-a036-126ec2693cda for instance f0c083fa-1cf5-4c10-9285-32162892dcd5 on n-h1-850468-18 Aug 25 13:41:25.775791 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9dc09210-54d8-48f6-a538-18fd4ee1b9ec req-907ea4be-0e05-4f73-85e2-11d3a021b494 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165373 Aug 25 13:41:25.777938 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3029/5985] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:41:25.782594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:25.809172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8050326-19a4-4723-95d0-1ffb80df7e69 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.523906 Aug 25 13:41:25.811122 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2957/5986] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:25 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:26.854578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:26.856311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:26.868834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:26.890021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:26.890021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:26.890021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:26.890021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:26.891414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:27.239080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:27.262082 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47fc9d1a-f727-432e-897b-0a88a445a6a8 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1315 microversion: 2.1 time: 0.418152 Aug 25 13:41:27.266283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3030/5987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:26 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:28.318466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:28.319673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:28.337893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:28.340143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:28.341099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:28.342572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:28.343485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:28.344368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:28.673912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:28.713761 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8809a5b3-05a4-46dc-b990-358694af2c77 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1502 microversion: 2.1 time: 0.411029 Aug 25 13:41:28.715635 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2958/5988] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:28 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:28.754527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:28.756729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:28.773002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:28.774436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:28.776914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:28.778770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:28.779991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:28.781376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:29.130126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:29.148902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6aa68302-9044-4391-8000-36e43e5585cb tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1502 microversion: 2.1 time: 0.401005 Aug 25 13:41:29.151537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3031/5989] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:28 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:29.192184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:29.193226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:29.205055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:29.205992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:29.206968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:29.208348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:29.209612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:29.210233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:29.267351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lazy-loading 'flavor' on Instance uuid f0c083fa-1cf5-4c10-9285-32162892dcd5 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:41:29.462599 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6b657785-f45c-4d67-aca6-58dde2a807d4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action" status: 202 len: 0 microversion: 2.1 time: 0.277683 Aug 25 13:41:29.465077 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2959/5990] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:41:29 2022] POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:41:29.481284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:29.485338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:29.517814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:29.521054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:29.522735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:29.528433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:29.531381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:29.532875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:30.100373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:30.141974 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1c4cb7fe-039f-4d4d-9f51-a912e03b8a8e tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1510 microversion: 2.1 time: 0.668838 Aug 25 13:41:30.156159 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3032/5991] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:29 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1510 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:31.194188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:31.196089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:31.215751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.216968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.218067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.219816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.221146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.222149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.633259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:31.654857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-29791e18-a493-403c-8e27-4e392a56c5c7 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1493 microversion: 2.1 time: 0.471987 Aug 25 13:41:31.656872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2960/5992] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:31 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1493 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:31.705473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:31.707047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:31.734148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.735758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.736924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.738569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:31.739881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:31.741298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:31.965899 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0993b405-d81e-4124-86ae-4b7508652644 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action" status: 202 len: 0 microversion: 2.1 time: 0.270343 Aug 25 13:41:31.968437 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3033/5993] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:41:31 2022] POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:41:31.984350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:31.986225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:32.014260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:32.015036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:32.015760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:32.029369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:32.030227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:32.031413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:32.134091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:32.691945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:32.733785 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-49711203-e1b4-4715-8699-5613ada12da6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1499 microversion: 2.1 time: 0.757766 Aug 25 13:41:32.739413 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2961/5994] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:31 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1499 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:33.796499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:33.799335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:33.814999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:33.816264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:33.823778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:33.823778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:33.823778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:33.823778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:34.192738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:34.226750 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-059031da-079a-4793-acec-5a9bda971ca4 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1499 microversion: 2.1 time: 0.444360 Aug 25 13:41:34.229105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3034/5995] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:33 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1499 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:35.298178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:35.299698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:35.311361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=26 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:35.315098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.316690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.317926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.319507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.320654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.321803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.702273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:35.752170 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e2e363a-8926-4138-ab0a-a6d41c342edf tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1502 microversion: 2.1 time: 0.468371 Aug 25 13:41:35.769586 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2962/5996] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:35 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1502 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:35.797956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:35.799314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:35.817950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.819370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.820761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.821896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:35.822885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:35.823713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:35.828478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:35.906043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lazy-loading 'flavor' on Instance uuid f0c083fa-1cf5-4c10-9285-32162892dcd5 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:41:36.098389 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ca992d9-8d0a-4240-848b-0a85185c8c7f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action" status: 202 len: 0 microversion: 2.1 time: 0.309113 Aug 25 13:41:36.100286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3035/5997] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:41:35 2022] POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:41:36.128713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:36.131073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:36.158466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:36.159867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:36.161252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:36.163870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:36.165432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:36.167067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:36.592693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:36.610784 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ac4aed8d-bef8-4a4b-ac8a-c5b208b167d5 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1510 microversion: 2.1 time: 0.491781 Aug 25 13:41:36.612693 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2963/5998] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:36 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:37.659860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:37.676946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:37.680428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:37.681240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:37.682801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:37.683586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:37.684339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:37.685258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:38.077232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:38.100396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2e0c45d4-b414-4628-aed9-ff6cd37e6c52 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1493 microversion: 2.1 time: 0.452192 Aug 25 13:41:38.101834 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3036/5999] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:37 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1493 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:38.154549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:38.157836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:38.190528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:38.190528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:38.190528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:38.191601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:38.196252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:38.198908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:38.398299 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ccab780b-3855-4e84-a5f3-df66c502011f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action" status: 202 len: 0 microversion: 2.1 time: 0.251744 Aug 25 13:41:38.407925 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2964/6000] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:41:38 2022] POST /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:41:38.455208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:38.462138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:38.490745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:38.492313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:38.493888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:38.497056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:38.498947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:38.500449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:39.051316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:39.073844 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b529fd55-5402-4d78-aa8b-98fb6503ba8a tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1499 microversion: 2.1 time: 0.657929 Aug 25 13:41:39.075416 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3037/6001] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:38 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1499 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:41:40.114831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:40.119165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:40.165476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:40.168080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:40.169127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:40.171658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:40.172655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:40.175374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:40.603270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:40.645162 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0cee09de-5cdf-4da6-b9c0-663907493415 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1499 microversion: 2.1 time: 0.536791 Aug 25 13:41:40.665349 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2965/6002] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:40 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1499 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:41.701671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:41.702682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:41.712856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:41:41.718629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:41.719158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:41.719891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:41.722060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:41.726033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:41.730649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:42.119679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:42.137218 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b120ed7-20e2-46cb-854c-d3457bbc8d8c tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1502 microversion: 2.1 time: 0.442652 Aug 25 13:41:42.139286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3038/6003] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:41 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:42.179036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:42.181036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:42.194953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.196466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.198168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:42.200223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.201441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.202527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:42.256099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:41:42.521506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0ad38ba8-f030-4e68-83eb-d710b09673c6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 204 len: 0 microversion: 2.1 time: 0.347791 Aug 25 13:41:42.524397 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2966/6004] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:41:42 2022] DELETE /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:41:42.539154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:42.540800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:42.565706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.566568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.574658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:42.576277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:42.577437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:42.578542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:43.007751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:43.031484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92c90805-fd7c-458a-91b5-784ad3563266 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1508 microversion: 2.1 time: 0.499322 Aug 25 13:41:43.063845 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3039/6005] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:42 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:44.082706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:44.087660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:44.109958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:44.111397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:44.113754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:44.116739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:44.118237 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:44.123398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:44.518919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:44.536957 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ea1e6cc8-8b22-4714-8fbe-7fbe8ab90036 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1508 microversion: 2.1 time: 0.465861 Aug 25 13:41:44.538357 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2967/6006] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:44 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:45.572270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:45.575987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:45.601376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:45.602283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:45.603117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:45.605302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:45.606188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:45.607004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:46.407749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4543d52c3b4a18954f0b3eb0c8d4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6252eecb600470ca940564fe9d8c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:41:46.419969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c083fa-1cf5-4c10-9285-32162892dcd5", "name": "network-vif-deleted", "tag": "4fe86620-4661-49c1-a036-126ec2693cda"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:41:46.447868 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bd2bbc22-bf29-4542-8720-9cbf4632c10f tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 200 len: 1508 microversion: 2.1 time: 0.882642 Aug 25 13:41:46.451781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:46.464948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:46.471216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:46.474045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3040/6007] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:45 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 1508 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:41:46.504863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] Creating event network-vif-deleted:4fe86620-4661-49c1-a036-126ec2693cda for instance f0c083fa-1cf5-4c10-9285-32162892dcd5 on n-h1-850468-18 Aug 25 13:41:46.516980 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b8722569-662f-4834-ad1a-68f5367e2efa req-ffc8872d-42a5-4363-9d9c-ac603608ca5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125259 Aug 25 13:41:46.518988 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2968/6008] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:41:47.483088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:41:47.484337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] [instance: f0c083fa-1cf5-4c10-9285-32162892dcd5] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:41:47.508419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.510271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.511417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.513676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:41:47.514886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:41:47.515980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:41:47.546756 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] HTTP exception thrown: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Request method failure captured: Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 HTTP/1.1 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3vxB2YIP2tn84-VVCn4Q6iWlRT9SIFwpA0KdTAw3uuUfVOWxxFiFUmL6LtzRMWmItod9jfyKeELB62zTP2Py7S9yTX-2xTgd61uPLs0LsMH8LNIeNRP6SD9qN59htyKSouIO_TJMTSb3LnbNCPSlA6a5_l6T1utAOJTolgpbg1T2sQ Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a6252eecb600470ca940564fe9d8c778 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestServerAdvancedOps-433351136 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a6252eecb600470ca940564fe9d8c778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a6252eecb600470ca940564fe9d8c778"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6252eecb600470ca940564fe9d8c778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a6252eecb600470ca940564fe9d8c778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestServerAdvancedOps-433351136 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a6252eecb600470ca940564fe9d8c778 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestServerAdvancedOps-433351136 Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestServerAdvancedOps-433351136-project Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 2b4543d52c3b4a18954f0b3eb0c8d4af Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestServerAdvancedOps-433351136-project Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'f0c083fa-1cf5-4c10-9285-32162892dcd5'} Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:41:47.550342 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] Returning 404 to user: Instance f0c083fa-1cf5-4c10-9285-32162892dcd5 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14031fb0-4e56-4786-8227-2c8001fbe5a6 tempest-TestServerAdvancedOps-433351136 tempest-TestServerAdvancedOps-433351136-project] 10.222.0.60 "GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5" status: 404 len: 111 microversion: 2.1 time: 0.077414 Aug 25 13:41:47.559315 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3041/6009] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:41:47 2022] GET /compute/v2.1/servers/f0c083fa-1cf5-4c10-9285-32162892dcd5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:42:19.625191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:19.629843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:19.640294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-280280296", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "d3e2b8c5-1d0d-4d58-835b-5c2d82bde0b5"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:19.802551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] validate_networks() for [('d3e2b8c5-1d0d-4d58-835b-5c2d82bde0b5', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:42:21.129131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:42:21.130355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:42:21.130937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:42:21.131605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:42:21.132455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:42:21.155364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:21.157978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:21.159263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:21.161689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:21.163035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:21.164567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:21.204992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Getting quotas for project 901258b3bfad4f11a18b377f1aa0ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:21.217117 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Getting quotas for user 0dd77a6b3e204a56b84c6eee05200442 and project 901258b3bfad4f11a18b377f1aa0ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:21.255239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:42:21.278882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:42:21.409429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f6f7a0cb-04de-4d41-85bf-ee72a49668e0 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787744 Aug 25 13:42:21.422740 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2969/6010] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:42:21.435619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-331d0912-f0f3-4a45-8de1-2747acfe8081 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:21.440449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-331d0912-f0f3-4a45-8de1-2747acfe8081 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:21.475911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:21.482680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:21.628284 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-331d0912-f0f3-4a45-8de1-2747acfe8081 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:21.644363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-331d0912-f0f3-4a45-8de1-2747acfe8081 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1218 microversion: 2.1 time: 0.219990 Aug 25 13:42:21.657041 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3042/6011] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:21 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:22.691287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-db21ad4b-bf41-48f3-80de-6bdc194af92e tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:22.693892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-db21ad4b-bf41-48f3-80de-6bdc194af92e tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:22.875032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-db21ad4b-bf41-48f3-80de-6bdc194af92e tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:22.905066 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-db21ad4b-bf41-48f3-80de-6bdc194af92e tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1218 microversion: 2.1 time: 0.223773 Aug 25 13:42:22.920492 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2970/6012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:22 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:23.942875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:23.944075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:23.963183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.965162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.966305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:23.970072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:23.971310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:23.978860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:24.203221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:24.221109 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-61460735-e828-49e0-8ad2-c896321c5f06 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1270 microversion: 2.1 time: 0.285866 Aug 25 13:42:24.222885 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3043/6013] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:23 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:25.262549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:25.263637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:25.289293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.291322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.292475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.308510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:25.308510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:25.308510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:25.444647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1363787741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-536620425", "security_groups": [{"name": "tempest-secgroup-smoke-1545881986"}], "block_device_mapping_v2": [{"uuid": "a49cf049-efcb-4df1-8567-2327920c9e7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:25.471784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:25.496236 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d077d07-f917-409f-bc76-b388de4ce6f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1276 microversion: 2.1 time: 0.238217 Aug 25 13:42:25.496668 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2971/6014] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:25 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:25.801549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] validate_networks() for [('7a8ddaaa-7f34-4bde-b5dd-89560eaa7a6b', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:42:26.534930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:26.535901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:26.557712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:26.560462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:26.562082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:26.564197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:26.565518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:26.566625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:27.000411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:27.026267 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-746e2ee1-76e0-4a7b-809d-c6e823a508d3 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 0.497716 Aug 25 13:42:27.064286 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2972/6015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:26 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:27.765830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:42:27.766624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:42:27.768215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:42:27.769316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:42:27.770124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:42:27.789088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:27.789984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:27.791545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:27.793038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:27.794208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:27.795302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:27.855500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:42:27.872251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Getting quotas for user 28984c02b06f4a3db9f97aec71b7ae54 and project 2b4a8deb5f9d490c846c6cbdf66e799b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:42:27.960500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e807a20e-da4a-4fb0-9a53-ac74f458ce62", "tag": "0ca38975-1798-4cf6-8f95-dff89bc529ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:28.007459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.008217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.008882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.033292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:42:28.048937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a49cf049-efcb-4df1-8567-2327920c9e7c',volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:42:28.069790 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] Creating event network-changed:0ca38975-1798-4cf6-8f95-dff89bc529ef for instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 on n-h2-850468-18 Aug 25 13:42:28.091644 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7d6e974f-d257-41a8-8560-21ca392b30c9 req-cd8b54e2-9865-41d7-874a-b5133c3909a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135500 Aug 25 13:42:28.092771 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2973/6016] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:28.102564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:28.105084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:28.125953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.126505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.126949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.127921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:28.128443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:28.130247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:28.412147 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f4959a8-311d-4bb7-bde0-0c4b37a3ab05 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.973232 Aug 25 13:42:28.417374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3044/6017] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:42:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:42:28.446160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ed61afd-3ffb-407c-9af6-8d686150a705 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:28.448620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ed61afd-3ffb-407c-9af6-8d686150a705 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:28.536156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:28.554391 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52482c01-01e1-49e5-9956-e3a8a44e4d41 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 0.459342 Aug 25 13:42:28.575986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2974/6018] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:28 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:28.706590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ed61afd-3ffb-407c-9af6-8d686150a705 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:28.733768 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ed61afd-3ffb-407c-9af6-8d686150a705 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1094 microversion: 2.1 time: 0.308825 Aug 25 13:42:28.735034 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3045/6019] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:28 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1094 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:29.592037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:29.600387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:29.620394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:29.621628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:29.622523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:29.623647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:29.624380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:29.625414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:29.789257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:29.791190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:29.803874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:29.804942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:29.806964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:29.809231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:29.810508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:29.811587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:30.136757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:30.169417 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a0dbda5-7893-4230-9724-8d04e0b5456d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 0.586590 Aug 25 13:42:30.171118 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2975/6020] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:29 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:30.288204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:30.322124 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-16e5e73c-3495-4668-92dd-df7caaacbef7 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1144 microversion: 2.1 time: 0.553804 Aug 25 13:42:30.334981 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3046/6021] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:29 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1144 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:31.208699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:31.213317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:31.225391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:31.237213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.243278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.245069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.246748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.248102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.249518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.375413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:31.380838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:31.428784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.429744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.430574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.432993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:31.435605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:31.439077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:31.899349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:31.953826 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fdc0544-d782-4339-ba5d-615c176bf597 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1210 microversion: 2.1 time: 0.587029 Aug 25 13:42:31.966849 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3047/6022] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:31 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1210 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:32.037123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:32.059115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-95cbbc40-5e2e-4788-9895-b46b8a5151c4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 0.857430 Aug 25 13:42:32.093992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2976/6023] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:31 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:33.016442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:33.017817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:33.032619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.033544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.034455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.035850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.036919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.037725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.108092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:33.119772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:33.139885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:33.142868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.144040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.144990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.157036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:33.158427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:33.160352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:33.920220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:33.954288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-852c8e48-2388-4d37-b264-12ddfcbffdd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.948727 Aug 25 13:42:33.972767 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3048/6024] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:33 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:33.990506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e807a20e-da4a-4fb0-9a53-ac74f458ce62", "name": "network-vif-plugged", "status": "completed", "tag": "0ca38975-1798-4cf6-8f95-dff89bc529ef"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:34.019116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:34.022145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:34.023329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:34.077547 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] Creating event network-vif-plugged:0ca38975-1798-4cf6-8f95-dff89bc529ef for instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 on n-h2-850468-18 Aug 25 13:42:34.099386 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-aa11f617-09e5-4732-a6e7-ee28f39ff365 req-f46c7b1b-f024-483e-a804-4eb5d9b29b30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123989 Aug 25 13:42:34.101376 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3049/6025] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:34.201733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:34.231596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b9d34f7-e7ab-4846-8003-0fbbe96e7e38 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 1.131657 Aug 25 13:42:34.246146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2977/6026] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:33 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:34.998598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:35.003168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:35.029013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:35.033473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:35.039394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:35.044902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:35.046035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:35.047164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:35.352606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:35.365698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:35.424466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:35.433423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:35.450235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:35.454638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:35.459095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:35.463943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:35.801231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:35.835094 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4bd8859c-2f5d-4997-a645-71b13182e264 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.844018 Aug 25 13:42:35.836151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3050/6027] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:34 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:36.130945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:36.157728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df74a841-a5a3-4ef1-b6b7-0319e3cf9c37 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1318 microversion: 2.1 time: 0.855146 Aug 25 13:42:36.159276 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2978/6028] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:35 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:36.813227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e1428a-33ff-41c2-8c6b-7bc72a5aed5e", "tag": "b75b7eed-4b2e-4fe9-a665-7a3a241acee3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:36.847107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.847967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.848839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.883845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:36.885255 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] Creating event network-changed:b75b7eed-4b2e-4fe9-a665-7a3a241acee3 for instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e on n-h1-850468-18 Aug 25 13:42:36.889735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:36.899504 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9e02adcb-676e-4ced-83c0-01db90d35259 req-0cd02493-3cfb-46e3-abc4-c2cdf82fdceb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.534646 Aug 25 13:42:36.901091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3051/6029] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:42:36.933280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.937008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.941244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:36.945432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:36.947421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:36.948455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:37.203789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:37.209063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:37.245424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:37.246732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:37.247693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:37.265270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:37.269508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:37.270378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:37.456997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:37.484569 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3cbff76f-8052-4fcc-85a5-7864febe062c tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.609028 Aug 25 13:42:37.497386 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2979/6030] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:36 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:37.821952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:37.942573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:37.970606 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d29eb9e7-d7f1-4fe0-8cbd-9b50eb76c6ea tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1508 microversion: 2.1 time: 0.774101 Aug 25 13:42:37.974669 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3052/6031] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:37 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1508 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:38.538504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:38.539136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:38.561232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:38.562091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:38.562662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:38.563611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:38.564099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:38.564813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:39.659370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:39.714226 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6fad78be-828e-4081-a935-69f9fa01bbd6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 1.179742 Aug 25 13:42:39.719182 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2980/6032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:38 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:40.756400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:40.757924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:40.762802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=10 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:40.774743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:40.776082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:40.777254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:40.778960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:40.780201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:40.781302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:41.133273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:41.146366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ec152da-6083-4a55-b0e7-6f8a53e02a69 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.396362 Aug 25 13:42:41.171721 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3053/6033] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:40 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:42.180503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:42.182560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:42.213426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:42.223625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:42.224727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:42.233050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:42.233712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:42.238225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:42.731368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:42.760450 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c66bb606-1190-4f4e-b2a9-b1c0e29e9f13 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.582011 Aug 25 13:42:42.760450 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2981/6034] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:42 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:43.804691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:43.807948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:43.824726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:43.826063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:43.827264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:43.842160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:43.843603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:43.844845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:44.262336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:44.277136 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fb8992ec-531a-4f05-b58b-0d310513088f tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1278 microversion: 2.1 time: 0.479332 Aug 25 13:42:44.278154 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3054/6035] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:43 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1278 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:45.322465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:45.325863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:45.340197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:45.341508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:45.342632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:45.344370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:45.345266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:45.346286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:45.861903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:45.892631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbe45238-4d33-4a6b-89f9-9634bb8fe8dc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.579489 Aug 25 13:42:45.909357 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2982/6036] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:45 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:46.935916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:46.937313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:46.953646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:46.954485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:46.955418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:46.957082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:46.957991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:46.958847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:47.304758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:47.368242 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d1e96b8-8516-4508-89ec-ca15e6d0ea61 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.443496 Aug 25 13:42:47.396136 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3055/6037] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:46 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:48.409783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:48.413042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:48.430678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:48.436351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:48.437874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:48.439723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:48.440966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:48.442087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:48.827462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:48.849595 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-69bb58d8-4c1d-4e61-bfd2-99d5bdc04d56 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.449417 Aug 25 13:42:48.850706 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2983/6038] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:48 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:49.887181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:49.888256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:49.897918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:49.898478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:49.899281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:49.902338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:49.903906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:49.905058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:50.250235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:50.269033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47a7e5d4-da4a-442c-8cec-9109c3da63f3 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.387801 Aug 25 13:42:50.288714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3056/6039] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:49 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:42:51.317259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:51.318849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:51.324688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:51.335674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:51.337128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:51.338260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:51.339918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:51.341018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:51.341931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:51.358062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=77 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:51.702357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:51.716268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-811702c8-7f0c-414c-8a03-d7abdc64a4de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.411090 Aug 25 13:42:51.718599 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2984/6040] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:51 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:52.765429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:52.766695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:52.771784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:52.784222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:52.786071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:52.787157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:52.788865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:52.791704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:52.792579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:52.838700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=67 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:42:53.150330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:53.173195 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa000304-318f-41b9-b0e9-ac15fbbd75bf tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.422547 Aug 25 13:42:53.181383 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3057/6041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:52 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:54.217974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:54.225995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:54.312800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:54.317443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:54.321463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:54.324744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:54.329475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:54.332335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:54.787102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:54.808011 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-626ed9ee-de48-4336-9624-e5a202284e94 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.598695 Aug 25 13:42:54.811887 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2985/6042] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:54 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:55.852980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:55.855424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:55.874229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:55.875404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:55.876348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:55.877686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:55.878574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:55.879430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:56.337722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:56.382173 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b67a8dfd-f052-4d2a-b97e-a15a63d9b6ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.538921 Aug 25 13:42:56.387732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3058/6043] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:55 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:56.725155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e1428a-33ff-41c2-8c6b-7bc72a5aed5e", "name": "network-vif-plugged", "status": "completed", "tag": "b75b7eed-4b2e-4fe9-a665-7a3a241acee3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:42:56.759608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:56.760512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:56.761370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:56.835815 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] Creating event network-vif-plugged:b75b7eed-4b2e-4fe9-a665-7a3a241acee3 for instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e on n-h1-850468-18 Aug 25 13:42:56.848939 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4f2bf9a0-65eb-4c2c-91d5-3778e7b6958c req-4d84e2ed-eaf3-4f5d-961d-930438535f9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134154 Aug 25 13:42:56.853463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2986/6044] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:42:57.433133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:57.435605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:57.462940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:57.467577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:57.469782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:57.476462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:57.477341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:57.481528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:57.834098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:57.874204 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1393ba91-3a7b-4bea-9b00-2700178e34b6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1266 microversion: 2.1 time: 0.456485 Aug 25 13:42:57.876531 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3059/6045] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:57 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:58.912797 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:42:58.914203 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e (ip 10.222.0.60) !!! Aug 25 13:42:58.927766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:58.930268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:58.947717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:58.949174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:58.950485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:58.952385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:58.953969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:58.955321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:59.317904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:59.346626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-678b58b0-3154-4a2a-98ef-ba21aeec1354 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1454 microversion: 2.1 time: 0.436967 Aug 25 13:42:59.350024 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2987/6046] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:58 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1454 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:42:59.402029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:42:59.405870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:42:59.425638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:59.426591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:59.427966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:59.429410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:42:59.430277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:42:59.431643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:42:59.817142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:42:59.833476 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aa02f690-172a-4dc4-8c7e-299f610976b1 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1454 microversion: 2.1 time: 0.440697 Aug 25 13:42:59.835411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3060/6047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:42:59 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1454 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:05.527569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e1428a-33ff-41c2-8c6b-7bc72a5aed5e", "tag": "b75b7eed-4b2e-4fe9-a665-7a3a241acee3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:05.550973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:05.551835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:05.554860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:05.585838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] Creating event network-changed:b75b7eed-4b2e-4fe9-a665-7a3a241acee3 for instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e on n-h1-850468-18 Aug 25 13:43:05.601411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9ae28f55-029a-4323-919a-75c553392709 req-f19f477f-84a0-4394-8a9c-4414e6048c4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081420 Aug 25 13:43:05.607612 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3061/6048] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:06.101508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c757a94-81b3-441f-8f2d-695523cb332e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: .version_select at 0x7fc6c116f040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1927643376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIHOtb6RhdkXSSn8s0LF/apQb1Eo/psNAGd8yzOJOXRWMhmKOj1s70awfcqf2e6srTvoGU3jNxb+bLI4O7Wj/OrdM0N8MGaLhyQRfcitCtoYswsRTpT08M0ZpNyh5Ynvg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:06.234204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0c757a94-81b3-441f-8f2d-695523cb332e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:43:06.254988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0c757a94-81b3-441f-8f2d-695523cb332e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:43:06.390843 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c757a94-81b3-441f-8f2d-695523cb332e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.917621 Aug 25 13:43:06.392543 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2988/6049] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:43:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:18.746842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:18.751258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:18.773557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=9 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:18.777567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=25 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:18.783941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:18.786766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:18.788393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:18.792302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:18.794081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:18.794929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:19.245135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lazy-loading 'services' on Instance uuid 4b74913c-4164-4874-aa26-86edb6cfa42f {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:43:19.600421 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6500cc7-8a4f-49e2-a4a8-1676142f6f67 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f/os-volume_attachments/4bf1e762-9ef9-462f-be91-f5c5807390ba" status: 202 len: 0 microversion: 2.1 time: 0.870891 Aug 25 13:43:19.602028 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3062/6050] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:43:18 2022] DELETE /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f/os-volume_attachments/4bf1e762-9ef9-462f-be91-f5c5807390ba => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:43:20.715659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "defe99de-a667-4f34-aa8f-7d41f67d7907", "device": "/dev/sdb"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:20.720803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:20.729717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=19 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:20.731705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:20.733651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:20.752211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:20.753706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:20.754955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:20.757139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:20.758489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:20.759662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:21.647027 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-729bc35b-7563-4b5e-91b4-00ae97439e92 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "POST /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940755 Aug 25 13:43:21.657784 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2989/6051] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:43:20 2022] POST /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:24.183850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1531199934", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "1e7a9e99-c15c-49e6-9069-a5878936e613"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1927643376", "security_groups": [{"name": "tempest-secgroup-smoke-479491972"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:24.411914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] validate_networks() for [('1e7a9e99-c15c-49e6-9069-a5878936e613', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:43:25.059283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:43:25.060491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:43:25.062290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:43:25.063511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:43:25.064573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:43:25.081520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:25.085336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:25.086850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:25.089096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:25.090844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:25.093043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:25.137571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:43:25.151902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:43:25.180800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:43:25.187036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:43:25.288153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-53d42a8c-8b04-41a1-95f2-41bda5712b6e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117676 Aug 25 13:43:25.292243 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3063/6052] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:43:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:43:25.311340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27df9ee6-b0ba-4dc3-919c-08644b421677 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:25.313790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-27df9ee6-b0ba-4dc3-919c-08644b421677 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:25.498122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-27df9ee6-b0ba-4dc3-919c-08644b421677 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:25.515356 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27df9ee6-b0ba-4dc3-919c-08644b421677 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1267 microversion: 2.1 time: 0.211848 Aug 25 13:43:25.525170 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2990/6053] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:25 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:26.597287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:26.612403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:26.646513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:26.649876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:26.652398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:26.653787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:26.654600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:26.655356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:26.802471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:26.824045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2cb93e77-c421-4d59-a888-f473bfaed7e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1319 microversion: 2.1 time: 0.255411 Aug 25 13:43:26.825472 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3064/6054] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:26 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:27.859108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:27.860596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:27.884763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:27.886065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:27.886956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:27.888544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:27.889945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:27.891313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:28.043323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:28.053742 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0417f8f2-83dc-4399-93db-0c38d4548b86 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1325 microversion: 2.1 time: 0.204689 Aug 25 13:43:28.054946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2991/6055] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:27 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:29.094046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:29.095472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:29.112167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.112760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.113641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.114560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.115278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.115962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.365385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:29.378880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e885b152-9d89-43ff-bca2-c0a1af29ed79 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.292729 Aug 25 13:43:29.381051 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3065/6056] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:29 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:29.599586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:29.601476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:29.627666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.628951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.630073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.631892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.638770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.639920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.700329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:43:29.875065 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ebf1f666-1737-40bf-ba21-89ebc22161f0 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 204 len: 0 microversion: 2.1 time: 0.279842 Aug 25 13:43:29.876349 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2992/6057] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:43:29 2022] DELETE /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:43:29.893575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:29.895743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:29.910073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.910728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.911634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.913081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:29.913944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:29.914567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:29.984699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:30.007529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:30.009657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:30.011223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:30.039770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] Creating event network-changed:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h2-850468-18 Aug 25 13:43:30.061756 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e08f6b09-89dc-4e1b-859b-8256ca2b4e03 req-18a7e5e1-2426-462a-993c-6b395351947f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086056 Aug 25 13:43:30.063062 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2993/6058] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:30.175169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:30.197415 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67ed8d9b-571a-44d6-bd09-0b78b9eebefa tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1469 microversion: 2.1 time: 0.313672 Aug 25 13:43:30.199743 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3066/6059] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:29 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:30.418920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:30.420488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:30.432649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:30.433563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:30.434415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:30.435775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:30.436906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:30.437716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:30.729351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:30.741308 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-037af9d7-2c03-40aa-9696-fd27a1c4130e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.328713 Aug 25 13:43:30.749663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2994/6060] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:30 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:31.252179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:31.253900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:31.268862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.270137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.270817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.273855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.275361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.276270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.785583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:31.788771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:31.812014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.814148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.815491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.817839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:31.819906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:31.821425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:31.845995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:31.882339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-acd4213a-457b-4fa5-a3fb-454f67cd0199 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1469 microversion: 2.1 time: 0.643206 Aug 25 13:43:31.900963 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3067/6061] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:31 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1469 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:32.473127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:32.489659 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61635534-040c-444e-a193-11998f64eb26 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.713932 Aug 25 13:43:32.491584 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2995/6062] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:31 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:32.939469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:32.941033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:33.024144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.026677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.030188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.032540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.034018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.037386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.134465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b74913c-4164-4874-aa26-86edb6cfa42f", "name": "network-vif-deleted", "tag": "87547e7d-2b70-48e5-afed-c8c014c79b54"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:33.167451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.170498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.171719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.203067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:33.222936 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-423436a6-6cc2-46c2-aadb-f9d2611c5ebf tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1427 microversion: 2.1 time: 0.301301 Aug 25 13:43:33.224914 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3068/6063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:32 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:33.235665 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] Creating event network-vif-deleted:87547e7d-2b70-48e5-afed-c8c014c79b54 for instance 4b74913c-4164-4874-aa26-86edb6cfa42f on n-h2-850468-18 Aug 25 13:43:33.247292 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2a75acdd-e519-4a9b-a9e1-47e385aed52e req-82136c8f-8987-41db-884a-60fb647a91a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130198 Aug 25 13:43:33.275797 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2996/6064] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:33.519279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:33.523197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:33.536956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.537727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.538438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.539834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:33.540809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:33.541598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:33.786087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:33.803099 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04867fa0-c27b-4afc-96f9-6bfb6321fa39 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.290900 Aug 25 13:43:33.804209 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3069/6065] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:33 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:34.279249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:34.281540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:34.304257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:34.305280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:34.306256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:34.307837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:34.308800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:34.309609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:34.376655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:34.376655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:34.376655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:34.377293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lazy-loading 'fault' on Instance uuid 4b74913c-4164-4874-aa26-86edb6cfa42f {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:43:34.454954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c1dbed94ce40d8b08c1379f8a0af18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3a5bcd0b3d4e30977b642f93cd64cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:34.466978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6102b29b-7c15-46f2-9c34-29069c3fcba9 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 200 len: 1304 microversion: 2.1 time: 0.202011 Aug 25 13:43:34.467618 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2997/6066] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:34 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:34.840018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:34.842164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:34.853618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:34.854867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:34.855635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:34.856917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:34.857756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:34.858785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:35.116697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:35.131901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:35.150390 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-73382585-6c0e-4c23-a982-fad2b55e19fa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.317789 Aug 25 13:43:35.152676 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3070/6067] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:34 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:35.506262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:35.507061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] [instance: 4b74913c-4164-4874-aa26-86edb6cfa42f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:35.511545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:35.519553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:35.520286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:35.520993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:35.522005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:35.522921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:35.523775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:35.549707 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] HTTP exception thrown: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Request method failure captured: Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f HTTP/1.1 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3vU_8vbWTctvqK1RpE9NOFORH995gvJ2-Xr_A0Z_VjHKYbSKmyLFe0Q64515Kdgc91xX1G-XzNXIVFG4Frgc2y3_KBYvmGiUX3T0rXWPIp8xVHDrPEhqPPOFbU0c7yChsI7zNWCmIhLRhU09a0wv1GePAI9hVkAFV-Zcp6dgtZjH-4 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: ca3a5bcd0b3d4e30977b642f93cd64cd Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesBackupsTest-340684547 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ca3a5bcd0b3d4e30977b642f93cd64cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ca3a5bcd0b3d4e30977b642f93cd64cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca3a5bcd0b3d4e30977b642f93cd64cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ca3a5bcd0b3d4e30977b642f93cd64cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesBackupsTest-340684547 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: ca3a5bcd0b3d4e30977b642f93cd64cd Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesBackupsTest-340684547 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesBackupsTest-340684547-project Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 27c1dbed94ce40d8b08c1379f8a0af18 Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesBackupsTest-340684547-project Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4b74913c-4164-4874-aa26-86edb6cfa42f'} Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:43:35.554868 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] Returning 404 to user: Instance 4b74913c-4164-4874-aa26-86edb6cfa42f could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa790483-a263-46e0-8457-999a96ff9090 tempest-VolumesBackupsTest-340684547 tempest-VolumesBackupsTest-340684547-project] 10.222.0.60 "GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f" status: 404 len: 111 microversion: 2.1 time: 0.057029 Aug 25 13:43:35.569948 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2998/6068] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:35 2022] GET /compute/v2.1/servers/4b74913c-4164-4874-aa26-86edb6cfa42f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:43:36.176647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:36.178173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:36.181860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:43:36.199078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:36.200315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:36.201290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:36.203025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:36.204164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:36.205150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:36.520937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:36.546599 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-070a14ca-bdfd-4f59-a46d-ca225206c68e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.371881 Aug 25 13:43:36.548606 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3071/6069] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:36 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:37.585784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:37.587910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:37.607503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:37.608987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:37.613083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:37.616221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:37.617832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:37.618824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:37.639736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "name": "network-vif-plugged", "status": "completed", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:37.683718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:37.685068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:37.686280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:37.732402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] Creating event network-vif-plugged:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h2-850468-18 Aug 25 13:43:37.745693 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4ba8909a-0207-44ba-ba11-057f0bfcff43 req-f0c7e461-d686-4f81-af58-bc960ccb7c27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116555 Aug 25 13:43:37.746889 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3072/6070] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:43:37.940576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:37.952793 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf40f7f3-49a5-4635-abc0-92d298660f8f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.375699 Aug 25 13:43:37.953420 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 2999/6071] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:37 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:38.995431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:38.996781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:39.009999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:39.010826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:39.011805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:39.013162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:39.014061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:39.014878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:39.314439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:39.328938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97e17d4f-a1f5-4b70-a4f2-51fe39e0bed5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1392 microversion: 2.1 time: 0.344815 Aug 25 13:43:39.330381 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3073/6072] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:38 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:40.370387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:40.373311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:40.388485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:40.389622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:40.390541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:40.392181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:40.393211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:40.394144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:40.695465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:40.711740 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7bd7d6be-c351-4405-a233-aaba84a7811a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1564 microversion: 2.1 time: 0.350587 Aug 25 13:43:40.712983 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3000/6073] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:40 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1564 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:40.754147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:40.756520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:40.775567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:40.777011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:40.778172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:40.779981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:40.781525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:40.782644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:41.123763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:41.142332 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f1afef87-ad33-47fa-bfe4-bb6cdbbcc8f0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1564 microversion: 2.1 time: 0.396194 Aug 25 13:43:41.171110 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3074/6074] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:40 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1564 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:43:45.366965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:43:45.370339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:43:45.371224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:43:45.388266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:45.389535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:45.391828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:45.393330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:45.394300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:45.395303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:45.408932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:43:45.414931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:43:45.416088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:43:45.445529 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] Creating event network-changed:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h2-850468-18 Aug 25 13:43:45.462782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3bd148e9-a57e-4a0e-9266-ef22ee12b7d6 req-ae63bc59-6c61-4f99-9543-19db9c2f9f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093297 Aug 25 13:43:45.465099 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3075/6075] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:43:45.844226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:43:45.865180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-05413b53-6ebe-4d00-ac85-b6c5d07352d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1564 microversion: 2.1 time: 0.505505 Aug 25 13:43:45.866216 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3001/6076] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:43:45 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1564 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:02.944592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:02.949814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:02.955140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:02.956348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:02.969975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:02.970602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:02.971025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:02.972540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:02.973555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:02.974147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:03.312203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lazy-loading 'services' on Instance uuid e807a20e-da4a-4fb0-9a53-ac74f458ce62 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:44:03.444405 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-363529f1-9544-4bc9-9083-59dda431255f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62/os-volume_attachments/defe99de-a667-4f34-aa8f-7d41f67d7907" status: 202 len: 0 microversion: 2.1 time: 0.502747 Aug 25 13:44:03.446006 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3076/6077] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:44:02 2022] DELETE /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62/os-volume_attachments/defe99de-a667-4f34-aa8f-7d41f67d7907 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:44:04.545957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:04.550046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:04.563517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:04.565351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:04.567924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.569326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.572588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.574515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:04.575445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:04.576695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:04.685591 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f46a4cd8-85e5-44cd-9e44-638edf5bda48 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action" status: 200 len: 24576 microversion: 2.1 time: 0.149322 Aug 25 13:44:04.696935 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3002/6078] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:04 2022] POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action => generated 24576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:44:10.341146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:10.341754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:10.352854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.353649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.354288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.355043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.355510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.356090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.396170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:44:10.521522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba8453f2-7693-4c4b-84cf-b8cc24359ed4 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 204 len: 0 microversion: 2.1 time: 0.187094 Aug 25 13:44:10.522891 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3077/6079] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:10 2022] DELETE /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:44:10.535856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:10.537253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:10.549791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.550603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.551339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.552612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:10.553394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:10.554720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:10.761743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:10.771704 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13f712fb-504a-4396-bd07-b94b17f50be5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1514 microversion: 2.1 time: 0.242509 Aug 25 13:44:10.780721 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3003/6080] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:10 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:11.802787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:11.804707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:11.813331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:11.813922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:11.814536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:11.815276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:11.815771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:11.816343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:12.031541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:12.042511 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c53e6f8-afe8-4092-b1d4-713382eb03df tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1514 microversion: 2.1 time: 0.245390 Aug 25 13:44:12.043567 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3078/6081] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:11 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:12.911727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e807a20e-da4a-4fb0-9a53-ac74f458ce62", "name": "network-vif-deleted", "tag": "0ca38975-1798-4cf6-8f95-dff89bc529ef"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:12.934517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:12.935421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:12.936280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:12.960858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] Creating event network-vif-deleted:0ca38975-1798-4cf6-8f95-dff89bc529ef for instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 on n-h2-850468-18 Aug 25 13:44:12.969088 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2374eec3-9e12-447d-9218-67eb706e9342 req-ce8cd802-ac3b-4b63-8891-60d24cffc366 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072451 Aug 25 13:44:12.970058 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3004/6082] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:13.077200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:13.079718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:13.091806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:13.092472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:13.092956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:13.094109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:13.094618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:13.095061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:13.139293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:13.139832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:13.140311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:13.140782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lazy-loading 'fault' on Instance uuid e807a20e-da4a-4fb0-9a53-ac74f458ce62 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:44:13.222907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:13.244076 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-894e376c-72d0-4df4-b9dd-e70261927f97 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 200 len: 1308 microversion: 2.1 time: 0.175027 Aug 25 13:44:13.244916 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3079/6083] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:13 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:14.272568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:14.273700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: e807a20e-da4a-4fb0-9a53-ac74f458ce62] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:14.283483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:14.283974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:14.284653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:14.285408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:14.285875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:14.286310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:14.303545 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] HTTP exception thrown: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Request method failure captured: Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 HTTP/1.1 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3vBWZQJ0GSYBXYAedLYbfAs06z47c3z_i2nSm_tn3DTkjW1tpyLs6SPvSCSo4fNb-E4Cuwyx7TmLjB2xbc3hTkpsuuVIToOpmcAhhNaGMfuzanDR394Y9SLU58EqUZp4o5v5iLarRc6DQEvdzjGddD9VSGi4uUl7V8w0e3jUPH3c60 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 901258b3bfad4f11a18b377f1aa0ed3d Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 901258b3bfad4f11a18b377f1aa0ed3d Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-VolumesSnapshotTestJSON-1787657051-project Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0dd77a6b3e204a56b84c6eee05200442 Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-VolumesSnapshotTestJSON-1787657051-project Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'e807a20e-da4a-4fb0-9a53-ac74f458ce62'} Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:44:14.306514 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Returning 404 to user: Instance e807a20e-da4a-4fb0-9a53-ac74f458ce62 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:44:14.315502 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fffd0ec0-9c16-4662-9da6-9757cff528a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62" status: 404 len: 111 microversion: 2.1 time: 0.042600 Aug 25 13:44:14.325836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3005/6084] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:14 2022] GET /compute/v2.1/servers/e807a20e-da4a-4fb0-9a53-ac74f458ce62 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:44:15.646364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:15.648321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:15.660755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.661742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.662785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:15.664765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:15.666297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:15.669496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.080054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65a6df60-cde3-4018-8730-85d8c4eb34e8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1836 microversion: 2.1 time: 0.440436 Aug 25 13:44:16.080813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3080/6085] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:15 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1836 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:16.111971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:16.113163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:16.124637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.125309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.125872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.126775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.127337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.127904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.411464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:16.458709 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb7b7664-2069-43e1-8e2b-00cba492f573 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1683 microversion: 2.1 time: 0.353759 Aug 25 13:44:16.460283 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3006/6086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:16 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1683 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:16.666631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:16.670968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:16.686454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.687376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.688162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.689551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.690400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.691191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.763156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dea9bd56-e879-4473-a822-48f499b70412 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action" status: 200 len: 32645 microversion: 2.1 time: 0.108885 Aug 25 13:44:16.764078 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3081/6087] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:16 2022] POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action => generated 32645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:44:16.951586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:16.952420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:16.961531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.962054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.962516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:16.963277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:16.963759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:16.964246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:17.020851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc4c8e47035a4df39b1faa17b5396e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe039087024e493f8ad1d1ed917fbee2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:17.021869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] flavor_id is None. Assuming migration. {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 13:44:17.022572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:44:17.523961 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a1ab9dc-30df-4d35-a1e4-7d2d088ae339 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action" status: 202 len: 0 microversion: 2.1 time: 0.578126 Aug 25 13:44:17.528827 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3007/6088] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:16 2022] POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:44:17.536611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:17.538178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:17.548838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:17.549507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:17.550078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:17.551143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:17.552484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:17.553630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:17.840948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:17.866015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d99656e-e569-4ecd-811f-70db53eab8a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1692 microversion: 2.1 time: 0.334712 Aug 25 13:44:17.868966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3082/6089] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:17 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1692 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:18.901699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:18.902460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:18.913040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:18.913862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:18.914542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:18.915458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:18.916147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:18.916788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:19.191781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:19.202227 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71cf6c3d-6a40-4574-ae47-822876a37eaf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1692 microversion: 2.1 time: 0.306101 Aug 25 13:44:19.203587 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3008/6090] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:18 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1692 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:20.236018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:20.238086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:20.251603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.253314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.254267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.256380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:20.257370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:20.273663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:20.561868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:20.578563 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2d33f97d-ca0a-4f99-b7a6-bb07d92d56dc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1692 microversion: 2.1 time: 0.349362 Aug 25 13:44:20.580683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3083/6091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:20 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1692 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:21.614161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:21.615525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:21.632554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:21.635071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:21.636355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:21.647693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:21.648902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:21.649945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:21.911300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:21.933515 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ac3d8cb-0601-4669-8ad3-88e66993b05c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.325391 Aug 25 13:44:21.934789 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3009/6092] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:21 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:22.972399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:22.972977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:22.981876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:22.982367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:22.982820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:22.983555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:22.984009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:22.984461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:23.159819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:23.170652 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5b4f214-a3c4-4c1d-9ab5-574a4beb955d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.202797 Aug 25 13:44:23.171591 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3084/6093] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:22 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:23.870164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-913665459", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "d3e2b8c5-1d0d-4d58-835b-5c2d82bde0b5"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:23.965291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] validate_networks() for [('d3e2b8c5-1d0d-4d58-835b-5c2d82bde0b5', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:44:24.207104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:24.208831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:24.216375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:24.216882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:24.217333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:24.218063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:24.218542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:24.219028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:24.502630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:24.514260 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ac16e7d-e6f6-4807-a39c-2c92daf43945 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.311946 Aug 25 13:44:24.514994 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3085/6094] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:24 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:24.535037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:44:24.538636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:44:24.538636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:44:24.538636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:44:24.538636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:44:24.548963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:24.549738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:24.550214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:24.551044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:24.551597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:24.551998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:24.582723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Getting quotas for project 901258b3bfad4f11a18b377f1aa0ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:44:24.592033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Getting quotas for user 0dd77a6b3e204a56b84c6eee05200442 and project 901258b3bfad4f11a18b377f1aa0ed3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:44:24.612262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:44:24.615331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:44:24.680355 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa5875b4-6756-48ab-8c04-25a2a11b913a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815829 Aug 25 13:44:24.681448 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3010/6095] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:44:24.697317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d64d14c-07d1-4fa4-9a54-a93533a49a6c tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:24.698388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d64d14c-07d1-4fa4-9a54-a93533a49a6c tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:24.812524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d64d14c-07d1-4fa4-9a54-a93533a49a6c tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:24.821716 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d64d14c-07d1-4fa4-9a54-a93533a49a6c tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1218 microversion: 2.1 time: 0.131481 Aug 25 13:44:24.832825 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3086/6096] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:24 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:25.544508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:25.546806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:25.560663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.561622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.562521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.563945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.564899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.565724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.798143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:25.820675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1659030f-6a93-449c-9ff9-75d59327292e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.285452 Aug 25 13:44:25.822080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3011/6097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:25 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:25.849248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:25.850413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:25.861953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.862535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.863114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.863940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:25.865098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:25.868778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:25.984876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:26.007184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e1461bc-e184-4101-a776-62196e75cb69 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1270 microversion: 2.1 time: 0.166648 Aug 25 13:44:26.026969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3087/6098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:25 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:26.858957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:26.861160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:26.870590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:26.871310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:26.872067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:26.873279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:26.873937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:26.874737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:27.059427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:27.060676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:27.076169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:27.077041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:27.078471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:27.080886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:27.082014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:27.083993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:27.111746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:27.138623 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e3f3aea-5e3b-4bbf-bc5b-4b2675947b00 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.287705 Aug 25 13:44:27.139835 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3012/6099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:26 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:27.316573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:27.326486 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d7a010d-791d-46ba-873c-6e7f8bcca720 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.276892 Aug 25 13:44:27.327700 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3088/6100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:27 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:28.045151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b208d9d1-ef51-49c1-9370-0bafabf9562e", "tag": "24baa7ba-020d-4704-9230-a1c2fac65bcb"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:28.069893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:28.071141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:28.072327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:28.096905 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] Creating event network-changed:24baa7ba-020d-4704-9230-a1c2fac65bcb for instance b208d9d1-ef51-49c1-9370-0bafabf9562e on n-h2-850468-18 Aug 25 13:44:28.111579 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-733b3ee7-84d5-43a0-b908-00f4fdb3124f req-54c79dbb-79f7-4ea4-9fc5-5588bc8be8c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073094 Aug 25 13:44:28.113489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3013/6101] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:44:28.191919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:28.193858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:28.205251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:28.206043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:28.206713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:28.207911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:28.209428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:28.210580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:28.370270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:28.371227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:28.381927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:28.382749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:28.383383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:28.384481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:28.385118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:28.385744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:28.427008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:28.441370 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-172962c5-052a-4211-8e0d-f5b702dfa7bb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.273190 Aug 25 13:44:28.443535 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3089/6102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:28 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:28.614898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:28.629155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d865513-da91-4ba9-b63f-df2ed7d5be08 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.271778 Aug 25 13:44:28.644149 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3014/6103] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:28 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:29.481885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:29.482688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:29.493933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:29.494732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:29.495426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:29.496625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:29.497417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:29.498108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:29.660313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:29.663319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:29.678543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:29.680840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:29.681995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:29.683642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:29.684822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:29.685894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:29.778342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:29.794236 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9da5c337-7082-45ae-a26f-7e12ea500637 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.318408 Aug 25 13:44:29.795847 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3090/6104] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:29 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:29.944600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:29.959737 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf20ef57-b358-4402-b96b-b37c86f3d227 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.306395 Aug 25 13:44:29.960691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3015/6105] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:29 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:30.836004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:30.837308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:30.849910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:30.850676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:30.851337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:30.852533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:30.853309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:30.854000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:30.861774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:31.000698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:31.002910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:31.015519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:31.016421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:31.017153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:31.018241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:31.019094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:31.019925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:31.245306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:31.264219 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5a1a4444-9384-42b9-95ef-06d0d3ed261e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.430835 Aug 25 13:44:31.272710 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3091/6106] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:30 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:31.389662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:31.410119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef3b51ee-bded-48a3-a6ee-bb46eaf861ec tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.415250 Aug 25 13:44:31.412417 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3016/6107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:30 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:32.313431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:32.315064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:32.329165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.331254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.332796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.334670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.336086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.337477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.447338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:32.450056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:32.462165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.463252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.464514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.465972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:32.466947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:32.467850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:32.687429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:32.703328 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4a1e461-4d52-45b9-84d6-38b030620ebb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.397496 Aug 25 13:44:32.704350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3092/6108] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:32 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:32.745416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:32.759403 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-818b29a4-8c62-4c7b-9dd3-c621abe34080 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.320162 Aug 25 13:44:32.760204 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3017/6109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:32 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:33.732090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:33.733050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:33.740273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:33.746626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.747378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.748029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.749692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.750448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.751121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.788186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b208d9d1-ef51-49c1-9370-0bafabf9562e", "name": "network-vif-plugged", "status": "completed", "tag": "24baa7ba-020d-4704-9230-a1c2fac65bcb"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:33.813159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.814893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.815661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.838210 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] Creating event network-vif-plugged:24baa7ba-020d-4704-9230-a1c2fac65bcb for instance b208d9d1-ef51-49c1-9370-0bafabf9562e on n-h2-850468-18 Aug 25 13:44:33.851575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5c12ee14-6483-41eb-afd8-b984f7aa7fb3 req-9476393a-eb8d-4ecb-aed7-0981b9a33c71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068625 Aug 25 13:44:33.852910 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3018/6110] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:44:33.867269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:33.868942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:33.882394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.884485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.885367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.886647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:33.887319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:33.887937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:33.953899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:33.979507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4ecc664c-f41d-4366-8518-d76574dd734c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.253929 Aug 25 13:44:33.980956 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3093/6111] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:33 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:34.125859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:34.142996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-50c8ff83-f4eb-4705-aa4d-5224fcc69d91 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.285424 Aug 25 13:44:34.144085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3019/6112] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:33 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:35.020887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:35.022356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:35.026122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:35.033952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.034696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.035825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.036720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.037461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.037983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.172229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:35.175694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:35.185881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:35.187717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:35.194265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:35.206587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.209082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.209914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.211923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:35.213620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:35.213840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:35.262387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:35.277939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:35.284569 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-51b987ff-2552-409d-bc35-80ae2043b108 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.269373 Aug 25 13:44:35.286081 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3094/6113] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:35 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:35.476282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:35.491207 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8df81c49-113e-4ebb-b4a7-92fee741d1f1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1318 microversion: 2.1 time: 0.320882 Aug 25 13:44:35.493000 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3020/6114] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:35 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:36.321394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:36.322291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:36.334845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.334845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.335637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:36.336774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.337517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.338226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:36.525291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:36.528056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:36.543318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.544581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.545236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:36.546199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.546882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.547881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:36.635300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:36.648794 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-229860ce-d97b-4c34-aa82-e46d7bf911da tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.334070 Aug 25 13:44:36.650043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3095/6115] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:36 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:36.799582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:36.817026 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eadee79c-0a1c-4577-bad1-5b99f8f464d1 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1507 microversion: 2.1 time: 0.299602 Aug 25 13:44:36.819487 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3021/6116] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:36 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:36.854548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b2215bf-6c3d-4e24-a57b-905f50dc2b18", "device": "/dev/sdb"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:36.858465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:36.869260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.870051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.870762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:36.871936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:36.872995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:36.873737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:37.677908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:37.679216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:37.690464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:37.691259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:37.691953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:37.693143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:37.693874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:37.694564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:37.906419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:37.916220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d94759c1-40b2-4f19-9dce-5bc1e754d106 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1697 microversion: 2.1 time: 0.244159 Aug 25 13:44:37.916838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3022/6117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:37 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:38.220421 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-beaf6387-b484-471e-beb5-c96ca66a135a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "POST /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.370490 Aug 25 13:44:38.224714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3096/6118] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 13:44:36 2022] POST /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e/os-volume_attachments => generated 194 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:44:38.956805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:38.959176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:38.978712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:38.980171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:38.982205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:38.984811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:38.986268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:38.987426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:39.445463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "name": "network-vif-unplugged", "status": "completed", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:39.469499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:39.483715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:39.489621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d2a884d-6276-46d6-b0aa-b76016e976ee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1696 microversion: 2.1 time: 0.543065 Aug 25 13:44:39.491167 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3023/6119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:38 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1696 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:39.507562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:39.508971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:39.548859 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Creating event network-vif-unplugged:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h1-850468-18 Aug 25 13:44:39.564783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] Instance b873e6e1-2a73-46a2-bb58-1205da52142e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:44:39.606735 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b2019ae4-ec4f-42df-86fb-2f8fec91d653 req-cfb88bd9-bdc5-4b5d-852b-0e2d6c982e2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168483 Aug 25 13:44:39.608813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3097/6120] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:40.553139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:40.554590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:40.566997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:40.567794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:40.568688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:40.569802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:40.570755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:40.571693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:40.994371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:41.011276 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4ef433c3-4da4-4265-b4ec-eef83834f20e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1696 microversion: 2.1 time: 0.485373 Aug 25 13:44:41.014505 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3024/6121] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:40 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1696 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:41.659919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:41.702574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:41.703443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:41.704561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:41.730890 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Creating event network-changed:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h1-850468-18 Aug 25 13:44:41.743101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] Instance b873e6e1-2a73-46a2-bb58-1205da52142e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:44:41.782825 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3595c9da-363f-4bf8-950a-a07e5e84d323 req-e3cc4fd3-dad4-4bd4-b798-0117d11c60c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132206 Aug 25 13:44:41.790867 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3098/6122] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:42.047191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:42.047991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:42.087494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:42.088460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:42.089288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:42.090440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:42.091320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:42.092183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:42.376867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:42.394570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-369f2773-3c80-4d9e-9569-d23682ccc8fd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1694 microversion: 2.1 time: 0.351777 Aug 25 13:44:42.396278 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3025/6123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:42 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1694 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:43.439834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:43.441386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:43.454880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:43.456265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:43.456957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:43.458462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:43.459297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:43.460102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:43.754169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:43.775543 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34ed9e58-ec4b-4ac8-b4ef-b6ba01c0d1ab tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1694 microversion: 2.1 time: 0.347368 Aug 25 13:44:43.784599 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3099/6124] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:43 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1694 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:44.820358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:44.822544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:44.852694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:44.853905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:44.856062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:44.858077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:44.859345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:44.860776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:45.342590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:45.388396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-13c16dd7-a6f7-4daf-8cfa-e279e98714f1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1694 microversion: 2.1 time: 0.578380 Aug 25 13:44:45.389681 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3026/6125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:44 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1694 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:46.352554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:46.353382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:46.374395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e1428a-33ff-41c2-8c6b-7bc72a5aed5e", "tag": "b75b7eed-4b2e-4fe9-a665-7a3a241acee3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:46.377805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.378954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.379788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.381171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.382047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.382829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.395888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.397140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.398347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.429950 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] Creating event network-changed:b75b7eed-4b2e-4fe9-a665-7a3a241acee3 for instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e on n-h1-850468-18 Aug 25 13:44:46.443835 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bbc6ccf8-3f50-4ed7-bef5-486a864e5933 req-cd98ae27-1ea1-4df4-9aa0-b67559c5c993 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081722 Aug 25 13:44:46.445797 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3027/6126] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:46.458587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:46.460377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:46.476036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.478386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.479579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.481282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.482424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.483526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.497650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:44:46.731425 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a82a6557-41e3-4b24-a45f-65eddc582168 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 204 len: 0 microversion: 2.1 time: 0.382630 Aug 25 13:44:46.732931 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3100/6127] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:44:46 2022] DELETE /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:44:46.750023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:46.763555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:46.793507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.795383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.797911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.801692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:46.802621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:46.803440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:46.885473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:46.940760 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-300445be-a907-4fdb-bc6c-2ee4aff8587e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1691 microversion: 2.1 time: 0.483989 Aug 25 13:44:46.956232 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3028/6128] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:46 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1691 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:46.989223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:46.995673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:47.019531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:47.024889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:47.025665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:47.027093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:47.027992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:47.028880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:47.253291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e1c91630-d861-4f14-a231-7db4c13d0d0f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action" status: 204 len: 0 microversion: 2.1 time: 0.272425 Aug 25 13:44:47.259641 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3029/6129] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:44:46 2022] POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:44:47.280148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:47.282959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:47.306568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:47.306568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:47.319187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:47.326127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:47.330582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:47.335272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:47.437119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:47.466525 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a8e64795-9496-45e1-8fed-24b1eee967b9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1579 microversion: 2.1 time: 0.726074 Aug 25 13:44:47.467239 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3101/6130] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:46 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1579 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:47.691276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:47.710864 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-726e998a-f639-40d1-b575-400f7304fb85 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1691 microversion: 2.1 time: 0.447401 Aug 25 13:44:47.723752 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3030/6131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:47 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:48.516302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:48.519657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:48.536484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.537808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.538906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:48.542457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.543803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.545729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:48.756745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:48.757870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:48.788202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.789050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.789837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:48.791083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:48.791954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:48.792816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:49.531482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:49.550252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:49.577689 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8e592d9-2564-4620-ace2-f110db0766d8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1691 microversion: 2.1 time: 0.819349 Aug 25 13:44:49.581868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3031/6132] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:48 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1691 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:44:49.609027 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d2b4c39b-2f7c-4b9e-8a29-8cad52335916 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1579 microversion: 2.1 time: 1.108615 Aug 25 13:44:49.625068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3102/6133] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:48 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1579 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:50.645894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:50.649455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:50.669742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:50.672388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:50.675919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:50.678007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:50.679133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:50.680529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:50.681844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:50.683038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:50.725217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:50.735170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:50.741574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:50.743025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:50.746560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:50.751543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:51.007451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:51.031971 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da3daa6f-9bf2-420b-87cc-40a7dc4459d5 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1392 microversion: 2.1 time: 0.376212 Aug 25 13:44:51.034724 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3103/6134] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:50 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1392 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:51.046476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e1428a-33ff-41c2-8c6b-7bc72a5aed5e", "name": "network-vif-deleted", "tag": "b75b7eed-4b2e-4fe9-a665-7a3a241acee3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:51.065777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:51.067387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:51.068786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:51.099093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] Creating event network-vif-deleted:b75b7eed-4b2e-4fe9-a665-7a3a241acee3 for instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e on n-h1-850468-18 Aug 25 13:44:51.115330 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-63aa6409-9c49-4883-9ba3-c33bf4d8fd13 req-116f5fbc-4d1e-45eb-a5dd-6e8144d5cbe9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073454 Aug 25 13:44:51.117684 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3104/6135] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:51.296929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:51.324500 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88718aaf-6da7-474f-a50d-cb44bce51f20 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1691 microversion: 2.1 time: 0.702209 Aug 25 13:44:51.327188 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3032/6136] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:50 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1691 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:51.404307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "name": "network-vif-plugged", "status": "completed", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:44:51.451652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:51.457357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:51.461305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:51.518351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] Creating event network-vif-plugged:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h1-850468-18 Aug 25 13:44:51.535566 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c8ef7407-d5eb-4590-898f-661c89b0fafb req-9dd80746-0772-4f0c-836f-30d659671a42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142866 Aug 25 13:44:51.538040 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3105/6137] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:44:52.073100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:52.074073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:52.086825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.087594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.088346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:52.089500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.090241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.090931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:52.211850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:52.226580 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79976f0f-08e3-4f34-8837-9f31c547613b tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.159777 Aug 25 13:44:52.240162 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3033/6138] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:52 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:52.379982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:52.382241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:52.398700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.399962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.400461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:52.401592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:52.402312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:52.402950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:52.692993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:52.700877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:52.719055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9456346d-4186-4db4-b561-dabb12d6b7b4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1683 microversion: 2.1 time: 0.356300 Aug 25 13:44:52.720651 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3106/6139] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:52 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1683 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:53.278767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:53.280097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:53.295751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:53.296828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:53.297781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:53.299357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:53.300421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:53.301354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:53.472072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:53.506242 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-55072905-5dbc-4bd3-96cb-a8e8967011de tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.236286 Aug 25 13:44:53.519544 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3034/6140] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:53 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:54.563258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:54.566383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:54.583430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:54.584702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:54.585739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:54.587514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:54.588724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:54.589729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:54.708013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:54.723967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8c7fc86-e31c-4609-a8bb-7ea126af6f2d tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.173082 Aug 25 13:44:54.725816 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3107/6141] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:54 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:55.777210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:55.780693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:55.829259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:55.830640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:55.831713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:55.833451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:55.834794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:55.835874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:55.997859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:56.014215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73c47d4f-1d83-42fa-87fb-1a3802397ecd tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.246126 Aug 25 13:44:56.056730 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3035/6142] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:55 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:57.068098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:57.070207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:57.088869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:57.089383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:57.090088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:57.091499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:57.092249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:57.093189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:57.287698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:57.305232 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e567388b-d266-48ca-9ac1-bb2dd1b8a779 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.249902 Aug 25 13:44:57.306393 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3108/6143] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:57 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:58.346369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:58.348239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:58.361407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:58.362955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:58.364240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:58.366055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:58.367596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:58.368504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:58.410896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:44:58.502487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:58.522039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-31f05a2d-33be-40c1-8a27-0b8627659d4e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1225 microversion: 2.1 time: 0.181246 Aug 25 13:44:58.528346 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3036/6144] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:58 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1225 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:44:59.561604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:44:59.562544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:44:59.574669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:59.575258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:59.575708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:59.576530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:59.578289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:59.578541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:59.654027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:44:59.654218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:44:59.655050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:44:59.655918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lazy-loading 'fault' on Instance uuid 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:44:59.755449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:44:59.777057 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a49edde-025c-4d50-84f8-e2804723eb14 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 200 len: 1230 microversion: 2.1 time: 0.215123 Aug 25 13:44:59.778045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3109/6145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:44:59 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 1230 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:00.825106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:00.828656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:00.843710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:00.845304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:00.846095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:00.847716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:00.848877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:00.849793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:00.884066 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e HTTP/1.1 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '44e1428a-33ff-41c2-8c6b-7bc72a5aed5e'} Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:00.886524 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 44e1428a-33ff-41c2-8c6b-7bc72a5aed5e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38ee5a57-2189-4292-8476-fdf54551c217 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e" status: 404 len: 111 microversion: 2.1 time: 0.082160 Aug 25 13:45:00.901972 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3037/6146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:00 2022] GET /compute/v2.1/servers/44e1428a-33ff-41c2-8c6b-7bc72a5aed5e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:45:09.952344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:09.953461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:09.958592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:09.960761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:09.978001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:09.979699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:09.980880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:09.982038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:09.982844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:09.983801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:10.168377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lazy-loading 'services' on Instance uuid b208d9d1-ef51-49c1-9370-0bafabf9562e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:45:10.317210 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd4477ec-6bf8-4901-95c6-74c0027e5f70 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e/os-volume_attachments/3b2215bf-6c3d-4e24-a57b-905f50dc2b18" status: 202 len: 0 microversion: 2.1 time: 0.369345 Aug 25 13:45:10.319721 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3110/6147] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 13:45:09 2022] DELETE /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e/os-volume_attachments/3b2215bf-6c3d-4e24-a57b-905f50dc2b18 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:45:11.746282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:11.747931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:11.771200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:11.773007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:11.776535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:11.777269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:11.778089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:11.778954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:11.779462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:11.779928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:11.829719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:45:11.996374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab21daa-b870-4d92-bb5f-f47b9403dbc3", "tag": "1878b03f-356c-4fa4-a593-63568a450ef4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:12.038951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:12.040281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:12.041797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:12.059082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9f47cda-572d-4145-b4a6-d1c255e1eddc tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 204 len: 0 microversion: 2.1 time: 0.316526 Aug 25 13:45:12.061374 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3038/6148] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:45:11 2022] DELETE /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:45:12.080055 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] Creating event network-changed:1878b03f-356c-4fa4-a593-63568a450ef4 for instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 on n-h1-850468-18 Aug 25 13:45:12.089587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:12.091222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:12.091935 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6735dd49-fb34-4e4e-8498-d4d5581bc108 req-087a6df9-9994-45b7-b831-63b264210007 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338091 Aug 25 13:45:12.101104 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3111/6149] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:45:12.113994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:12.115461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:12.116563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:12.118180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:12.119977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:12.121047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:12.465877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:12.487801 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-01786832-aecb-4079-b900-8762dedd6341 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1578 microversion: 2.1 time: 0.418515 Aug 25 13:45:12.489062 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3039/6150] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:12 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1578 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:13.533409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:13.540276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:13.574434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:13.577183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:13.582169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:13.589441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:13.591765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:13.594575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:14.391030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:14.423440 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47dd8d51-de40-405e-8578-776f5535ad0a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1578 microversion: 2.1 time: 0.895042 Aug 25 13:45:14.424835 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3112/6151] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:13 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1578 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:14.774949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab21daa-b870-4d92-bb5f-f47b9403dbc3", "name": "network-vif-deleted", "tag": "1878b03f-356c-4fa4-a593-63568a450ef4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:14.794289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:14.795176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:14.795925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:14.816707 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] Creating event network-vif-deleted:1878b03f-356c-4fa4-a593-63568a450ef4 for instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 on n-h1-850468-18 Aug 25 13:45:14.828972 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ebbd05c1-9de9-48d9-a51e-f0664d21748b req-9314f98d-a4c8-48e8-9171-44273e25d24a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059176 Aug 25 13:45:14.844795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3040/6152] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:45:15.473507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:15.474310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:15.486167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:15.486668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:15.487451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:15.488239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:15.488688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:15.489113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:15.580269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:15.600606 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6915179f-dbc0-4821-87df-b373d6cd9bef tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.139407 Aug 25 13:45:15.601736 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3113/6153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:15 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:45:16.639342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:16.647811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:16.663619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:16.664785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:16.667996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:16.669466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:16.670276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:16.671859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:16.810542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:16.830741 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d16eb6eb-0277-4e0d-b9f4-82fffe920469 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.199388 Aug 25 13:45:16.831777 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3041/6154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:16 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:17.878135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:17.879482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:17.894696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:17.895559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:17.896427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:17.898260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:17.899556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:17.900466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:18.033528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:18.049691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1aa85b9b-2043-4746-baff-de65849f80c6 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.180634 Aug 25 13:45:18.052522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3114/6155] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:17 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:18.692425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:18.694163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:18.719007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:18.720640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:18.721601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:18.723175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:18.724895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:18.725957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:18.773270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:45:18.932801 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9cebf19-b593-472a-a629-3b1d1456e25d tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 204 len: 0 microversion: 2.1 time: 0.246738 Aug 25 13:45:18.934168 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3042/6156] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:45:18 2022] DELETE /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:45:18.949378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:18.951442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:18.963890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:18.964808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:18.965609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:18.967150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:18.968083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:18.968941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:19.084378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:19.085963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:19.099137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:19.100323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:19.101507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:19.103041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:19.104283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:19.105261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:19.219378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:19.232630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7abd8d39-ec9a-4636-8206-29c1c5405933 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.156034 Aug 25 13:45:19.250183 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3043/6157] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:19 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:19.250183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:19.250183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:19.258458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:19.263942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:19.271137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:19.274736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:19.280488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:19.282310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:19.283416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:19.294673 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8b3e3742-9482-4fe7-8a4b-a8cbabe2535a tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1513 microversion: 2.1 time: 0.352377 Aug 25 13:45:19.296694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3115/6158] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:18 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:19.394649 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b98882ec-9c56-4114-998d-1b3e5ea6d258 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action" status: 200 len: 24579 microversion: 2.1 time: 0.158585 Aug 25 13:45:19.395919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3044/6159] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:45:19 2022] POST /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e/action => generated 24579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:45:20.279224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:20.280884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:20.293820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:20.294747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:20.295635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:20.297244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:20.298354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:20.299380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:20.333932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:20.335481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:20.359299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:20.360765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:20.361598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:20.362977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:20.363864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:20.370429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:20.453521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:20.472803 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-211378de-a81a-47e6-87d7-5a651e37d8a0 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.200629 Aug 25 13:45:20.474531 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3116/6160] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:20 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:20.641897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:20.658857 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-747c78dc-75b6-4874-935c-8e7cf40236a5 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1513 microversion: 2.1 time: 0.334297 Aug 25 13:45:20.660838 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3045/6161] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:20 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:21.372997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b208d9d1-ef51-49c1-9370-0bafabf9562e", "name": "network-vif-deleted", "tag": "24baa7ba-020d-4704-9230-a1c2fac65bcb"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:21.398431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.399485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.400729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.430643 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] Creating event network-vif-deleted:24baa7ba-020d-4704-9230-a1c2fac65bcb for instance b208d9d1-ef51-49c1-9370-0bafabf9562e on n-h2-850468-18 Aug 25 13:45:21.442366 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f6d985d0-ea3f-42b6-9b36-352745403d35 req-331681d3-3bce-458b-b834-fdf20dfa8dea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078740 Aug 25 13:45:21.443378 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3117/6162] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:45:21.521478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:21.523714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:21.543157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.544773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.547106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.549168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.550287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.551141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.686257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:21.695432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:21.697714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:21.698124 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4da7217-20f5-4d24-a37b-4669310bbb71 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.185245 Aug 25 13:45:21.699309 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3046/6163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:21 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:21.708626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.709712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.710598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.711844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.712873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.713593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.759337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:21.760330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:21.761519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:21.762190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lazy-loading 'fault' on Instance uuid b208d9d1-ef51-49c1-9370-0bafabf9562e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:45:21.819043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd77a6b3e204a56b84c6eee05200442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901258b3bfad4f11a18b377f1aa0ed3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:21.834510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-278c1cdb-2d4d-4144-89a3-66f386706e01 tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 200 len: 1308 microversion: 2.1 time: 0.150220 Aug 25 13:45:21.838363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3118/6164] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:21 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:22.740988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:22.742306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:22.756512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:22.757435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:22.758263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:22.759584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:22.760474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:22.761274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:22.880093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:22.882053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] [instance: b208d9d1-ef51-49c1-9370-0bafabf9562e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:22.895387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:22.901633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:22.902430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:22.903044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:22.904146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:22.906034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:22.906878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:22.912866 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c796fb3b-b815-42a8-b161-e17840ebf21e tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.179856 Aug 25 13:45:22.926850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3047/6165] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:22 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:22.932964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] HTTP exception thrown: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Request method failure captured: Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e HTTP/1.1 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3vBWZQJ0GSYBXYAedLYbfAs06z47c3z_i2nSm_tn3DTkjW1tpyLs6SPvSCSo4fNb-E4Cuwyx7TmLjB2xbc3hTkpsuuVIToOpmcAhhNaGMfuzanDR394Y9SLU58EqUZp4o5v5iLarRc6DQEvdzjGddD9VSGi4uUl7V8w0e3jUPH3c60 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 901258b3bfad4f11a18b377f1aa0ed3d Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/901258b3bfad4f11a18b377f1aa0ed3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 901258b3bfad4f11a18b377f1aa0ed3d Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1787657051 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-VolumesSnapshotTestJSON-1787657051-project Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0dd77a6b3e204a56b84c6eee05200442 Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-VolumesSnapshotTestJSON-1787657051-project Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'b208d9d1-ef51-49c1-9370-0bafabf9562e'} Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:22.939769 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] Returning 404 to user: Instance b208d9d1-ef51-49c1-9370-0bafabf9562e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-75509724-72ad-442c-aaf4-c2ef00e57d6f tempest-VolumesSnapshotTestJSON-1787657051 tempest-VolumesSnapshotTestJSON-1787657051-project] 10.222.0.60 "GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e" status: 404 len: 111 microversion: 2.1 time: 0.073684 Aug 25 13:45:22.949400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3119/6166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:22 2022] GET /compute/v2.1/servers/b208d9d1-ef51-49c1-9370-0bafabf9562e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:45:23.954965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:23.957232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:23.969251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:23.970286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:23.971150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:23.972208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:23.973069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:23.973815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:24.077897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:24.094654 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc4dfb29-5c6e-410f-bc2d-1f14edd594f9 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1225 microversion: 2.1 time: 0.146759 Aug 25 13:45:24.096298 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3048/6167] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:23 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:25.141331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:25.142915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:25.155936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:25.157250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:25.158076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:25.159074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:25.160322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:25.160645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:25.223582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:25.224213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:25.224672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:25.225261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lazy-loading 'fault' on Instance uuid 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:45:25.291059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28984c02b06f4a3db9f97aec71b7ae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4a8deb5f9d490c846c6cbdf66e799b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:25.303904 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4570a579-48c0-454f-a2a6-86dfa767038a tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 200 len: 1230 microversion: 2.1 time: 0.172096 Aug 25 13:45:25.305244 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3120/6168] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:25 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 1230 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:26.339811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:26.344007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 9ab21daa-b870-4d92-bb5f-f47b9403dbc3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:26.357453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:26.359197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:26.360528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:26.362205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:26.363159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:26.363962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:26.397100 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 HTTP/1.1 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '9ab21daa-b870-4d92-bb5f-f47b9403dbc3'} Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:26.400506 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. Aug 25 13:45:26.408983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:26.411280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 9ab21daa-b870-4d92-bb5f-f47b9403dbc3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:26.413112 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c0f6a8f-4d91-4957-beef-385dc58bc7ce tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3" status: 404 len: 111 microversion: 2.1 time: 0.081552 Aug 25 13:45:26.414059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3049/6169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:26 2022] GET /compute/v2.1/servers/9ab21daa-b870-4d92-bb5f-f47b9403dbc3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:45:27.319548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:27.320327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:27.331532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:27.332867 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:27.333944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:27.335590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:27.337038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:27.337849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:27.366268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec HTTP/1.1 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '4829a5ea-dc2a-430b-9e60-768191508fec'} Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:27.369793 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:27.378796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa54b7e0-e89e-4365-add2-92cf72a9d231 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 404 len: 111 microversion: 2.1 time: 0.057144 Aug 25 13:45:27.383373 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3121/6170] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:45:27 2022] DELETE /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:45:27.387735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:27.389144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [instance: 4829a5ea-dc2a-430b-9e60-768191508fec] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:27.396991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:27.397591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:27.398049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:27.398784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:27.399411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:27.399871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:27.420967 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] HTTP exception thrown: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Request method failure captured: Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec HTTP/1.1 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3eIXI3pohfFLYnQxG_e87euRFnw6cn3WJ_QLRc420dba3W1jaNBKV64WTLJ5REoSAOFVe-Fz9pi7amE1PGs2S1XyPakUSdUs5lekGJMKX5oV-06ZOUvHN5RPZ2foM5Wq9kXcABERL4twH0B_rJoW88KKIg14BqyiBE_qcU4-5wL0-c Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2b4a8deb5f9d490c846c6cbdf66e799b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2b4a8deb5f9d490c846c6cbdf66e799b Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126844654 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 28984c02b06f4a3db9f97aec71b7ae54 Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestVolumeBootPattern-1126844654-project Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '4829a5ea-dc2a-430b-9e60-768191508fec'} Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:27.422650 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Returning 404 to user: Instance 4829a5ea-dc2a-430b-9e60-768191508fec could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c7453ff-d7bc-48f6-ba99-ca547986ed91 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec" status: 404 len: 111 microversion: 2.1 time: 0.040648 Aug 25 13:45:27.430525 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3050/6171] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:27 2022] GET /compute/v2.1/servers/4829a5ea-dc2a-430b-9e60-768191508fec => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:45:33.640395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-920fccc2-e563-4416-b5d4-7f6f16c77e24 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] Calling method '.version_select at 0x7fc6c6c31940>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:33.652060 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-920fccc2-e563-4416-b5d4-7f6f16c77e24 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [240fb10b-69ec-4ee0-811e-acdb72400662] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:45:34.671522 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-920fccc2-e563-4416-b5d4-7f6f16c77e24 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] [240fb10b-69ec-4ee0-811e-acdb72400662] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45302. Aug 25 13:45:34.726138 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-920fccc2-e563-4416-b5d4-7f6f16c77e24 tempest-TestVolumeBootPattern-1126844654 tempest-TestVolumeBootPattern-1126844654-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-536620425" status: 202 len: 0 microversion: 2.1 time: 1.093077 Aug 25 13:45:34.728185 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3122/6172] 10.222.0.60 () {58 vars in 1260 bytes} [Thu Aug 25 13:45:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-536620425 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:45:42.459439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:42.462891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:42.479321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:42.480840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:42.484232 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:42.485739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:42.487008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:42.488829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:42.506750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:42.531783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:43.090808 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59d4ebac-9152-4a9e-931c-4f5ba6693ebb tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1836 microversion: 2.1 time: 0.638250 Aug 25 13:45:43.092443 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3051/6173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:42 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1836 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:45.488096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:45.489003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:45.490560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:45.509453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:45.515118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:45:45.519045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:45.520520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:45.521072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:45.521825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:45.523410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:45.525253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:45.526201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:45.534932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:45.536470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:45.581483 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] Creating event network-changed:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h1-850468-18 Aug 25 13:45:45.602540 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-78c76aa5-861a-4ea6-9838-3d61a128d0ca req-7d476543-9d2a-4d4c-8b6d-dc1d1d675462 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123436 Aug 25 13:45:45.603707 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3052/6174] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:45:45.612806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:45:45.975345 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15ba4e15-f0cd-4a77-b62a-6d609ec4b767 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 204 len: 0 microversion: 2.1 time: 0.501623 Aug 25 13:45:45.985811 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3123/6175] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:45:45 2022] DELETE /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:45:46.006741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:46.008695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:46.025392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:46.026716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:46.030476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:46.032287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:46.033465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:46.036103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:46.538249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:46.572072 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6f24014-e099-4262-af12-f6a4c789736b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1689 microversion: 2.1 time: 0.578240 Aug 25 13:45:46.575215 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3053/6176] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:45 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1689 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:45:47.644841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:47.647404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:47.697133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:47.707205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:47.715656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:47.724829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:47.725820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:47.730744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:48.660866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:48.706375 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-707ed212-e893-401b-9bb3-6abb539ff3cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1689 microversion: 2.1 time: 1.091852 Aug 25 13:45:48.707532 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3124/6177] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:47 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1689 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:49.381783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b873e6e1-2a73-46a2-bb58-1205da52142e", "name": "network-vif-deleted", "tag": "017ca2e0-b5b5-4b41-89d7-e4de25bffe1a"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:45:49.411561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:49.415250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:49.417096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:49.471269 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] Creating event network-vif-deleted:017ca2e0-b5b5-4b41-89d7-e4de25bffe1a for instance b873e6e1-2a73-46a2-bb58-1205da52142e on n-h1-850468-18 Aug 25 13:45:49.484180 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-64e6cbdc-92d2-4aca-8b37-b8df244de543 req-6774d743-c4d0-4861-81c5-7cbc48566ba4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114366 Aug 25 13:45:49.493859 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3054/6178] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:45:49.753189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:49.754339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:49.788162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:49.789164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:49.790019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:49.802099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:49.803473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:49.804396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:49.943314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:49.944943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:49.946224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:49.952198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lazy-loading 'fault' on Instance uuid b873e6e1-2a73-46a2-bb58-1205da52142e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:45:50.169778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:45:50.196740 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc661b4f-c4fe-4115-8478-0cb0cd55b062 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 200 len: 1357 microversion: 2.1 time: 0.452982 Aug 25 13:45:50.206760 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3125/6179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:49 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 1357 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:45:51.271115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:45:51.276032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: b873e6e1-2a73-46a2-bb58-1205da52142e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:45:51.298783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:51.301561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:51.303499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:51.313430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:45:51.314408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:45:51.324781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:45:51.352385 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] HTTP exception thrown: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Request method failure captured: Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e HTTP/1.1 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3xnodkzhBi1ie6ZcgaYa4g8pQLL6CMYNxAG0T4rPbE-Mmj-Xg4C-YdcsTRNGTkzJbKx4KNW4l4_s8FYzJNFR8PlG3OVY9egFgUEJbDQ-fqmbi2PSTdx_nvbAV0P18W1xhrJh5QGNEIg6kfZDnDv5tLHW23LeuVkVsXjenz9qpVE7kc Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 10c593bba32e4bec8f8ed1b8909440e0 Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'b873e6e1-2a73-46a2-bb58-1205da52142e'} Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:51.354916 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. Aug 25 13:45:51.360855 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:45:51.362943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Returning 404 to user: Instance b873e6e1-2a73-46a2-bb58-1205da52142e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:45:51.366530 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a02a10d-ea43-433e-9f4d-bc4a19d1b1df tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e" status: 404 len: 111 microversion: 2.1 time: 0.119301 Aug 25 13:45:51.374800 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3055/6180] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:45:51 2022] GET /compute/v2.1/servers/b873e6e1-2a73-46a2-bb58-1205da52142e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:46:02.434058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb86a2ee-7d6e-4373-b7d2-a434a5d1030d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '.version_select at 0x7fc6c1700ca0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:02.482899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:02.484853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:02.544207 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb86a2ee-7d6e-4373-b7d2-a434a5d1030d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927643376" status: 202 len: 0 microversion: 2.1 time: 0.117280 Aug 25 13:46:02.549492 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3126/6181] 10.222.0.60 () {58 vars in 1284 bytes} [Thu Aug 25 13:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927643376 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:46:02.625148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: .version_select at 0x7fc6c101baf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-508535275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPvFTiWJQ0d9veshSwEEUQBV0G71RjOu7RIJbMenC9Dn8WaWtQfmTOmayKvC/9Ct0GmRez+MctskJwWX+5F2rapUrW4OuFp1gTsT0g69rAR8xv7bJ4M1XgeqxAaZKj3PA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:02.646660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:02.648397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:02.674851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:46:02.682872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:46:02.704634 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:46:03.721342 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45564. Aug 25 13:46:03.754597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3763e337-0a76-433f-ac2a-63201324e9a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.137444 Aug 25 13:46:03.756197 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3056/6182] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:46:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:46:17.978318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1781729371", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "c90ead3b-ae1e-424c-b836-ee1afb433be6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-508535275", "security_groups": [{"name": "tempest-secgroup-smoke-23918246"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:18.232752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] validate_networks() for [('c90ead3b-ae1e-424c-b836-ee1afb433be6', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:46:19.179324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:46:19.180669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:46:19.181735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:46:19.182419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:46:19.183083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:46:19.208918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:19.209898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:19.210724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:19.212515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:19.213367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:19.214420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:19.252754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:46:19.279411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:46:19.311026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:46:19.332559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:46:19.462835 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:46:20.480033 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 45762. Aug 25 13:46:20.492035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2dfc334-0faf-4bfb-a76b-c1b777a77fa4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.524837 Aug 25 13:46:20.494328 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3127/6183] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:46:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:46:20.510525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:20.514990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:20.537871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-696606ef-4e1d-4d33-bc67-c97733deff25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:20.546417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-696606ef-4e1d-4d33-bc67-c97733deff25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:20.698030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-696606ef-4e1d-4d33-bc67-c97733deff25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:20.718746 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-696606ef-4e1d-4d33-bc67-c97733deff25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1266 microversion: 2.1 time: 0.212120 Aug 25 13:46:20.736171 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3057/6184] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:20 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:21.775556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:21.776561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:21.805230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:21.830510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:21.831704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:21.832783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:21.833681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:21.834499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:22.058433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:22.090741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-477be767-4e19-483b-be0c-27ddc80ebb93 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1270 microversion: 2.1 time: 0.335161 Aug 25 13:46:22.092182 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3128/6185] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:21 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:23.126723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:23.143696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:23.177484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:23.178501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:23.179388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:23.181433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:23.182283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:23.183049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:23.439944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:23.468670 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-098536bb-56db-42ad-9086-2b00408595ea tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1324 microversion: 2.1 time: 0.349634 Aug 25 13:46:23.470656 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3058/6186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:23 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:24.502270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:24.502739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:24.516934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:24.518393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:24.519129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:24.520747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:24.521923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:24.523783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:24.702918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:24.723582 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7ea56fd3-9124-4663-b624-892139d9c939 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1324 microversion: 2.1 time: 0.227143 Aug 25 13:46:24.725233 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3129/6187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:24 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:46:25.769106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:25.770822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:25.802608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:25.806735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:25.810935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:25.812652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:25.817717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:25.818728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:26.306020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:26.331361 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10cdc54f-c68c-4703-9407-f6b659e7a268 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.576646 Aug 25 13:46:26.333820 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3059/6188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:25 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:27.148454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:27.196197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:27.197028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:27.197865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:27.229317 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] Creating event network-changed:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:46:27.243706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3a5bccf7-d697-4283-82ca-c73ffd0e4be8 req-d8288c88-a818-4611-beb3-dda59aa0ed47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102027 Aug 25 13:46:27.245475 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3130/6189] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:46:27.385429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:27.388349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:27.412809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:27.415717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:27.417093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:27.419247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:27.420658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:27.423034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:27.743844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:27.769628 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a628e45c-3da2-4ca2-8755-c349be982f68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.396008 Aug 25 13:46:27.771010 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3060/6190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:27 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:28.816186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:28.818471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:28.834167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:28.835881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:28.838143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:28.840947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:28.841907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:28.842883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:29.226686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:29.237372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:29.243782 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b734272-fbd4-425f-b84a-967f6a2f8d78 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.439539 Aug 25 13:46:29.260692 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3131/6191] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:28 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:30.288771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:30.289685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:30.298627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:30.299414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:30.300069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:30.301056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:30.301710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:30.302331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:30.592223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:30.615284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-72941c89-646d-48f4-8c10-9cdc2554fb82 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.334340 Aug 25 13:46:30.618016 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3061/6192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:30 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:31.640875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:31.642263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:31.650269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:31.654066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:31.655436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:31.656334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:31.657364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:31.658324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:31.659413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:31.921061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:31.943270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ada5fa43-cabd-4faa-85c6-785e80265a8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.306137 Aug 25 13:46:31.945355 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3132/6193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:31 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:46:32.521537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:32.884731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-plugged", "status": "completed", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:32.909714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:32.912096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:32.914206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:32.946340 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] Creating event network-vif-plugged:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:46:32.957911 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-efc2f50f-aaea-4383-8f2d-27e3d3e869ce req-cb317ea4-0585-4153-bd62-819cfe8a0569 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452974 Aug 25 13:46:32.959658 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3062/6194] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:46:33.037045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:33.043487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:33.079899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:33.091819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:33.092688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:33.093750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:33.094415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:33.095021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:33.487526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:33.501648 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-15e18051-f58c-4d07-afe7-d6c56cc8c60e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1390 microversion: 2.1 time: 0.536183 Aug 25 13:46:33.502703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3133/6195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:32 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1390 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:34.535095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:34.536951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:34.556231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:34.557601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:34.565846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:34.580158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:34.587893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:34.589392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:34.923915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:34.943122 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a3b59b0-a627-4b17-9d11-552fad2594a3 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1562 microversion: 2.1 time: 0.416455 Aug 25 13:46:34.945990 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3063/6196] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:34 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1562 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:34.979859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:34.981309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:34.995408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:34.996539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:34.997456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:35.000579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:35.001514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:35.002379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:35.311082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:35.328233 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ecdc5eb-8e34-40c2-94b2-72cd71eb0435 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1562 microversion: 2.1 time: 0.355794 Aug 25 13:46:35.330168 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3134/6197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:34 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1562 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:46:39.477587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:46:39.483156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:39.485259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:39.505461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:39.507296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:39.508394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:39.521131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:39.523005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:39.528571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:39.530260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:39.533297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:39.535184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] Creating event network-changed:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:46:39.539024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:39.548850 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4ecdaac4-04f4-4d0e-9855-42f0755ad303 req-d37cecfc-e32c-4b45-9209-e1fbe9b03031 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071373 Aug 25 13:46:39.569559 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3135/6198] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:46:40.006127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:46:40.029790 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8cfdd48-b8de-4dc3-824c-9f7e544eb381 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1562 microversion: 2.1 time: 0.561729 Aug 25 13:46:40.032562 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3064/6199] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:46:39 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1562 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:46:58.709444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:58.711931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=42 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:46:58.719229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:46:58.724433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:46:58.740071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:58.742107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:58.742699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:58.743589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:46:58.744398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:46:58.744937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:46:58.825521 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1aa8d261-4969-43b2-8a01-c41da468e7a1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action" status: 200 len: 24569 microversion: 2.1 time: 0.119999 Aug 25 13:46:58.833573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3136/6200] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:46:58 2022] POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action => generated 24569 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:47:09.526466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:09.527359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:09.529560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:09.530338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=38 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:09.538161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:09.538846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:09.539420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:09.540388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:09.540988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:09.541538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:09.767927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8bcf9672-c888-4dec-bd2f-7b9e608ac75d tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1833 microversion: 2.1 time: 0.245835 Aug 25 13:47:09.769081 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3065/6201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:09 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1833 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:47:09.808024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:09.809230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:09.814486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:09.816681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:09.833172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:09.834328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:09.835077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:09.836435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:09.837257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:09.838036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.114273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:10.130189 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-193588d9-bb9b-4382-b9f8-6e5208819056 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1680 microversion: 2.1 time: 0.331767 Aug 25 13:47:10.131255 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3137/6202] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:09 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:10.308563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:10.311538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:10.321468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.322148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.322874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.323769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.324417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.325021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.391044 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd3cd6b8-b7e2-4054-b4d5-e389f6e2d88c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action" status: 200 len: 32639 microversion: 2.1 time: 0.087982 Aug 25 13:47:10.391959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3066/6203] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:47:10 2022] POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action => generated 32639 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:47:10.607246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:10.608693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:10.621426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.622878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.623874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.625257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:10.626128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:10.626925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:10.713562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc4c8e47035a4df39b1faa17b5396e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe039087024e493f8ad1d1ed917fbee2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:10.714801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] flavor_id is None. Assuming migration. {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 25 13:47:10.716164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:47:11.319572 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a74f742e-3b16-47fb-acc7-dcb7a84623f2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action" status: 202 len: 0 microversion: 2.1 time: 0.719524 Aug 25 13:47:11.321803 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3138/6204] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:47:10 2022] POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:47:11.340375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:11.342984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:11.359742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:11.361266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:11.362181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:11.364665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:11.365882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:11.366958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:11.684175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:11.700671 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e8d4999-c947-41e3-b07e-c329f1d8672b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1689 microversion: 2.1 time: 0.369638 Aug 25 13:47:11.701844 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3067/6205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:11 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1689 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:12.747333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:12.749549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:12.764007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:12.765092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:12.765851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:12.767163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:12.767990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:12.770148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:13.050268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:13.064508 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7268ee19-ee2f-4e1d-a1c0-fa34c5e11023 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1689 microversion: 2.1 time: 0.327783 Aug 25 13:47:13.065707 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3139/6206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:12 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1689 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:14.111670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:14.114449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:14.127516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:14.128948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:14.129780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:14.131172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:14.132695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:14.133694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:14.470715 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:14.484093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-54fcfee8-8895-476f-b3df-5d0d60f425bf tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1689 microversion: 2.1 time: 0.378792 Aug 25 13:47:14.485338 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3068/6207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:14 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1689 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:47:15.521105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:15.521739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:15.530260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:15.530759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:15.531207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:15.531935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:15.532440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:15.532876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:15.771715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:15.790060 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9664281-170f-4a0e-aff2-6bf5c1441227 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.274305 Aug 25 13:47:15.791375 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3140/6208] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:15 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:16.824167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:16.825395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:16.838967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:16.840576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:16.841419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:16.842694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:16.844251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:16.845249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:17.129047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:17.146612 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aaff5b51-f45a-40dd-80aa-2a043b354372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.329967 Aug 25 13:47:17.147651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3069/6209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:16 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:18.185675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:18.187031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:18.199735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:18.200389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:18.201087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:18.201903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:18.202708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:18.203218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:18.421539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:18.431178 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56fe37d5-d146-4af4-903b-abea548761f6 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.252097 Aug 25 13:47:18.432098 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3141/6210] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:18 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:19.456509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:19.457324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:19.465745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:19.466424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:19.466941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:19.467856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:19.468476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:19.469065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:19.694480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:19.710495 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d38a1f9-9bad-43bb-a471-baa32c6b0eae tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.259201 Aug 25 13:47:19.711632 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3070/6211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:19 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:20.749197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:20.750362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:20.762261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:20.763578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:20.764615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:20.765994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:20.766863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:20.767308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:21.016660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:21.031218 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-99d4bbda-4d0a-4c11-bb77-aeba0a6a6ad5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.288424 Aug 25 13:47:21.033901 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3142/6212] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:20 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:22.075813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:22.077401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:22.090628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:22.091544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:22.092430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:22.093785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:22.094594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:22.095375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:22.324096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:22.340097 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a483825-e132-4304-8a84-e931cd2d3854 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.271321 Aug 25 13:47:22.341470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3071/6213] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:22 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:23.382405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:23.383329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:23.396955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:23.397637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:23.398490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:23.399729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:23.400621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:23.401928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:23.628353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:23.639386 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0f4dfcb5-8693-4154-90dd-9d52480e2a2d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.264163 Aug 25 13:47:23.639386 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3143/6214] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:23 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:24.662071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:24.663123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:24.672107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:24.672718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:24.673171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:24.673934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:24.675047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:24.675047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:24.911924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:24.924674 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aed085f8-0352-4f24-a839-44d8c7bbfe8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.266654 Aug 25 13:47:24.926185 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3072/6215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:24 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:25.970111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:25.971300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:25.980934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:25.981449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:25.981915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:25.982662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:25.983152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:25.983591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:26.199257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:26.211203 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5d91f498-977e-4179-af53-fd4f96b642c1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1694 microversion: 2.1 time: 0.248943 Aug 25 13:47:26.212168 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3144/6216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:25 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:27.250918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:27.253800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:27.269269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:27.273278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:27.275063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:27.276527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:27.277696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:27.278529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:27.624284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:27.639996 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-456b7341-9275-4d75-b8b4-7c2e2bf30fc8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1693 microversion: 2.1 time: 0.396301 Aug 25 13:47:27.652795 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3073/6217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:27 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1693 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:28.074320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-unplugged", "status": "completed", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:28.101796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:28.103345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:28.103500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:28.143465 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Creating event network-vif-unplugged:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h1-850468-18 Aug 25 13:47:28.156477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] Instance 3a0cde47-287a-4ad8-a060-afd71069d44d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:47:28.201451 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b7b4b163-fc03-4340-8df7-4fbf465b4a92 req-ef6983ed-f0d0-49f8-8aa0-173906dbc3a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131272 Aug 25 13:47:28.202922 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3145/6218] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:47:28.675077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:28.677011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:28.690399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:28.691029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:28.691937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:28.693283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:28.693963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:28.694580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:29.127586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:29.143450 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c36f18c7-4b02-4b78-bbbd-43302cc43d0b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1693 microversion: 2.1 time: 0.474748 Aug 25 13:47:29.144599 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3074/6219] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:28 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1693 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:30.181241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:30.181241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:30.192161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:30.192387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:30.193235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:30.195789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:30.196818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:30.197695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:30.250945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:30.273687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:30.275168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:30.275870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:30.301030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Creating event network-changed:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h1-850468-18 Aug 25 13:47:30.312758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] Instance 3a0cde47-287a-4ad8-a060-afd71069d44d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:47:30.335320 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-de33a39d-9dff-408a-b85c-6fd8500c0e0f req-2b692a9e-2a70-4e3a-bbbb-edfe1bfd7a84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090598 Aug 25 13:47:30.335320 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3075/6220] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:47:30.537298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:30.554913 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d44b19f7-ca94-448a-8034-d1feaa508b9d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1691 microversion: 2.1 time: 0.386288 Aug 25 13:47:30.556227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3146/6221] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:30 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1691 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:31.590750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:31.591922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:31.604822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:31.605688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:31.606488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:31.607760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:31.608619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:31.609384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:31.827013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:31.846541 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-861cd343-fc2d-48ec-8f83-a4cbfb6af9a9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1691 microversion: 2.1 time: 0.266209 Aug 25 13:47:31.847568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3076/6222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:31 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:32.890303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:32.891549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:32.899569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:32.900094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:32.900456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:32.901200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:32.901670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:32.902105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:33.522261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:33.538280 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f05764b-1432-418f-a304-9b2857ce707a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1691 microversion: 2.1 time: 0.669234 Aug 25 13:47:33.539234 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3147/6223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:32 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1691 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:34.577632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:34.578691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:34.591380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:34.592316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:34.593037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:34.594292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:34.595731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:34.596580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:34.952753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:34.978159 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-724598d4-243f-4eb5-9dd3-c3982b82a6c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1688 microversion: 2.1 time: 0.407866 Aug 25 13:47:34.979836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3077/6224] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:34 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1688 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:35.014369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:35.015615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:35.038474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.039328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.040186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.041201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.041955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.044633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.288305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a75320f7-fcee-4994-b874-68c928bf7b18 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action" status: 202 len: 0 microversion: 2.1 time: 0.279940 Aug 25 13:47:35.291464 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3148/6225] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:47:35 2022] POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:47:35.312772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:35.318366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:35.346001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.348170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.349320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.350718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.357169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.358144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.599862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-plugged", "status": "completed", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:35.614613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:35.615717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:35.617027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:35.644348 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Creating event network-vif-plugged:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h1-850468-18 Aug 25 13:47:35.656090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] Instance 3a0cde47-287a-4ad8-a060-afd71069d44d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:47:35.680629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-35145465-56e2-40ca-8349-c3ef8f002816 req-9f848d6b-c753-4283-9a38-3ed140d08b9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086776 Aug 25 13:47:35.681772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3149/6226] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:47:35.879201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:35.889764 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ffc01962-c379-473a-b539-efb2517dc0b9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.582803 Aug 25 13:47:35.890682 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3078/6227] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:35 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:47:36.936919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:36.939221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:36.951829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:36.953223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:36.954933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:36.956824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:36.958132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:36.959069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:37.215383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:37.220563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:37.237790 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5eed7fec-8cdf-45e8-a6fc-3443f3db2457 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.313065 Aug 25 13:47:37.240273 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3150/6228] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:36 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:38.268166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:38.269389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:38.283205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:38.284364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:38.285225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:38.286607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:38.287523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:38.288389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:38.569986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:38.596566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce88ecf2-00e8-4206-b9e8-1d22006d4080 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.331078 Aug 25 13:47:38.597489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3079/6229] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:38 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:39.632865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:39.640096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:39.657168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:39.658294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:39.660619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:39.661546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:39.662509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:39.663411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:39.989259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:40.006946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-426122ed-140a-42d9-a6a8-1aa75936679c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.383128 Aug 25 13:47:40.008329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3151/6230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:39 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:47:40.200836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-unplugged", "status": "completed", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:40.210453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=31 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:40.223559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:40.224788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:40.225976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:40.235999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=87 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:40.255778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Creating event network-vif-unplugged:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:47:40.271806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] Instance 3a0cde47-287a-4ad8-a060-afd71069d44d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:47:40.294882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ba24ed1f-6c82-432d-9136-339dcd3e9c20 req-d7f2d4fc-7112-4717-a7ad-25cdbc7f108b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099362 Aug 25 13:47:40.296040 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3080/6231] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:41.053843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:41.056490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:41.066610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=37 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:47:41.083881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:41.085273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:41.086238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:41.088886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:41.090282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:41.091427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:41.434557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:41.448432 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7796f17-4b34-44bd-9c37-75b3092e5365 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.403701 Aug 25 13:47:41.449408 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3152/6232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:41 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:42.393912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:42.410220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:42.410737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:42.411450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:42.435402 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Creating event network-changed:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:47:42.448045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] Instance 3a0cde47-287a-4ad8-a060-afd71069d44d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:47:42.471083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0553937f-de60-4597-aeec-560b1c2b901a req-1eec3f17-ae98-4cde-90c8-b31e48d5db4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084107 Aug 25 13:47:42.472453 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3081/6233] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:47:42.483849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:42.485211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:42.496675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:42.497588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:42.498425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:42.499744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:42.502024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:42.503198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:42.867063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:42.885276 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8c861ef-1a57-43ac-9d08-7259c6392396 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1687 microversion: 2.1 time: 0.408871 Aug 25 13:47:42.885975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3153/6234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:42 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1687 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:43.916751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:47:43.918358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:47:43.931344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:43.932465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:43.933368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:43.934813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:43.936544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:43.937512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:44.171540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:47:44.194067 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9465b55e-20f2-47a5-b20b-cbde60695d25 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1680 microversion: 2.1 time: 0.287917 Aug 25 13:47:44.195232 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3082/6235] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:47:43 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:47:46.867028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-plugged", "status": "completed", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:47:46.885301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:47:46.886039 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:47:46.886489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:47:46.912455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] Creating event network-vif-plugged:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:47:46.922854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3ed8b4a2-18d5-45f1-b3cc-60990fd23e97 req-edcb2547-7ec6-4ebc-a80e-e7a87d06b46e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064362 Aug 25 13:47:46.923521 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3154/6236] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:08.534777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:08.535769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=13 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:08.787712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:08.792546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:08.807578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:08.808559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:08.809644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:08.811104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:08.811779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:08.812451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:08.900411 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ae391ed-d5ee-4172-9eeb-5f5d74b79d35 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action" status: 200 len: 63166 microversion: 2.1 time: 0.377616 Aug 25 13:48:08.902218 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3083/6237] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:48:08 2022] POST /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d/action => generated 63166 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:48:15.180070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:15.181985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=21 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:15.396728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:15.398174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:15.410169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.411563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.412087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.413666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:15.414875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:15.415523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:15.648437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f70e35c6-996b-4f7e-b59c-af3e9660ceed tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1833 microversion: 2.1 time: 0.480655 Aug 25 13:48:15.649958 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3155/6238] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:15 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1833 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:17.338594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:17.339680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:17.341324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:17.357680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.358282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.358926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.360707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.361911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.362995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.364614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.365456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.366277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.394297 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] Creating event network-changed:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:48:17.409073 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a46e89cd-bb69-4243-8eb4-3219ef8ce1be req-e51a6dfa-0bba-4989-b670-ed7641aeea8a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077235 Aug 25 13:48:17.410522 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3156/6239] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:17.436694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:48:17.679240 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-faa0098f-ed4f-4a37-81dc-b534e25d9109 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 204 len: 0 microversion: 2.1 time: 0.351401 Aug 25 13:48:17.681759 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3084/6240] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:48:17 2022] DELETE /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:48:17.698647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:17.699324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:17.723974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.725282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.726059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:17.727329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:17.728145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:17.729002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:18.003251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:18.019616 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9c3f1c75-dd3b-49df-a23b-a02c2a75d890 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1686 microversion: 2.1 time: 0.330254 Aug 25 13:48:18.020697 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3157/6241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:17 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1686 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:19.059086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:19.060663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:19.078725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:19.079597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:19.080731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:19.082509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:19.083685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:19.084810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:19.785730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:19.801482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2875b5cc-637a-403b-bd25-808b3ceb8ae2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1686 microversion: 2.1 time: 0.751862 Aug 25 13:48:19.803468 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3085/6242] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:19 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1686 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:20.541375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0cde47-287a-4ad8-a060-afd71069d44d", "name": "network-vif-deleted", "tag": "071dd797-1bf7-4078-8883-1bfaf8d24a04"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:20.561148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.561888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.562701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.588238 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] Creating event network-vif-deleted:071dd797-1bf7-4078-8883-1bfaf8d24a04 for instance 3a0cde47-287a-4ad8-a060-afd71069d44d on n-h2-850468-18 Aug 25 13:48:20.597365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-da29b78b-0a94-49c6-a93a-7368255a6409 req-e51b4f99-3fbf-4f9b-9c82-f336a3495c54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187380 Aug 25 13:48:20.598521 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3158/6243] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:48:20.853202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:20.854603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:20.869894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.871006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.872171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.873860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.875481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.876818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.945814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:20.946897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:20.947893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:20.949248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lazy-loading 'fault' on Instance uuid 3a0cde47-287a-4ad8-a060-afd71069d44d {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:48:21.044862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:21.061193 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8f7d395-c62f-40c4-9d93-a616829c7b2e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 200 len: 1356 microversion: 2.1 time: 0.215509 Aug 25 13:48:21.062350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3086/6244] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:20 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:22.110731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:22.112022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 3a0cde47-287a-4ad8-a060-afd71069d44d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:22.124427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:22.125333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:22.126095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:22.127323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:22.128147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:22.128918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:22.159363 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] HTTP exception thrown: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Request method failure captured: Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d HTTP/1.1 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3xnodkzhBi1ie6ZcgaYa4g8pQLL6CMYNxAG0T4rPbE-Mmj-Xg4C-YdcsTRNGTkzJbKx4KNW4l4_s8FYzJNFR8PlG3OVY9egFgUEJbDQ-fqmbi2PSTdx_nvbAV0P18W1xhrJh5QGNEIg6kfZDnDv5tLHW23LeuVkVsXjenz9qpVE7kc Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 10c593bba32e4bec8f8ed1b8909440e0 Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '3a0cde47-287a-4ad8-a060-afd71069d44d'} Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:48:22.162925 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Returning 404 to user: Instance 3a0cde47-287a-4ad8-a060-afd71069d44d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5b12d623-7a53-4cfc-be52-c362b9eeb414 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d" status: 404 len: 111 microversion: 2.1 time: 0.065544 Aug 25 13:48:22.179455 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3159/6245] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:22 2022] GET /compute/v2.1/servers/3a0cde47-287a-4ad8-a060-afd71069d44d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:48:28.972189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e26842c6-a20a-47ff-9f11-b547c598665d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '.version_select at 0x7fc6c109c550>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:29.017997 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e26842c6-a20a-47ff-9f11-b547c598665d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508535275" status: 202 len: 0 microversion: 2.1 time: 0.057023 Aug 25 13:48:29.019339 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3087/6246] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 13:48:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508535275 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:48:29.061010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-044de3d0-4fa8-4ade-a7ba-a6c360f79a6b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: .version_select at 0x7fc6c1885430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-489297887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5bKkD6JkmhxEDM2rhAzqpvnuhO38jrZZZf2ldqEFgQBjIe9tHK93E+2i7zZcQsWOji9vwAE6692GJURdMgYDittlHpkW1dwzraGcZ/Xqc+MXDL4f8QfYyBUy3wChf4qQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:29.085820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-044de3d0-4fa8-4ade-a7ba-a6c360f79a6b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:48:29.094963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-044de3d0-4fa8-4ade-a7ba-a6c360f79a6b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:48:29.132902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-044de3d0-4fa8-4ade-a7ba-a6c360f79a6b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.076893 Aug 25 13:48:29.134851 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3160/6247] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:48:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:40.398253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2125129669", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "255ca92a-f753-4d83-abd4-2cece09b1fbe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-489297887", "security_groups": [{"name": "tempest-secgroup-smoke-1465127414"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:40.476039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:40.478175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:40.824949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] validate_networks() for [('255ca92a-f753-4d83-abd4-2cece09b1fbe', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:48:41.948187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:48:41.949406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:48:41.949797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:48:41.950832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:48:41.951886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:48:41.972072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:41.974036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:41.974832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:41.976327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:41.977637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:41.980618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:42.030880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:48:42.048372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:48:42.079497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:48:42.084804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:48:42.202206 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b946fe41-81b5-4cfb-bbf9-db7354b71329 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.822191 Aug 25 13:48:42.203281 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3088/6248] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:48:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:48:42.221221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:42.223973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:42.225492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:42.247444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-746efa62-8304-4925-a962-72a57089a35d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:42.248811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-746efa62-8304-4925-a962-72a57089a35d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:42.398956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-746efa62-8304-4925-a962-72a57089a35d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:42.411498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-746efa62-8304-4925-a962-72a57089a35d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1266 microversion: 2.1 time: 0.193981 Aug 25 13:48:42.412232 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3161/6249] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:42 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:43.453106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73d9371c-4c9d-4978-89ef-abe1cbe6c603 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:43.454660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73d9371c-4c9d-4978-89ef-abe1cbe6c603 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:43.587680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73d9371c-4c9d-4978-89ef-abe1cbe6c603 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:43.603619 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73d9371c-4c9d-4978-89ef-abe1cbe6c603 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1266 microversion: 2.1 time: 0.159199 Aug 25 13:48:43.604769 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3089/6250] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:43 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:44.642363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:44.643585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:44.658299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:44.659305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:44.659881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:44.661427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:44.661957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:44.662426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:44.790921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:44.809787 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29dd76a0-0140-4f0c-9d3b-3f83bf24e3d1 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1270 microversion: 2.1 time: 0.171495 Aug 25 13:48:44.809787 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3162/6251] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:44 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:45.856538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:45.857905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:45.889815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:45.892135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:45.893850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:45.895096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:45.896441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:45.897250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:46.130280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:46.148025 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbad7e33-64d1-452d-ba11-b7fd10a43ab9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1318 microversion: 2.1 time: 0.306509 Aug 25 13:48:46.149105 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3090/6252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:45 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:47.177340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:47.178799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:47.188360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:47.189372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:47.190197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:47.191218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:47.192749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:47.193481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:47.363301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:47.382071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ebfbb80e-79d4-4dfb-adfe-4473039235af tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1324 microversion: 2.1 time: 0.208322 Aug 25 13:48:47.383684 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3163/6253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:47 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:48.425921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:48.427384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:48.441669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:48.442770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:48.443702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:48.445280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:48.446277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:48.447120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:48.844157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:48.861119 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca486f6e-0ffc-4c48-885b-63cb41677c33 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.443857 Aug 25 13:48:48.862168 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3091/6254] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:48 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:49.105189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:49.139332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:49.140287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:49.140931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:49.158503 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] Creating event network-changed:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h2-850468-18 Aug 25 13:48:49.165109 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-99ac3f9f-7c54-4f15-a7a2-190c61342c2b req-6901d807-d7b0-4ad9-953c-76a32742ae0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072537 Aug 25 13:48:49.165866 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3164/6255] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:48:49.892510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:49.893687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:49.907121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:49.908039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:49.908905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:49.910253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:49.911182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:49.911985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:50.156406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:50.171829 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ed09252-f53f-48bb-be7b-4c8182f2eb70 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.287795 Aug 25 13:48:50.173028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3092/6256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:49 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:51.209751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:51.211732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:51.219024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:51.220020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:51.220875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:51.221819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:51.222560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:51.223223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:51.758622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:51.768926 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8ef5415a-0f8f-4f19-aea5-716d8cc73ed2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.566077 Aug 25 13:48:51.769546 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3165/6257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:51 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:52.810834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:52.811634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:52.814663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:52.821528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:52.822522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:52.822980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:52.824026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:52.824699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:52.825328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:53.161305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:53.175981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f64f99e0-5e80-4eab-90c5-c728ad25080e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.370543 Aug 25 13:48:53.177850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3093/6258] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:52 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:54.207124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:54.207760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:54.211036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:54.219639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:54.220171 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:54.220657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:54.221392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:54.221865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:54.222305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:54.450296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:54.460965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dcc3a204-6b99-4e61-beb3-73d180794c2f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.258402 Aug 25 13:48:54.461703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3166/6259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:54 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:55.062073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "name": "network-vif-plugged", "status": "completed", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:48:55.071920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:48:55.088762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:55.089654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:55.090804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:55.135331 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] Creating event network-vif-plugged:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h2-850468-18 Aug 25 13:48:55.148451 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-2d6e1ef0-a9c6-4fcb-9130-c3a557edcd9e req-3ef363be-3a77-4f05-940b-26e133ab2bb6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094119 Aug 25 13:48:55.150997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3094/6260] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:48:55.491874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:55.492760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:55.502928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:55.503623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:55.504268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:55.505501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:55.506235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:55.506835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:55.771970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:55.788706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31b9ddb9-f808-4b64-8778-bc17c30ef42b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1392 microversion: 2.1 time: 0.300758 Aug 25 13:48:55.790379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3167/6261] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:55 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1392 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:48:56.830350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:56.831761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:56.843440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.844448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.845251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:56.846677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:56.847303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:56.847844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:57.094626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:57.108156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9bc10214-f10c-4a68-a91f-246719024c11 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1564 microversion: 2.1 time: 0.286872 Aug 25 13:48:57.109914 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3095/6262] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:56 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1564 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:48:57.154882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:48:57.155902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:48:57.170614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:57.171499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:57.172692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:57.176896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:48:57.177773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:48:57.178677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:48:57.412840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:48:57.425579 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb0e490f-bdd9-42c9-a399-685123ddbc28 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1564 microversion: 2.1 time: 0.283300 Aug 25 13:48:57.429050 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3168/6263] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:48:57 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1564 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:00.065063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:00.065882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:00.081389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:00.091646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:00.094737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:00.095240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:00.096152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:00.100015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:00.104956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:00.108022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:00.109829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:00.110394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:00.156729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] Creating event network-changed:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h2-850468-18 Aug 25 13:49:00.184900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-fdd3b5fb-10fb-4118-8e10-40097cd20b73 req-1b4d69c4-eafc-4d48-b421-91dcc3833a76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110270 Aug 25 13:49:00.186092 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3169/6264] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 25 13:49:00.685094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:00.714666 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fbaa3893-d820-4336-856a-81be6188ccca tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1564 microversion: 2.1 time: 0.653430 Aug 25 13:49:00.716252 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3096/6265] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:00 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1564 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:21.222990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:21.225845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=40 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:21.244760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:21.252345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:21.268813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.269390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.269941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:21.270836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:21.271484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:21.272144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:21.375689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5223ccad-3481-49ec-a2df-fa5a06b7d55f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action" status: 200 len: 24561 microversion: 2.1 time: 0.157212 Aug 25 13:49:21.377482 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3170/6266] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:21 2022] POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action => generated 24561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:49:26.852686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:26.854140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:27.068739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a770d2d5-6d3b-4e9f-91c4-927422127c50 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-996271717", "availability_zone": "foo_zone"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:27.074306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.aggregate [None req-a770d2d5-6d3b-4e9f-91c4-927422127c50 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Generated uuid 8f69c2d7-5d85-4480-ab1c-8b2499066a6b for aggregate {{(pid=122700) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 25 13:49:27.116941 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a770d2d5-6d3b-4e9f-91c4-927422127c50 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.274154 Aug 25 13:49:27.117619 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3097/6267] 10.222.0.60 () {60 vars in 1164 bytes} [Thu Aug 25 13:49:26 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:27.133021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe258784-175c-43ba-877a-91c14e333267 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:27.170463 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe258784-175c-43ba-877a-91c14e333267 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:49:28.193712 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe258784-175c-43ba-877a-91c14e333267 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 48394. Aug 25 13:49:28.199996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe258784-175c-43ba-877a-91c14e333267 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.073236 Aug 25 13:49:28.208451 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3171/6268] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 13:49:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.218374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:28.224450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:28.227058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:28.227871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:28.229220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:28.230032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:28.230764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:28.269345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27978893-8d83-49ba-8137-7b199991cba7 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.058856 Aug 25 13:49:28.270475 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3098/6269] 10.222.0.60 () {58 vars in 1176 bytes} [Thu Aug 25 13:49:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.289951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4968f2c7-d065-4da8-ad13-2b055735b8e2 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:28.303093 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4968f2c7-d065-4da8-ad13-2b055735b8e2 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.020505 Aug 25 13:49:28.305192 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3172/6270] 10.222.0.60 () {58 vars in 1143 bytes} [Thu Aug 25 13:49:28 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.325231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77711a70-2ee9-4821-b6f8-2af36a489244 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-850468-18"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:28.346051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77711a70-2ee9-4821-b6f8-2af36a489244 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:28.349152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77711a70-2ee9-4821-b6f8-2af36a489244 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:28.350116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77711a70-2ee9-4821-b6f8-2af36a489244 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:28.756482 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77711a70-2ee9-4821-b6f8-2af36a489244 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.439313 Aug 25 13:49:28.757537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3099/6271] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 13:49:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:49:28.768961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96dc0810-6d87-462a-bd9f-c929022e038c tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:28.778746 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96dc0810-6d87-462a-bd9f-c929022e038c tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013509 Aug 25 13:49:28.779355 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3173/6272] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:49:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:49:28.795456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a665cc6-c5b3-43d2-a935-0614ba816560 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-250220288", "availability_zone": "foo_zone"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:28.887564 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a665cc6-c5b3-43d2-a935-0614ba816560 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.095737 Aug 25 13:49:28.898283 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3100/6273] 10.222.0.60 () {60 vars in 1173 bytes} [Thu Aug 25 13:49:28 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.904587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-669a89b3-a7f5-4700-86c5-9dfdc45345b1 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:28.938963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-669a89b3-a7f5-4700-86c5-9dfdc45345b1 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.038477 Aug 25 13:49:28.940390 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3174/6274] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 13:49:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.956504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c5c66380-bea2-4ca8-b1e5-4cd91fb1b25b tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:28.969321 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c5c66380-bea2-4ca8-b1e5-4cd91fb1b25b tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.019620 Aug 25 13:49:28.970400 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3101/6275] 10.222.0.60 () {58 vars in 1152 bytes} [Thu Aug 25 13:49:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:28.985683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00d88880-ce29-41d1-b346-ceba8f8f5268 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-850468-18"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:29.002013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00d88880-ce29-41d1-b346-ceba8f8f5268 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:29.002819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00d88880-ce29-41d1-b346-ceba8f8f5268 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:29.003553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00d88880-ce29-41d1-b346-ceba8f8f5268 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:29.188969 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00d88880-ce29-41d1-b346-ceba8f8f5268 tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.208853 Aug 25 13:49:29.190390 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3175/6276] 10.222.0.60 () {60 vars in 1194 bytes} [Thu Aug 25 13:49:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:29.209492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-94a2efbc-0410-4a9c-ab67-791d01d09c5b tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:29.250800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-94a2efbc-0410-4a9c-ab67-791d01d09c5b tempest-TestAggregatesBasicOps-1971823538 tempest-TestAggregatesBasicOps-1971823538-project-admin] 10.222.0.60 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.047797 Aug 25 13:49:29.252197 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3102/6277] 10.222.0.60 () {58 vars in 1155 bytes} [Thu Aug 25 13:49:29 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 25 13:49:32.474554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:32.476084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:32.485028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:32.485689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:32.486381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:32.487541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:32.488707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:32.488707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:32.904375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:32.918310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8e20fc8d-3627-4d53-b5b2-2814ac3570a7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1682 microversion: 2.1 time: 0.450091 Aug 25 13:49:32.923745 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3176/6278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:32 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1682 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:33.057352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:33.059637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:33.066364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.066876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.067328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.068082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.068597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.069227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.136760 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ff14ee8c-47b2-4d5d-a221-e7ccf797e849 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action" status: 200 len: 32632 microversion: 2.1 time: 0.084388 Aug 25 13:49:33.137846 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3103/6279] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:33 2022] POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action => generated 32632 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:49:33.323522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:33.325651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:33.338163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.339045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.339831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.341161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.341977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.342734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.571903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b72a633-7794-4588-ba4c-78f368c21cb8 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1835 microversion: 2.1 time: 0.253049 Aug 25 13:49:33.572993 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3177/6280] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:33 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1835 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:33.606719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:33.609908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:33.619034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.619839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.620327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.621252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:33.621710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:33.622133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:33.660425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lazy-loading 'flavor' on Instance uuid 2d14b617-292d-44c9-aae6-1fbb60e003d6 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:49:33.683138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Going to try to live migrate instance to another host {{(pid=122700) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 25 13:49:35.687991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79f73dd9-3cd7-4d9d-9d89-f50157b03743 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action" status: 202 len: 0 microversion: 2.1 time: 2.086383 Aug 25 13:49:35.689497 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3104/6281] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:33 2022] POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action => generated 0 bytes in 2090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:49:35.706678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:35.707712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:35.746884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:35.750857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:35.751645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:35.754792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:35.754792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:35.755172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:36.473111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:36.483288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9645c66a-d25c-4fbf-baff-2a449a49fa3d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.786000 Aug 25 13:49:36.483941 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3178/6282] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:35 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:37.514964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:37.516792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:37.530685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:37.531873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:37.532597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:37.533989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:37.534687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:37.535329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:37.866523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:37.875543 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a20ef9fc-dde7-4c4c-8fc9-ad490c4903ad tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.366301 Aug 25 13:49:37.877153 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3105/6283] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:37 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:37.961428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "name": "network-vif-unplugged", "status": "completed", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:37.976210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:37.976517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:37.976844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:37.994297 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] Creating event network-vif-unplugged:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h2-850468-18 Aug 25 13:49:38.002946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-878a5225-4e1c-4c6f-8556-12e17e2b6b54 req-147a6df9-6304-46fe-a108-999f7edccaeb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051322 Aug 25 13:49:38.004423 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3179/6284] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:38.898740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:38.904894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:38.905672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:38.915921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.916896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.917667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:38.922896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:38.923983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:38.924757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:39.314531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:39.341113 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1fa09fd9-5caa-43d4-9278-60428acb79d0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.444242 Aug 25 13:49:39.342645 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3106/6285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:38 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:40.036081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:40.051864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.052390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.053192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.070914 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] Creating event network-changed:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h2-850468-18 Aug 25 13:49:40.078973 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-448a3b46-35e5-49b4-ba5d-aa6ddb50e4f6 req-ff169a3e-57de-4204-8397-a77846a9c537 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053034 Aug 25 13:49:40.079981 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3180/6286] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:40.376106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:40.378875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:40.415862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.416766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.417742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.419169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:40.420976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:40.422120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:40.791252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:40.808005 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b256a096-89de-4001-9036-34731b0fb2a2 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.439896 Aug 25 13:49:40.809157 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3107/6287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:40 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:41.848715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:41.850719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:41.862243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.863045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.863954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:41.865895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:41.866732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:41.867501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:42.080878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:42.095313 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-05d455d7-8461-4a7e-90d1-ccc4b31760bc tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.255410 Aug 25 13:49:42.096262 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3181/6288] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:41 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:43.130251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:43.131661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:43.140234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.140759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.141228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.142022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:43.142541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:43.142995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:43.312958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:43.327306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c08d68dc-1031-4349-b9ff-96ef91231b24 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.200732 Aug 25 13:49:43.328441 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3108/6289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:43 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:44.350491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:44.351112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:44.359610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.360161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.360767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:44.361524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:44.361997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:44.362438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:44.531633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:44.546135 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-833dff7e-0451-442e-8c19-9ae942e7ce8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.199373 Aug 25 13:49:44.546965 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3182/6290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:44 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:45.580588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:45.581851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:45.594975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:45.595886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:45.596745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:45.598106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:45.598998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:45.600369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:45.832749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:45.842944 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b972a32d-695b-4e47-a998-a7308117f01a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.269996 Aug 25 13:49:45.843701 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3109/6291] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:45 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:46.867280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:46.867942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:46.876220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.876723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.877193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:46.877910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:46.878364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:46.878792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:47.146191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:47.162671 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf991820-a842-4898-b7ce-2c063b0b7b8a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.298867 Aug 25 13:49:47.164101 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3183/6292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:46 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:48.187319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:48.188154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:48.197949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.199256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.199256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.199647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:48.201769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:48.201769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:48.458095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:48.467519 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bec1ab9b-d0f8-4d6c-b7aa-cfce1b20eb9e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1692 microversion: 2.1 time: 0.284242 Aug 25 13:49:48.477025 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3110/6293] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:48 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:49.503083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:49.504434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:49.512650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.513144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.513586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.514301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.514756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.515182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.685441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:49.695090 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0bd7ed12-980c-4ba7-9704-363cd7115571 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1682 microversion: 2.1 time: 0.197627 Aug 25 13:49:49.696348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3184/6294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:49 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:49.718916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:49.719566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:49.726991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.727565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.728026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:49.728958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:49.729433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:49.730090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:50.281077 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9dc39e4f-6dad-46b9-99ee-b5a597974eb2 tempest-TestNetworkAdvancedServerOps-1636086175 tempest-TestNetworkAdvancedServerOps-1636086175-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1835 microversion: 2.1 time: 0.566920 Aug 25 13:49:50.282147 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3111/6295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:49 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1835 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:49:50.314088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:50.314944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:50.323756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:50.326372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:50.327761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:50.328786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:50.329516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:50.330332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:50.556550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:50.567205 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-21cb8502-1bb9-4b25-a6e9-195d456b6a7b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1682 microversion: 2.1 time: 0.258673 Aug 25 13:49:50.568770 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3185/6296] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:50 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1682 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:52.758152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:52.760979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:52.768781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:52.769292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:52.769748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:52.770480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:52.772390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:52.772390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:52.843434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e47febb-f750-4a8e-b1c3-b50bd1377e8d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action" status: 200 len: 38638 microversion: 2.1 time: 0.089073 Aug 25 13:49:52.846007 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3112/6297] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:49:52 2022] POST /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6/action => generated 38638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:49:54.349985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:54.350985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:54.356361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:54.357043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:54.387556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:54.388478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:54.390105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:54.391365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:54.392290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:54.393008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:54.401428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:54.402274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:54.403018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:54.403850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=61 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:49:54.424373 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] Creating event network-changed:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h1-850468-18 Aug 25 13:49:54.435249 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-648e07b6-3fbb-4047-93f0-dc6e38d581a6 req-b0e75ab7-fbe3-46c9-a16d-999f8e0f7f6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086547 Aug 25 13:49:54.436811 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3113/6298] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:54.455528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:49:54.615864 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9b16845a-a8dd-4ad6-b540-2b9cf210af59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 204 len: 0 microversion: 2.1 time: 0.272309 Aug 25 13:49:54.617070 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3186/6299] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:49:54 2022] DELETE /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:49:54.633425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:54.635391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:54.649265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:54.650716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:54.651791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:54.653501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:54.654713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:54.655990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:55.020086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:55.036058 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9ea2d5b-f1f6-4a12-b38b-9bf5377568ed tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1688 microversion: 2.1 time: 0.411667 Aug 25 13:49:55.037623 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3114/6300] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:54 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1688 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:56.077636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:56.078902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:56.091824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.092678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.093293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.094529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.095178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.096384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.227985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:49:56.234655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d14b617-292d-44c9-aae6-1fbb60e003d6", "name": "network-vif-deleted", "tag": "62271715-c351-45b4-a148-7d046afae489"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:49:56.253235 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-82b6fb48-f8cc-4606-9aee-b3f9a744b4d4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 200 len: 1502 microversion: 2.1 time: 0.184454 Aug 25 13:49:56.254372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3187/6301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:56 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:49:56.257757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:56.259180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:56.260406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:56.286702 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] Creating event network-vif-deleted:62271715-c351-45b4-a148-7d046afae489 for instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 on n-h1-850468-18 Aug 25 13:49:56.296794 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-47e48a0f-6eab-499e-a5c9-289be80bfca8 req-c73569d6-ba24-48c1-9f8d-da0089587f47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070353 Aug 25 13:49:56.297841 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3115/6302] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:49:57.283640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:49:57.284777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 2d14b617-292d-44c9-aae6-1fbb60e003d6] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:49:57.297852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:57.298703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:57.299472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:57.300795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:49:57.302186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:49:57.303064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:49:57.333193 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] HTTP exception thrown: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Request method failure captured: Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 HTTP/1.1 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3xnodkzhBi1ie6ZcgaYa4g8pQLL6CMYNxAG0T4rPbE-Mmj-Xg4C-YdcsTRNGTkzJbKx4KNW4l4_s8FYzJNFR8PlG3OVY9egFgUEJbDQ-fqmbi2PSTdx_nvbAV0P18W1xhrJh5QGNEIg6kfZDnDv5tLHW23LeuVkVsXjenz9qpVE7kc Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 10c593bba32e4bec8f8ed1b8909440e0 Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '2d14b617-292d-44c9-aae6-1fbb60e003d6'} Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.336252 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Returning 404 to user: Instance 2d14b617-292d-44c9-aae6-1fbb60e003d6 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f330faf7-85d0-4404-a477-b3624e380e68 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6" status: 404 len: 111 microversion: 2.1 time: 0.062688 Aug 25 13:49:57.344213 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3188/6303] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:49:57 2022] GET /compute/v2.1/servers/2d14b617-292d-44c9-aae6-1fbb60e003d6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:50:02.821138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b89df163-9e85-4b6b-90a1-6e5886e8ac34 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '.version_select at 0x7fc6c101e3a0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:02.835549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:02.860669 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b89df163-9e85-4b6b-90a1-6e5886e8ac34 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-489297887" status: 202 len: 0 microversion: 2.1 time: 0.050156 Aug 25 13:50:02.861736 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3116/6304] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 13:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-489297887 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:50:02.905791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a70ffcd4-32dd-4863-8e9c-3468041062aa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: .version_select at 0x7fc6c18ad820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1918711048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrYgaY9P7Zlm3uk1h5vbMbIfplNFdIL9xwWsQgpwfvjOCh6IdSOlWY/TNSeyzFIn44z7bttwYYT9mQe5PVvymHhzryxf6sFEkpsCuXwcCa2zARJMv3/+Jf4Od5/EoChUg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:02.930579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a70ffcd4-32dd-4863-8e9c-3468041062aa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:02.938085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-a70ffcd4-32dd-4863-8e9c-3468041062aa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:02.977292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a70ffcd4-32dd-4863-8e9c-3468041062aa tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.076707 Aug 25 13:50:02.980372 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3189/6305] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:50:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:12.419436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2107170014", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "56128007-a838-4a3c-b1ed-3b52e897a543"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1918711048", "security_groups": [{"name": "tempest-secgroup-smoke-1808565508"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:12.439754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:12.637513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] validate_networks() for [('56128007-a838-4a3c-b1ed-3b52e897a543', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:50:13.318192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:50:13.318850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:50:13.319476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:50:13.320275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:50:13.320882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:50:13.333017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.333622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.334156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:13.335044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:13.335694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:13.336274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:13.362608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:50:13.371420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Getting quotas for user 10c593bba32e4bec8f8ed1b8909440e0 and project a36b07b5628841c3b15a85b9ae25666b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:50:13.395113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:50:13.400439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:50:13.478624 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ceedf6e-cb39-4d01-b94e-c1d8b1334dee tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066282 Aug 25 13:50:13.489498 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3117/6306] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:50:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:50:13.495814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:13.498158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:13.499531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:13.509482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-efff63d8-9f3c-47ac-8cf3-cfd1d50af51a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:13.510686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-efff63d8-9f3c-47ac-8cf3-cfd1d50af51a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:13.627928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-efff63d8-9f3c-47ac-8cf3-cfd1d50af51a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:13.641991 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-efff63d8-9f3c-47ac-8cf3-cfd1d50af51a tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1267 microversion: 2.1 time: 0.149409 Aug 25 13:50:13.643503 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3190/6307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:13 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:14.681253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:14.682753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:14.699160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:14.700593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:14.701864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:14.703761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:14.704807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:14.705733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:14.823395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:14.840658 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36edf026-40de-4fe7-9779-1465a39289c4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1319 microversion: 2.1 time: 0.169400 Aug 25 13:50:14.841966 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3118/6308] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:14 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:15.898160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:15.899307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:15.915593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.917833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.919870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:15.921212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:15.922275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:15.923325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:16.083844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:16.103900 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bba8c32e-e3c5-4537-8ef8-e9d8af3f0b6c tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1325 microversion: 2.1 time: 0.227356 Aug 25 13:50:16.106132 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3191/6309] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:15 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1325 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:17.151314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:17.153811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:17.166278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.167722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.167722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.168820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:17.169533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:17.170192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:17.896062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:17.907144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b6b64d9-fac8-4339-9fe0-88f272c70a4f tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.765069 Aug 25 13:50:17.907817 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3119/6310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:17 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:18.079850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:18.103893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.104855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.105283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:18.124428 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] Creating event network-changed:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:50:18.133574 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1af086c0-a57f-41ca-af74-eb91e99493da req-b8636a91-cfe1-4e00-800d-3126bec98304 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062962 Aug 25 13:50:18.134290 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3192/6311] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:18.944655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:18.945869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:18.957085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.958258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.959081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:18.959989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:18.960506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:18.960957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:19.177198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:19.186673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e0e9677-37cf-497a-9913-9addfd743ccd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.250550 Aug 25 13:50:19.187864 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3120/6312] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:18 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:20.224247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:20.225170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:20.233079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:20.233721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:20.234061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:20.234784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:20.235238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:20.235892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:20.444485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:20.459566 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a5bf62a1-1ffb-4c24-ae8a-2e00802dc4cb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.241078 Aug 25 13:50:20.460683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3193/6313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:20 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:21.499274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:21.500691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:21.528605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:21.529596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:21.530484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:21.531909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:21.532966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:21.533892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:21.738756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:21.750916 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6fcab929-3588-4bec-9f55-7d495aa3c3e8 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.258959 Aug 25 13:50:21.751872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3121/6314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:21 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:22.779818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:22.780834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:22.790892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:22.791672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:22.792337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:22.793287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:22.794028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:22.794524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:23.027732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:23.043329 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2fa8695-da4b-42e2-8b68-77c291115408 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.268972 Aug 25 13:50:23.044064 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3194/6315] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:22 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:23.506882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "name": "network-vif-plugged", "status": "completed", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:23.517467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:23.519444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:23.531024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:23.531542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:23.532366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:23.553229 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] Creating event network-vif-plugged:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:50:23.559142 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7747a500-f30b-4ea4-98aa-ef10ec55b33c req-74474ba1-d0cd-46b0-8432-e06cc1c2adc6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059564 Aug 25 13:50:23.559874 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3122/6316] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:50:24.083863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:24.085005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:24.087785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:24.100097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:24.101025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:24.101803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:24.102958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:24.103698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:24.104429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:24.344077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:24.360653 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-209f53c5-5676-47c0-bc44-c23de1cb9a4b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1393 microversion: 2.1 time: 0.283239 Aug 25 13:50:24.361819 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3195/6317] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:24 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1393 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:25.397273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:25.407058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:25.415823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.416427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.416931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:25.417734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.418288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.418773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:25.651448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:25.662917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73ed8f88-c3cd-436c-afe5-b9376c3976e7 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1566 microversion: 2.1 time: 0.276495 Aug 25 13:50:25.663521 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3123/6318] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:25 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:25.687297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:25.688706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:25.703369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.704149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.705059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:25.706387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:25.707238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:25.707964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:26.047753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:26.063036 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-996ed171-1c6f-4559-98d5-279ca5e6d944 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1566 microversion: 2.1 time: 0.380927 Aug 25 13:50:26.064773 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3196/6319] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:25 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1566 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:28.812597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:28.813708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:28.826474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:28.828606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:28.829529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:28.832333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:28.833060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:28.833519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:29.056054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:29.059596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:29.071064 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-87b26d8a-04ad-4388-8f7d-d63ebb711f59 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1566 microversion: 2.1 time: 0.264658 Aug 25 13:50:29.071861 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3124/6320] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:28 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:29.074501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:29.074501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:29.075388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:29.097349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] Creating event network-changed:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:50:29.104362 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b1b4bebf-de69-46d1-9593-8a2c69dfd6ec req-c76c1dbc-f9a3-44fd-8051-11f5308b846b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292631 Aug 25 13:50:29.106367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3197/6321] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:50:51.551839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:51.554111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:51.556663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:51.557429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=40 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:51.567000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:51.567568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:51.568071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:51.569087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:51.569701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:51.570245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:51.631566 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f7a8cdc-c6d5-4490-8a8b-be952aaa4175 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action" status: 200 len: 24556 microversion: 2.1 time: 0.084781 Aug 25 13:50:51.632295 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3125/6322] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:50:51 2022] POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action => generated 24556 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 13:50:58.022299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:58.022972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:50:58.028419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:50:58.032587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:58.044383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.044932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.045470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.046417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.047677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.048379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.149210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:50:58.149924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:50:58.150705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:50:58.151481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:50:58.152203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:50:58.258304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:58.265485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.265995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.266445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.267184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.267632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.268061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.303381 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4320c292-791b-41b2-9a45-473682ec8ec0 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action" status: 202 len: 1139 microversion: 2.1 time: 0.282958 Aug 25 13:50:58.304631 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3198/6323] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:50:58 2022] POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action => generated 1139 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 25 13:50:58.326058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:58.327154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:58.337488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.338424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.339610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.340955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:58.341537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:58.342375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:58.522869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:58.530400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92731c7b-ad0f-46ae-b9c8-babdd7e654d5 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.208942 Aug 25 13:50:58.531006 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3126/6324] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:58 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:50:59.554382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:50:59.556253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:50:59.565062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:59.565558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:59.566010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:59.566735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:50:59.567193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:50:59.567632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:50:59.741420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:50:59.749847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae172c46-493f-46e9-8859-b9c7bb1a4959 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.199725 Aug 25 13:50:59.751379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3199/6325] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:50:59 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:00.777701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:00.778375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:00.789011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:00.789810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:00.790611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:00.791791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:00.792506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:00.793239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:00.968205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:00.980099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4eed278-64bb-40ea-8408-04e8eda124ec tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.206232 Aug 25 13:51:00.980997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3127/6326] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:00 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:02.002724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:02.003358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:02.013609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:02.014110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:02.014559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:02.015276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:02.016379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:02.016823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:02.186288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:02.198845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a83ab90e-0e8d-40b3-af5b-cb571140f192 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.200436 Aug 25 13:51:02.199452 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3200/6327] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:01 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:03.222247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:03.223245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:03.230932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:03.231451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:03.231901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:03.232668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:03.233141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:03.233586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:03.396833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:03.407647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb02b74b-8345-4fc7-b918-12648f2505e9 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.189083 Aug 25 13:51:03.408281 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3128/6328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:03 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:04.429447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:04.430117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:04.437773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:04.438456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:04.438904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:04.439633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:04.440090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:04.440551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:04.619231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:04.630086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-983c2402-de72-4746-81cd-55ac094dda0e tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.204715 Aug 25 13:51:04.630808 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3201/6329] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:04 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:05.654362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:05.655451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:05.669251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:05.670215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:05.671072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:05.672499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:05.673397 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:05.674223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:05.842800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:05.852472 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e33efe84-d103-4f66-827a-df07435ac372 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.202955 Aug 25 13:51:05.853059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3129/6330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:05 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:06.874581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:06.875290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:06.882655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:06.883148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:06.883598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:06.884380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:06.884844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:06.885282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:07.037571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:07.045795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5dc6cef-ac56-4d08-87de-cca0c37e5cf4 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.175300 Aug 25 13:51:07.046378 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3202/6331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:06 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:08.069405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:08.070116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:08.078585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:08.079094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:08.079561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:08.080330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:08.080811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:08.081249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:08.243844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:08.254455 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d42f980-5b35-4ca6-b8f2-cdcd684b6545 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.190720 Aug 25 13:51:08.255186 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3130/6332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:08 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:09.277249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:09.277903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:09.286512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:09.287012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:09.287449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:09.288186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:09.288663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:09.289078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:09.462899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:09.473368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f71f2478-db5e-4c95-a599-dea84e2c831b tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1694 microversion: 2.1 time: 0.199803 Aug 25 13:51:09.474170 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3203/6333] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:09 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:51:10.500004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:10.500960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:10.508751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:10.509254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:10.509707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:10.510441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:10.510902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:10.511378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:10.682742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:10.694492 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eedba680-1483-48b8-9dd4-d2718c5e615d tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1700 microversion: 2.1 time: 0.199088 Aug 25 13:51:10.695124 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3131/6334] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:10 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1700 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:11.720661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:11.721672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:11.731631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:11.731973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:11.732524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:11.733555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:11.734157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:11.734721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:11.925428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:11.934173 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5b95b18-b818-4f87-bc58-71af9298b3bd tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1700 microversion: 2.1 time: 0.218607 Aug 25 13:51:11.934766 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3204/6335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:11 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1700 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:12.960826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:12.961491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:12.968919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:12.969430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:12.969885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:12.970616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:12.971101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:12.971546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:13.126597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:13.142535 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22fec7fb-e938-4de8-941f-771a68527772 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1685 microversion: 2.1 time: 0.185366 Aug 25 13:51:13.144278 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3132/6336] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:12 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:13.932155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "name": "network-vif-plugged", "status": "completed", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:13.950423 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:13.951096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:13.951544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:13.975340 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] Creating event network-vif-plugged:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:51:13.983258 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9e75df7c-6c03-4aba-9207-6c199d0af4f9 req-22baca92-f097-4f8f-b34a-439700c89baf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058148 Aug 25 13:51:13.984217 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3205/6337] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:37.399658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:37.402011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:37.405524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:37.406239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=46 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:37.413629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:37.414168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:37.414660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:37.415567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:37.416093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:37.416546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:37.480393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a639690c-964e-46d5-8a78-4a0e08569493 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action" status: 200 len: 24563 microversion: 2.1 time: 0.084902 Aug 25 13:51:37.481390 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3133/6338] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:51:37 2022] POST /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b/action => generated 24563 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 13:51:50.097801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:50.099537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:50.103874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:50.104898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=20 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:50.105298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:50.117496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:50.118450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:50.119204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:50.120309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:50.120945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:50.122092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:50.123848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:50.125390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:51:50.130557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:50.131607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:50.132699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:50.158002 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] Creating event network-changed:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:51:50.168290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1a5cf2cc-2002-4226-a3a6-505ec9a27b61 req-6996b881-5dee-42b9-bed2-a900622d95bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072244 Aug 25 13:51:50.170662 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3134/6339] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:51:50.172175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:51:50.353275 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a79a4239-c382-45fd-9220-1457ce507fbb tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 204 len: 0 microversion: 2.1 time: 0.262782 Aug 25 13:51:50.355512 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3206/6340] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:51:50 2022] DELETE /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:51:50.367757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:50.369422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:50.379929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:50.380590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:50.381148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:50.382012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:50.382956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:50.383801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:50.587791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:50.600196 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5dd496b7-9129-4a38-b68a-82602f631668 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1691 microversion: 2.1 time: 0.238681 Aug 25 13:51:50.612494 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3135/6341] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:50 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:51.636721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:51.638719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:51.660223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.661321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.662558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.664085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:51.664831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:51.665677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:51.994756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c593bba32e4bec8f8ed1b8909440e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36b07b5628841c3b15a85b9ae25666b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:51:52.008482 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a7ebd3f-c978-46a3-a489-ff41fd6e8727 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 200 len: 1691 microversion: 2.1 time: 0.381760 Aug 25 13:51:52.020153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3207/6342] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:51 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:51:52.470582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61dc217d-556a-43aa-b38a-2f20dba26e8b", "name": "network-vif-deleted", "tag": "9afea2b9-f21e-4960-9b77-9e35400084d3"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:51:52.487200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:52.487942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:52.488603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:52.507666 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] Creating event network-vif-deleted:9afea2b9-f21e-4960-9b77-9e35400084d3 for instance 61dc217d-556a-43aa-b38a-2f20dba26e8b on n-h2-850468-18 Aug 25 13:51:52.519485 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f96ee617-a730-42cd-9817-3142b26d4384 req-99be4492-2e08-4393-a026-59e0e75fc924 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056503 Aug 25 13:51:52.520580 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3136/6343] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:51:53.040766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:53.041747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] [instance: 61dc217d-556a-43aa-b38a-2f20dba26e8b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:51:53.054363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:53.054991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:53.055446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:53.056458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:51:53.056927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:51:53.057366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:51:53.081784 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] HTTP exception thrown: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Request method failure captured: Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b HTTP/1.1 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3xnodkzhBi1ie6ZcgaYa4g8pQLL6CMYNxAG0T4rPbE-Mmj-Xg4C-YdcsTRNGTkzJbKx4KNW4l4_s8FYzJNFR8PlG3OVY9egFgUEJbDQ-fqmbi2PSTdx_nvbAV0P18W1xhrJh5QGNEIg6kfZDnDv5tLHW23LeuVkVsXjenz9qpVE7kc Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a36b07b5628841c3b15a85b9ae25666b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a36b07b5628841c3b15a85b9ae25666b Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2086130668 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 10c593bba32e4bec8f8ed1b8909440e0 Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2086130668-project Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '61dc217d-556a-43aa-b38a-2f20dba26e8b'} Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:51:53.085011 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Returning 404 to user: Instance 61dc217d-556a-43aa-b38a-2f20dba26e8b could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf6fe018-7a30-445a-bcb2-1eee17fb5172 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b" status: 404 len: 111 microversion: 2.1 time: 0.053263 Aug 25 13:51:53.095968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3208/6344] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:51:53 2022] GET /compute/v2.1/servers/61dc217d-556a-43aa-b38a-2f20dba26e8b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:51:58.037774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9b8a6a7-5168-4ac5-9849-695eb89bf112 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] Calling method '.version_select at 0x7fc6c0f96ca0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:51:58.069078 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9b8a6a7-5168-4ac5-9849-695eb89bf112 tempest-TestNetworkAdvancedServerOps-2086130668 tempest-TestNetworkAdvancedServerOps-2086130668-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1918711048" status: 202 len: 0 microversion: 2.1 time: 0.037238 Aug 25 13:51:58.070285 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3137/6345] 10.222.0.60 () {58 vars in 1284 bytes} [Thu Aug 25 13:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1918711048 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:52:02.496594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a5a3bb3-3171-4055-921b-e15e7d919714 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Action: 'create', calling method: .version_select at 0x7fc6c1807160>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-880561667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnolvUjUQFwxBOiLfsl36aQmDe5Jkcay/BGl3L69xBsTTL48qtDvE0qpqEk0UT5HWoy/3zBQry7QBKnMOclBxiRnkrYefdhgGcmHlZygANYPV/ChJODrD4cZJerVPU6Wg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:02.521678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4a5a3bb3-3171-4055-921b-e15e7d919714 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:52:02.528636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4a5a3bb3-3171-4055-921b-e15e7d919714 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for user d4ab47ff4ae749349d4f42516e167c1a and project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:52:02.567318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a5a3bb3-3171-4055-921b-e15e7d919714 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.336628 Aug 25 13:52:02.568906 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3209/6346] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:52:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:52:10.590857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-102200327-access_point-1836476566", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "ff04c746-9216-44e5-8bc4-72d84ac60de2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-880561667", "security_groups": [{"name": "tempest-secgroup_access--745612477"}, {"name": "tempest-secgroup_general--28701903"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:10.617442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=10 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:10.619500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:10.877261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] validate_networks() for [('ff04c746-9216-44e5-8bc4-72d84ac60de2', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:52:11.431935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:52:11.432409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:52:11.433031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:52:11.434308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:52:11.435068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:52:11.447514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:11.448158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:11.449501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:11.450439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:11.450985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:11.451604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:11.475735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:52:11.485818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for user d4ab47ff4ae749349d4f42516e167c1a and project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:52:11.509380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:52:11.513064 n-d-850468-18 devstack@n-api.service[122700]: WARNING nova.utils [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-102200327-access_point-1836476566 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-102200327-acc Aug 25 13:52:11.514369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:52:11.577140 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-273a2a3b-f8fa-4ff2-8f85-9b4deff88620 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 0.993256 Aug 25 13:52:11.577858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3138/6347] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:52:10 2022] POST /compute/v2.1/servers => generated 455 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:52:11.595167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5824f834-7303-4171-90d1-dd574977502e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:11.596459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5824f834-7303-4171-90d1-dd574977502e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:11.601903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:11.726938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5824f834-7303-4171-90d1-dd574977502e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:11.737710 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5824f834-7303-4171-90d1-dd574977502e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1293 microversion: 2.1 time: 0.151590 Aug 25 13:52:11.752842 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3210/6348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:11 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:12.766614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:12.768341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:12.777247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.778048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.778582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.779560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:12.780541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:12.781583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:12.885154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:12.898305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5f1d976-b3ee-45aa-bd9f-4646ef14c51b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1345 microversion: 2.1 time: 0.139354 Aug 25 13:52:12.899354 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3139/6349] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:12 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:13.929083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:13.931618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:13.947437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:13.949662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:13.951335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:13.953014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:13.954233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:13.955391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:14.107954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:14.130063 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cbb9ea04-d903-4c9e-8f06-7a539c0d2e99 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1351 microversion: 2.1 time: 0.206399 Aug 25 13:52:14.132091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3211/6350] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:13 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:15.159222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:15.160462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:15.171935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:15.172682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:15.173149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:15.174072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:15.174560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:15.175151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:15.369094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d8b598-71f5-41c6-93e8-e27bc74b0f03", "tag": "eb4d9af2-1474-4d64-913b-dddbaf7b5dc5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:15.389600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:15.390427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:15.391117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:15.403940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:15.419394 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4d34395-2aab-4620-9330-1909979a2567 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.267533 Aug 25 13:52:15.421137 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3140/6351] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:15 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:15.422510 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] Creating event network-changed:eb4d9af2-1474-4d64-913b-dddbaf7b5dc5 for instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 on n-h2-850468-18 Aug 25 13:52:15.434778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d00a59c1-c5f4-46d2-b52a-a639586d803e req-e0f6d9d3-07dc-4594-be0a-def765efc82b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066588 Aug 25 13:52:15.438106 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3212/6352] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:16.456716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:16.457799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:16.471569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:16.472383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:16.473024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:16.474012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:16.474611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:16.475226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:16.697214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:16.707068 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00df0eab-4b67-4306-b48d-e4ae26f7df14 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.257957 Aug 25 13:52:16.707713 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3141/6353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:16 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:17.735440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:17.736338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:17.745453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:17.746306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:17.746979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:17.748049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:17.748794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:17.749491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:17.989444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:18.000590 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d353ba6b-8cd7-4e2f-b8c5-3fec18381d32 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.271824 Aug 25 13:52:18.001511 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3213/6354] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:17 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:19.028011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:19.029218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:19.049220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:19.050126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:19.050961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:19.052651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:19.053408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:19.053829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:19.311532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:19.325871 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f2a70f84-32fd-4ace-b444-fcea97811bce tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.305179 Aug 25 13:52:19.326806 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3142/6355] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:19 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:20.366901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:20.369877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:20.381721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:20.383328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:20.384106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:20.388266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:20.389080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:20.389862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:20.467415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d8b598-71f5-41c6-93e8-e27bc74b0f03", "name": "network-vif-plugged", "status": "completed", "tag": "eb4d9af2-1474-4d64-913b-dddbaf7b5dc5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:20.487697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:20.499959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:20.500862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:20.501671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:20.521706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] Creating event network-vif-plugged:eb4d9af2-1474-4d64-913b-dddbaf7b5dc5 for instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 on n-h2-850468-18 Aug 25 13:52:20.528406 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-856a92c3-af01-45af-96a0-3d6f773f2b17 req-20fbb999-b84d-4aec-baa8-e00407c74eb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181282 Aug 25 13:52:20.529044 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3214/6356] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:52:20.680590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:20.694339 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa148647-289d-4e21-811a-a9f75515aaa5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.335855 Aug 25 13:52:20.695804 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3143/6357] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:20 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:52:21.723229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:21.724190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:21.732069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.732970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.733428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.734188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:21.734654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:21.735090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:21.738591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:21.976976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:21.987267 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5789d64b-317e-47ba-b24f-709902f5f465 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1468 microversion: 2.1 time: 0.269714 Aug 25 13:52:21.988710 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3215/6358] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:21 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:52:23.021332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:23.022372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:23.026929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:23.027796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:52:23.037477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.038093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.038552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.039379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.040008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.040479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.294415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:23.309781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35a5501a-2865-4867-b7bc-ff47a171f250 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1641 microversion: 2.1 time: 0.294526 Aug 25 13:52:23.310811 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3144/6359] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:23 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1641 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:23.336077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:23.338893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:23.351547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.352897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.353699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.355697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.356551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.357285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.588812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:52:23.606033 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4a564d0-3eb0-4264-9b34-8a43fbb341b2 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1641 microversion: 2.1 time: 0.275261 Aug 25 13:52:23.607157 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3216/6360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:23 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1641 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:23.645387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:52:23.646803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:52:23.657976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.658934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.659791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.661142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:23.661979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:23.662793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:23.999545 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14ba1b11-829c-42e5-9d49-5b9e383c706e tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1794 microversion: 2.1 time: 0.360952 Aug 25 13:52:24.000470 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3145/6361] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:52:23 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1794 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:52:26.581911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d8b598-71f5-41c6-93e8-e27bc74b0f03", "tag": "eb4d9af2-1474-4d64-913b-dddbaf7b5dc5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:52:26.602568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:52:26.604218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:52:26.604843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:52:26.933591 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] Creating event network-changed:eb4d9af2-1474-4d64-913b-dddbaf7b5dc5 for instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 on n-h2-850468-18 Aug 25 13:52:26.939964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9c55b0a3-7380-4ba6-af10-cb846f9ee52c req-66f6d13d-b35b-4244-90ab-579fa7bffe3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361930 Aug 25 13:52:26.940988 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3217/6362] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:06.673802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-385423935", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "4d90e89c-b973-43d9-a442-4b8fdaa2cac1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-880561667", "security_groups": []}, "os:scheduler_hints": {"different_host": ["60d8b598-71f5-41c6-93e8-e27bc74b0f03"]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:06.687250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:06.688198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=44 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:06.755699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] validate_networks() for [('4d90e89c-b973-43d9-a442-4b8fdaa2cac1', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:53:07.337487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:53:07.338942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:53:07.339827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:53:07.340458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:53:07.341023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:53:07.360006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:07.360561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:07.361427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:07.362493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:07.363291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:07.363796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:07.398889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:53:07.407968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Getting quotas for user d4ab47ff4ae749349d4f42516e167c1a and project 6b0fe1bfdeb14a50a874ba7d14d77ab8. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:53:07.433017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:53:07.436289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:53:07.534935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51f5aaf9-4c98-4c32-a8dc-44da610af59f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.868982 Aug 25 13:53:07.536508 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3146/6363] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:53:06 2022] POST /compute/v2.1/servers => generated 361 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:53:07.560044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=7 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:07.561981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=30 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:07.573544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da3d47b4-e79a-490c-8c09-c056dbd8e900 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:07.575617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da3d47b4-e79a-490c-8c09-c056dbd8e900 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:07.713267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-da3d47b4-e79a-490c-8c09-c056dbd8e900 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:07.729741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da3d47b4-e79a-490c-8c09-c056dbd8e900 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1240 microversion: 2.1 time: 0.173083 Aug 25 13:53:07.745400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3218/6364] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:07 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1240 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:08.766268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:08.767015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:08.776007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.776694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.777163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.777913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:08.778436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:08.778888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:08.870957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:08.880964 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bba1b05-08d3-4add-825e-fa9827e358f6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1292 microversion: 2.1 time: 0.118226 Aug 25 13:53:08.892772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3147/6365] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:08 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:09.903834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:09.904640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:09.919937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:09.920730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:09.921331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:09.922221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:09.922836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:09.923432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:10.027549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:10.047059 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ef177238-ae04-4edd-a572-b24660b20c4b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.147452 Aug 25 13:53:10.049008 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3219/6366] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:09 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:11.072864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:11.073674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:11.082158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:11.082675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:11.083134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:11.084007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:11.084720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:11.085080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:11.187730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:11.199218 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ec1d93f4-9594-47a7-ae2c-9487a0cf22fc tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.131989 Aug 25 13:53:11.205646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3148/6367] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:11 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:11.294974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f91831f-f869-4fc7-8dce-2fef5d494e91", "tag": "40698101-26ef-4d5e-b55d-1bcba4c52a6c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:11.311141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:11.311731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:11.312263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:11.327473 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] Creating event network-changed:40698101-26ef-4d5e-b55d-1bcba4c52a6c for instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 on n-h1-850468-18 Aug 25 13:53:11.333393 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-364e826b-1165-413d-9ae4-ee4fca55bfa8 req-c9956f13-8f25-46f0-84b2-291cc987a7e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047017 Aug 25 13:53:11.334060 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3220/6368] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:12.221132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:12.221873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:12.229819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:12.230333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:12.230833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:12.231515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:12.231984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:12.232467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:12.333641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:12.344986 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b21c552f-6161-4db9-b1ce-21bfca4d762f tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.127524 Aug 25 13:53:12.345878 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3149/6369] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:12 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:13.371182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:13.371902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:13.378615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:13.379111 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:13.379554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:13.380304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:13.380764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:13.381189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:13.472733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:13.481679 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ba0b24a3-5e91-4946-b47c-3fc92b56b0c9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.116585 Aug 25 13:53:13.482263 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3221/6370] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:13 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:14.504585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:14.505225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:14.517746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:14.518677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:14.519359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:14.520405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:14.520961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:14.524250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:14.644437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:14.656176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5661066-eb95-48cb-8810-64e096e97cf6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.155545 Aug 25 13:53:14.657372 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3150/6371] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:14 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:15.687295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:15.688274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:15.698606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.699438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.700267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:15.701253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:15.702028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:15.702734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:16.184359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:16.199347 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a83bfadd-3fe2-4afe-a14c-bfe9552faa00 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.518601 Aug 25 13:53:16.200363 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3222/6372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:15 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:17.231097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:17.231856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:17.240569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:17.241803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:17.242708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:17.244080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:17.244993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:17.245760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:17.347376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:17.356033 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-709e52dc-96ac-48d6-8b1b-65fce616693a tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.129445 Aug 25 13:53:17.356772 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3151/6373] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:17 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:18.378827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:18.379583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:18.383857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:18.391419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:18.391930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:18.392444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:18.393217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:18.393695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:18.394145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:18.516837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:18.532015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0776fddb-8771-478e-8464-c10477b666c6 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.156987 Aug 25 13:53:18.533057 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3223/6374] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:18 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:18.795955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f91831f-f869-4fc7-8dce-2fef5d494e91", "name": "network-vif-plugged", "status": "completed", "tag": "40698101-26ef-4d5e-b55d-1bcba4c52a6c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:18.803420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:18.806116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:18.814243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:18.814772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:18.815221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:18.833572 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] Creating event network-vif-plugged:40698101-26ef-4d5e-b55d-1bcba4c52a6c for instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 on n-h1-850468-18 Aug 25 13:53:18.840508 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4b8c14f9-d3a9-48e6-ba96-572b577785ac req-76a79f56-85ca-4f30-8551-6b1039f014ab service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050776 Aug 25 13:53:18.841586 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3152/6375] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:19.555227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:19.555954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:19.563959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.564560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.565065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.565847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:19.566411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:19.566982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:19.713917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:19.728054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79db3243-0ef7-4c89-b977-797dd817ee71 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1298 microversion: 2.1 time: 0.177591 Aug 25 13:53:19.729206 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3224/6376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:19 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:20.754157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:20.755062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:20.765053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.765557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.766008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.766740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.767210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.767651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.863091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:20.872185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-329367b0-b83b-4f31-967f-9e4597a483df tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1469 microversion: 2.1 time: 0.124001 Aug 25 13:53:20.872816 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3153/6377] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:20 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1469 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:20.899312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:20.899947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:20.907254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.907746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.908251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:20.908969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:20.909428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:20.909859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.003463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:21.014502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cef7d1f0-e7b9-4532-9fca-5bacb1d7414c tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1469 microversion: 2.1 time: 0.119940 Aug 25 13:53:21.015008 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3225/6378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:20 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1469 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:21.038301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.039069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.045347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.045972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.046477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.047020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.047501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.047950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.148679 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51ca2dae-ad90-419e-b158-c335345552d1 tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1622 microversion: 2.1 time: 0.114233 Aug 25 13:53:21.149575 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3154/6379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:21 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1622 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:21.177261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.177261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.177938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.178525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.179106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.179875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.180391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.180818 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.348996 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ab827ea-e95d-42f8-95e9-a8ee712114cc tempest-TestSecurityGroupsBasicOps-311015459 tempest-TestSecurityGroupsBasicOps-311015459-project-admin] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1913 microversion: 2.1 time: 0.182089 Aug 25 13:53:21.349581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3226/6380] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:21 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1913 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:21.427472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.428278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.442245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.443176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.444819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.445980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.446501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.447213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.483442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:53:21.591214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6fb453e-6fab-4e2f-ba93-bed499c6fc30 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 204 len: 0 microversion: 2.1 time: 0.167226 Aug 25 13:53:21.592029 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3155/6381] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:53:21 2022] DELETE /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 13:53:21.600774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:21.601761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:21.607828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:21.736596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:21.751247 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f737ca3c-9933-4b3e-b1eb-c9c8d5e32798 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1475 microversion: 2.1 time: 0.154862 Aug 25 13:53:21.752260 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3227/6382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:21 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:22.781935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:22.782810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:22.800061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.801024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.801727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.802551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:22.803046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:22.804071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:22.939319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:22.949443 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7fd5171b-9289-4d1e-8bd2-6fd4026db186 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1475 microversion: 2.1 time: 0.172619 Aug 25 13:53:22.950053 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3156/6383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:22 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:23.961730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f91831f-f869-4fc7-8dce-2fef5d494e91", "name": "network-vif-deleted", "tag": "40698101-26ef-4d5e-b55d-1bcba4c52a6c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:23.973782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:23.974625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:23.984458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.985080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.985232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.985434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:23.985941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.986783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:23.987773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:23.988479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:23.989182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:24.011877 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] Creating event network-vif-deleted:40698101-26ef-4d5e-b55d-1bcba4c52a6c for instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 on n-h1-850468-18 Aug 25 13:53:24.026150 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d79cfa72-2dd5-4fcf-9a84-f55c59d89790 req-b9ddeab3-e6d8-457e-b312-cddbc1f3c408 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071861 Aug 25 13:53:24.027248 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3228/6384] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:53:24.102792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:24.113223 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-384e04eb-b7b8-43e8-8435-d6e254587fc5 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 200 len: 1475 microversion: 2.1 time: 0.144327 Aug 25 13:53:24.113921 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3157/6385] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:23 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 1475 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:25.143548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:25.144499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 1f91831f-f869-4fc7-8dce-2fef5d494e91] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:25.154541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:25.155287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:25.155965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:25.157139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:25.157847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:25.158520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:25.187688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] HTTP exception thrown: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Request method failure captured: Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 HTTP/1.1 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB36AkUSxKvLMniJrBovCvOkp96nOt-cluZ13RfmA5Qb1wbglpXQK2x0gSjBNedi0gAh4v6eKXh5KjIUshXHO5xGkFmyuc6n5mdOZJw3LM5hULL80x7bLfOREa8xxnVP0XV-iV77cmuXzsX1lj2DQvpkKIldEBkyCeUQqfttvwy6S8yM Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6b0fe1bfdeb14a50a874ba7d14d77ab8 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6b0fe1bfdeb14a50a874ba7d14d77ab8 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestSecurityGroupsBasicOps-102200327-project Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d4ab47ff4ae749349d4f42516e167c1a Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestSecurityGroupsBasicOps-102200327-project Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '1f91831f-f869-4fc7-8dce-2fef5d494e91'} Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:25.191253 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Returning 404 to user: Instance 1f91831f-f869-4fc7-8dce-2fef5d494e91 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-169f5bed-81ba-4e3b-bd02-f2340b5fc643 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91" status: 404 len: 111 microversion: 2.1 time: 0.057114 Aug 25 13:53:25.200281 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3229/6386] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:25 2022] GET /compute/v2.1/servers/1f91831f-f869-4fc7-8dce-2fef5d494e91 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 13:53:32.437961 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:53:32.438452 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 13:53:32.441813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:32.444582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:32.460793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.461716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.462540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.464245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.465369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.466206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.523736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:53:32.539566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d8b598-71f5-41c6-93e8-e27bc74b0f03", "tag": "eb4d9af2-1474-4d64-913b-dddbaf7b5dc5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:32.558464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.559678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.560794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.587936 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] Creating event network-changed:eb4d9af2-1474-4d64-913b-dddbaf7b5dc5 for instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 on n-h2-850468-18 Aug 25 13:53:32.596493 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-21e87dd4-b579-4816-9486-bd09f60a1cb5 req-90145c80-e660-481c-8113-99fcee8d9d4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165051 Aug 25 13:53:32.597694 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3230/6387] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:53:32.686128 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a6de2f7a-c0e9-4efc-a457-4cb8eb7b1bc9 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "DELETE /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 204 len: 0 microversion: 2.1 time: 0.256421 Aug 25 13:53:32.688256 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3158/6388] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:53:32 2022] DELETE /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:53:32.701198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:32.702654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:32.712150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.712662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.713183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.714449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:32.715204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:32.715999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:32.946066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:32.961953 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48d1cc7a-1e77-4d0f-b221-464865fbe0bb tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1766 microversion: 2.1 time: 0.269189 Aug 25 13:53:32.962734 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3231/6389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:32 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1766 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:34.010253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:34.013669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:34.026856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:34.027655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:34.028553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:34.029900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:34.030792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:34.031596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:34.393611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:34.412867 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2315949e-be7b-47ee-8f86-afd0de14cb3e tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1766 microversion: 2.1 time: 0.409402 Aug 25 13:53:34.414523 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3159/6390] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:34 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1766 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:53:34.929830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d8b598-71f5-41c6-93e8-e27bc74b0f03", "name": "network-vif-deleted", "tag": "eb4d9af2-1474-4d64-913b-dddbaf7b5dc5"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:53:34.952557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:34.953449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:34.953936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:34.972405 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] Creating event network-vif-deleted:eb4d9af2-1474-4d64-913b-dddbaf7b5dc5 for instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 on n-h2-850468-18 Aug 25 13:53:34.980191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f6d73068-cec8-4b63-8ed4-a0a340046d7c req-ec72a567-0478-4f44-9400-d2a845c7796f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056019 Aug 25 13:53:34.980831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3232/6391] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:53:35.451863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:35.459558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:35.481912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:35.482853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:35.483691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:35.485185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:35.486098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:35.486929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:35.539626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:35.556963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:35.557492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:35.558192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:35.558706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lazy-loading 'fault' on Instance uuid 60d8b598-71f5-41c6-93e8-e27bc74b0f03 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:53:35.617775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ab47ff4ae749349d4f42516e167c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0fe1bfdeb14a50a874ba7d14d77ab8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:53:35.629769 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51ccb18d-c5cc-48ab-b996-d0cb8f663136 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 200 len: 1383 microversion: 2.1 time: 0.183767 Aug 25 13:53:35.630928 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3160/6392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:35 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 1383 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:53:36.656463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:36.657198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] [instance: 60d8b598-71f5-41c6-93e8-e27bc74b0f03] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:53:36.665325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:36.665904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:36.666563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:36.667391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:53:36.668073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:53:36.668685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:53:36.688952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] HTTP exception thrown: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Request method failure captured: Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 HTTP/1.1 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB36AkUSxKvLMniJrBovCvOkp96nOt-cluZ13RfmA5Qb1wbglpXQK2x0gSjBNedi0gAh4v6eKXh5KjIUshXHO5xGkFmyuc6n5mdOZJw3LM5hULL80x7bLfOREa8xxnVP0XV-iV77cmuXzsX1lj2DQvpkKIldEBkyCeUQqfttvwy6S8yM Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 6b0fe1bfdeb14a50a874ba7d14d77ab8 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b0fe1bfdeb14a50a874ba7d14d77ab8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 6b0fe1bfdeb14a50a874ba7d14d77ab8 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-102200327 Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestSecurityGroupsBasicOps-102200327-project Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d4ab47ff4ae749349d4f42516e167c1a Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestSecurityGroupsBasicOps-102200327-project Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '60d8b598-71f5-41c6-93e8-e27bc74b0f03'} Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:53:36.692139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Returning 404 to user: Instance 60d8b598-71f5-41c6-93e8-e27bc74b0f03 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-094944e9-1980-4614-91b2-821fff00990b tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03" status: 404 len: 111 microversion: 2.1 time: 0.044158 Aug 25 13:53:36.699665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3233/6393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:53:36 2022] GET /compute/v2.1/servers/60d8b598-71f5-41c6-93e8-e27bc74b0f03 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:53:42.150299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a238fc4e-2669-4e66-960c-b997638b70b0 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] Calling method '.version_select at 0x7fc6c101e310>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:53:42.163729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:53:42.182501 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a238fc4e-2669-4e66-960c-b997638b70b0 tempest-TestSecurityGroupsBasicOps-102200327 tempest-TestSecurityGroupsBasicOps-102200327-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-880561667" status: 202 len: 0 microversion: 2.1 time: 0.042318 Aug 25 13:53:42.183564 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3161/6394] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 13:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-880561667 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:56:24.819069 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 13:56:24.820301 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 13:56:24.821237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:24.822468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=66 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:24.824804 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 13:56:24.825025 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Aug 25 13:56:24.826751 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:56:24.826909 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Aug 25 13:56:24.833719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a8e0b92-f10a-4e9a-90f5-4e89b10a71eb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Action: 'create', calling method: .version_select at 0x7fc6c17050d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1300764208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM13cJv1EbpkBGxfZqQK6NvQa7ABN2uGofOLeAfkosj+OO4StOJMDBEA3p+5AVR0FLMRUxV5BmfhkfA1CtjoU3E6LOYtCPi5my3QLxt/OxeG0uKqeAt3/6SOKtu7NuKWOg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:24.859024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7a8e0b92-f10a-4e9a-90f5-4e89b10a71eb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Getting quotas for project 8a610575c3b04c8a8868148bad412c84. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:56:24.865478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-7a8e0b92-f10a-4e9a-90f5-4e89b10a71eb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Getting quotas for user abbfe075cc8142d89b91a4740a7d1594 and project 8a610575c3b04c8a8868148bad412c84. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:56:24.896887 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a8e0b92-f10a-4e9a-90f5-4e89b10a71eb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.081746 Aug 25 13:56:24.897432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3234/6395] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 13:56:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:56:26.185695 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:56:26.186545 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 13:56:26.187016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:26.189599 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 13:56:26.189599 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:56:26.190826 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:56:26.190826 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:56:26.191828 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 13:56:26.192148 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 13:56:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:56:26.198660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1696145944", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8789795d-44db-429a-a43e-4bef2f4c83ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1300764208", "security_groups": [{"name": "tempest-secgroup-smoke-705886824"}], "networks": [{"uuid": "92a3d415-1a07-43eb-a0df-dded661cfe12"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:26.529405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] validate_networks() for [('92a3d415-1a07-43eb-a0df-dded661cfe12', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:56:27.075932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:56:27.076411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:56:27.076911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:56:27.077339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:56:27.077777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:56:27.088182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:27.088699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:27.089152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:27.089915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:27.091105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:27.091594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:27.111434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Getting quotas for project 8a610575c3b04c8a8868148bad412c84. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:56:27.118936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Getting quotas for user abbfe075cc8142d89b91a4740a7d1594 and project 8a610575c3b04c8a8868148bad412c84. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:56:27.204086 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50346. Aug 25 13:56:27.206963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:56:27.209905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8789795d-44db-429a-a43e-4bef2f4c83ca',volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:56:27.216521 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50348. Aug 25 13:56:27.706246 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28bbb954-c861-4ca4-a3e2-9d51b1d5a9e6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.522541 Aug 25 13:56:27.707258 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3162/6396] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:56:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:56:27.721049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b298302b-b584-4eee-abf4-13fd40a0f563 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:27.721708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b298302b-b584-4eee-abf4-13fd40a0f563 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:27.746119 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50358. Aug 25 13:56:27.751151 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50356. Aug 25 13:56:27.893824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b298302b-b584-4eee-abf4-13fd40a0f563 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:27.904251 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b298302b-b584-4eee-abf4-13fd40a0f563 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1099 microversion: 2.1 time: 0.189041 Aug 25 13:56:27.904942 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3235/6397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:27 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1099 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:28.927058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0158a230-71d1-4cbf-876c-dd38c6c27697 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:28.927702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0158a230-71d1-4cbf-876c-dd38c6c27697 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:28.986640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0158a230-71d1-4cbf-876c-dd38c6c27697 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:28.993863 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0158a230-71d1-4cbf-876c-dd38c6c27697 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1099 microversion: 2.1 time: 0.070669 Aug 25 13:56:28.994449 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3163/6398] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:28 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1099 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:30.017098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-98aab288-26a3-4bd7-97b4-26a960df8307 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:30.017741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-98aab288-26a3-4bd7-97b4-26a960df8307 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:30.077634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-98aab288-26a3-4bd7-97b4-26a960df8307 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:30.084905 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-98aab288-26a3-4bd7-97b4-26a960df8307 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1099 microversion: 2.1 time: 0.073078 Aug 25 13:56:30.085501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3236/6399] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:30 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1099 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:31.109977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:31.110853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:31.118284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:31.118863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:31.119487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:31.120249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:31.120879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:31.121854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:31.220598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:31.230445 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d73ab49f-a313-46c6-996b-cb908403d43b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1215 microversion: 2.1 time: 0.126371 Aug 25 13:56:31.232030 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3164/6400] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:31 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:32.256014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:32.257509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:32.276409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:32.276409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:32.276941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:32.278832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:32.279541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:32.280708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:32.579944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:32.593085 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-015faa32-becc-4281-b615-39da5d2f57c8 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1282 microversion: 2.1 time: 0.342901 Aug 25 13:56:32.593825 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3237/6401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:32 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:56:33.074484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:33.095843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:33.097045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:33.098051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:33.120906 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] Creating event network-changed:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:56:33.131414 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-bcd31db1-115b-4e5b-9ffc-931e70d0881f req-88d13756-f5ea-48c7-a571-37b13e316e9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060305 Aug 25 13:56:33.132429 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3165/6402] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:56:33.625714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:33.627651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:33.635842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:33.636740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:33.637212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:33.637945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:33.638417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:33.639046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:33.894141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:33.908454 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6418a932-85e9-407c-94ee-ba5fa393c39e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1282 microversion: 2.1 time: 0.289681 Aug 25 13:56:33.909298 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3238/6403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:33 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:34.932406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:34.933124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:34.940745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:34.941301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:34.941764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:34.942475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:34.942942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:34.943373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:35.094751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:35.106306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-846ff40a-eeaa-4e5d-948c-05cccc48acf6 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1282 microversion: 2.1 time: 0.177988 Aug 25 13:56:35.107274 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3166/6404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:34 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:36.128343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:36.129008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:36.136602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:36.137451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:36.137574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:36.138240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:36.138700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:36.139136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:36.295025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:36.303873 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f81c3e2e-611e-4c53-ac79-cd1e7e395d93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1282 microversion: 2.1 time: 0.179430 Aug 25 13:56:36.304801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3239/6405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:36 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:37.329448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:37.330089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:37.333013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:37.340875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:37.342188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:37.342975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:37.343913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:37.344410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:37.344937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:37.512214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:37.521044 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-864fac12-85e4-453a-a57c-7f03b66202c1 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.195517 Aug 25 13:56:37.521905 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3167/6406] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:37 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:56:38.544046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:38.544786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:38.552483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:38.552989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:38.553422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:38.554151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:38.554617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:38.555044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:38.705551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:38.713902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7530305e-c8fd-4b6a-a647-c7f5e3fa227c tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.174764 Aug 25 13:56:38.714550 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3240/6407] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:38 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:39.735931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:39.736576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:39.739295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:39.744908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:39.745437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:39.747135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:39.747869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:39.748371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:39.748828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:39.892557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:39.901038 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c10589ce-c77d-47c3-baf6-998cfcbd1fee tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.168938 Aug 25 13:56:39.901640 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3168/6408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:39 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:40.923084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:40.923702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:40.926476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:40.931734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:40.932243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:40.932694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:40.933613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:40.933613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:40.934517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:41.087956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:41.096696 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc649e1b-5645-4412-9406-3041c4bd0c00 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.177688 Aug 25 13:56:41.097279 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3241/6409] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:40 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:42.118127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:42.118986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:42.127231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:42.127771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:42.128316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:42.129045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:42.129547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:42.129988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:42.286943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:42.296039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7fa3489-9782-4e1e-84f0-cf8992df118b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.181819 Aug 25 13:56:42.297225 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3169/6410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:42 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:43.322632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:43.323298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:43.331635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:43.332179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:43.332725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:43.333467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:43.334055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:43.334487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:43.479121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:43.487285 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27245f7b-a790-4561-beec-c20bfc6ffd9d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.169381 Aug 25 13:56:43.487888 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3242/6411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:43 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:44.509816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:44.510451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:44.518349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:44.518855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:44.519315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:44.520052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:44.520532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:44.520983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:44.675398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:44.684978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-46920fe9-f129-4b99-8fd6-694e90ed4b3d tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.178858 Aug 25 13:56:44.685591 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3170/6412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:44 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:45.706370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:45.707324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:45.714318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:45.715112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:45.715333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:45.716051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:45.716539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:45.716971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:45.878361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:45.888617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a29a2ee5-bc4f-4216-a3f1-4be4cead8490 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.186146 Aug 25 13:56:45.889663 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3243/6413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:45 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:46.910735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:46.911296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:46.919402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:46.919904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:46.920386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:46.921488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:46.921972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:46.922411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:47.070032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:47.078690 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f511a1e-9868-4787-906f-0a029ea74b6a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.172267 Aug 25 13:56:47.079279 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3171/6414] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:46 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:47.440823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "name": "network-vif-plugged", "status": "completed", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:47.457022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:47.457873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:47.458645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:47.481518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] Creating event network-vif-plugged:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:56:47.492177 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-2aea9fbc-d20b-40ea-ac08-3e2c77b291b4 req-51bb71e4-de6a-44be-b782-6610ca9331b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056871 Aug 25 13:56:47.493277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3244/6415] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:56:48.099420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:48.100079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:48.107896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:48.108438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:48.108907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:48.109638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:48.110102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:48.110543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:48.264668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:48.275787 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ef4c2f47-1520-42b2-b12a-3bea92183501 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1270 microversion: 2.1 time: 0.180151 Aug 25 13:56:48.277676 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3172/6416] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:48 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:49.304414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:49.305244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:49.311652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:49.312159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:49.312603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:49.313311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:49.314040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:49.314468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:49.459857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:49.470058 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-868889a6-e3f4-4001-8c99-2b6119a6d0b4 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1457 microversion: 2.1 time: 0.170707 Aug 25 13:56:49.470657 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3245/6417] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:49 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1457 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:49.490888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:56:49.491539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:56:49.499271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:49.499941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:49.500323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:49.501069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:49.501544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:49.501993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:49.646384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:56:49.654754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08fb189a-0d3f-4ee5-943a-8ccd97efcd42 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1457 microversion: 2.1 time: 0.167759 Aug 25 13:56:49.655262 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3173/6418] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:56:49 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:56:51.905276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:51.917259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:51.917914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:51.918362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:51.931881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] Creating event network-changed:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:56:51.939418 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-aa2a534c-c4a3-493e-a246-a5c36e12c1ba req-b26f1235-ad33-4a61-b8a7-855d568082d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115410 Aug 25 13:56:51.943114 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3246/6419] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:56:53.570775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:53.581665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:53.582074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:53.582534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:53.599532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] Creating event network-changed:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:56:53.600441 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-fc9fd104-a22d-4309-b99b-0e81bb0e0146 req-7c0ae80b-a85a-4459-833d-6cee34d37492 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Aug 25 13:56:53.601062 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3174/6420] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:56:55.617888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:56:55.625348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:55.633401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:56:55.634106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:56:55.634656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:56:55.638428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=53 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:56:55.649357 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] Creating event network-changed:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:56:55.655946 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-79f5cce9-922e-4bf0-89e2-846497dda541 req-6f2cf66e-9ba2-4ec4-a606-38a2f0982292 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042579 Aug 25 13:56:55.656658 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3247/6421] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:28.130058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:28.131033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:28.131179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:28.132913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=60 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:57:28.135622 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:28.142685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:28.144005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:28.152815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.154212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.155489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.158659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.159497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.160600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.162174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.163061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.163853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.177165 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] Creating event network-changed:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:57:28.189777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0fec1d5e-8eb3-4b9c-9e9c-09aa31e18af8 req-a5e70458-7195-4514-ad1e-28b0ebfde8b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061965 Aug 25 13:57:28.191178 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3248/6422] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:57:28.215691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:57:28.361716 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f1b8f73a-b783-430c-834b-5c125bbe1f99 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 204 len: 0 microversion: 2.1 time: 0.233814 Aug 25 13:57:28.362931 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3175/6423] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:57:28 2022] DELETE /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:57:28.375586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:28.377123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:28.386443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.386892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.387470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.389600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:28.390096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:28.390728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:28.617726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:28.632021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-784a74a1-3d5e-4355-bae4-05c12c6c3949 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1581 microversion: 2.1 time: 0.261912 Aug 25 13:57:28.633126 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3249/6424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:28 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1581 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:29.664325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:29.665849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:29.678205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:29.679083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:29.679645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:29.680739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:29.681585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:29.682313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:29.931757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:29.942178 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8c3b04c8-afe6-4bca-9615-8f5953c6400b tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1581 microversion: 2.1 time: 0.283810 Aug 25 13:57:29.943089 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3176/6425] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:29 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1581 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:30.534937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc6f128-ba5c-4d45-b9f0-46d9698814f8", "name": "network-vif-deleted", "tag": "12b9e3a2-ebdb-4784-aa7b-d25cc767536c"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:57:30.548265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.548814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.549186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.571087 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] Creating event network-vif-deleted:12b9e3a2-ebdb-4784-aa7b-d25cc767536c for instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 on n-h2-850468-18 Aug 25 13:57:30.582775 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6cfefcd2-298c-4696-b1ac-6c4cfba1a70b req-ffdf4dba-3418-49f7-8525-7ce9c3b9a004 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052402 Aug 25 13:57:30.584071 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3250/6426] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:57:30.967079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:30.968541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:30.976282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.976967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.977621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:30.978375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:30.978905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:30.979374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:31.047960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:31.056464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e29a0e8-506f-4123-822a-b7953388cf3a tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1230 microversion: 2.1 time: 0.094594 Aug 25 13:57:31.057071 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3177/6427] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:30 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:32.080078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:32.080929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:32.088279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:32.088901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:32.089429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:32.090251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:32.090791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:32.091325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:32.168198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:32.184484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5e9cb6b-2df0-42d2-9625-3abe27f2c0c2 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1230 microversion: 2.1 time: 0.109345 Aug 25 13:57:32.187195 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3251/6428] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:32 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:57:33.213028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:33.214563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:33.227936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.229003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.229841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:33.231196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:33.233143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:33.233986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:33.337266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:33.352635 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35a071a9-a412-4aa9-94ec-b1522305c6fb tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1230 microversion: 2.1 time: 0.146586 Aug 25 13:57:33.353599 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3178/6429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:33 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1230 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:34.382705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:34.383861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:34.397904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:34.398828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:34.399632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:34.401016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:34.401892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:34.402689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:34.497945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:34.513447 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c7800a7-b74a-47ff-ad8e-45723a2ef52e tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1230 microversion: 2.1 time: 0.138200 Aug 25 13:57:34.514525 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3252/6430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:34 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1230 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:35.552426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:35.553304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:35.562714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.563610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.564287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.565212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:35.565763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:35.566283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:35.666058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbfe075cc8142d89b91a4740a7d1594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610575c3b04c8a8868148bad412c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:57:35.681726 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9243c796-41c8-40c0-9cd7-4de15ae7f448 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 200 len: 1230 microversion: 2.1 time: 0.133862 Aug 25 13:57:35.682982 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3179/6431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:35 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 1230 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:57:36.720095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:36.720954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] [instance: 7cc6f128-ba5c-4d45-b9f0-46d9698814f8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:57:36.733961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.736296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.737202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.739654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:57:36.740313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:57:36.740905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:57:36.769185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] HTTP exception thrown: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Request method failure captured: Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 HTTP/1.1 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB38A2bFV4JxBpvONi_t1-__31_zkNGtUDz3y0u5YHtEN6C1XpKCww06Y57hNLncDdL0ZtmrQIaXYMLWXf1BvZRpAvfwQN_pK9kZUZGQb22ZmnOHDpKcIbxlmHUCIxsEmnFUExOPcAv-WXn6uZ8T7Y3MXyeI9R_rbckbw40WRoIDQHpI Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 8a610575c3b04c8a8868148bad412c84 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestVolumeBackupRestore-828449119 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8a610575c3b04c8a8868148bad412c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8a610575c3b04c8a8868148bad412c84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a610575c3b04c8a8868148bad412c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8a610575c3b04c8a8868148bad412c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestVolumeBackupRestore-828449119 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 8a610575c3b04c8a8868148bad412c84 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestVolumeBackupRestore-828449119 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestVolumeBackupRestore-828449119-project Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: abbfe075cc8142d89b91a4740a7d1594 Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestVolumeBackupRestore-828449119-project Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7cc6f128-ba5c-4d45-b9f0-46d9698814f8'} Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:57:36.771553 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Returning 404 to user: Instance 7cc6f128-ba5c-4d45-b9f0-46d9698814f8 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cfdabcc7-9466-4661-a64a-0aef201d1c93 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8" status: 404 len: 111 microversion: 2.1 time: 0.058495 Aug 25 13:57:36.779394 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3253/6432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:57:36 2022] GET /compute/v2.1/servers/7cc6f128-ba5c-4d45-b9f0-46d9698814f8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:57:37.054179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d616bebe-a374-4b7d-a98c-9b5b9ffe7413 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] Calling method '.version_select at 0x7fc6c076a8b0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:57:37.116959 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d616bebe-a374-4b7d-a98c-9b5b9ffe7413 tempest-TestVolumeBackupRestore-828449119 tempest-TestVolumeBackupRestore-828449119-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1300764208" status: 202 len: 0 microversion: 2.1 time: 0.062990 Aug 25 13:57:37.118553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3180/6433] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 13:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1300764208 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:58:08.312334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:08.313667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=24 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:08.315408 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:58:08.315408 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 13:58:08.498540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1115983730", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:08.559982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] validate_networks() for None {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:58:08.865541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:58:08.865970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:58:08.866451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:58:08.866863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:58:08.867361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:58:08.879678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.880235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.880663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.881403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:08.881868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:08.882296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:08.900242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Getting quotas for project 3e3a04f317124b7a828f347da7954668. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:58:08.905868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Getting quotas for user 7b5194d023a74250a5edffa614438075 and project 3e3a04f317124b7a828f347da7954668. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:58:08.922733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:58:08.925448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:58:08.974487 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4b5eaff-22af-4cdf-b7bb-be6b17c05294 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667991 Aug 25 13:58:08.975161 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3254/6434] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:58:08.985719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:08.986519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:08.991279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df4d2304-2af3-41ae-bf89-3a0072fdecde tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:08.991916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df4d2304-2af3-41ae-bf89-3a0072fdecde tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:09.056409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df4d2304-2af3-41ae-bf89-3a0072fdecde tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:09.064592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df4d2304-2af3-41ae-bf89-3a0072fdecde tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1222 microversion: 2.1 time: 0.080245 Aug 25 13:58:09.065081 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3181/6435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:08 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:10.088406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:10.089102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:10.097200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:10.097710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:10.098166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:10.098904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:10.099379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:10.099822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:10.169491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:10.180730 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3b3e979-a149-46bf-bcf5-3a1a42632eab tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1274 microversion: 2.1 time: 0.097049 Aug 25 13:58:10.181641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3255/6436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:10 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:11.209480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:11.210849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:11.221150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:11.221878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:11.222673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:11.223832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:11.224606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:11.225313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:11.461441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:11.474704 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-403a85f8-4b47-41eb-920a-a41646817817 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.273465 Aug 25 13:58:11.475321 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3182/6437] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:11 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:12.210935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6575578d-3180-4ee2-9c47-089b6fae731c", "tag": "3f32fafe-3e82-466d-9f4e-da26e392f5d7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:12.239935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:12.241108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:12.241930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:12.273729 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] Creating event network-changed:3f32fafe-3e82-466d-9f4e-da26e392f5d7 for instance 6575578d-3180-4ee2-9c47-089b6fae731c on n-h2-850468-18 Aug 25 13:58:12.281147 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ce69a8ed-0f10-4e6e-8c3c-29ae5802112e req-b4ad5dd9-cf84-4e86-8baf-c45702526503 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077664 Aug 25 13:58:12.282197 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3256/6438] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:12.518305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:12.519504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:12.544154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:12.545112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:12.545624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:12.546469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:12.546988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:12.547450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:12.781137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:12.795675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4515ce1-d45b-44a9-a63a-39a60f8d5766 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.284222 Aug 25 13:58:12.797538 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3183/6439] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:12 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:13.833016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:13.833954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:13.842207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:13.842847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:13.843410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:13.844318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:13.844907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:13.845460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:14.049393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:14.059435 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c408731-6689-455c-94c3-6d42b44d75fa tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.231786 Aug 25 13:58:14.060058 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3257/6440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:13 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:15.095812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:15.096516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:15.103821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:15.104386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:15.105226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:15.105829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:15.106322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:15.106695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:15.251620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:15.260524 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d41517aa-8a5f-465b-bddb-715258507cf0 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.169725 Aug 25 13:58:15.261667 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3184/6441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:15 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:16.283471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:16.284903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:16.293129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:16.293810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:16.294407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:16.295298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:16.295931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:16.296512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:16.468191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:16.476905 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0528b314-d81b-4076-9059-4565e85b21da tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.197420 Aug 25 13:58:16.477575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3258/6442] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:16 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:17.503276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:17.504414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:17.518025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:17.518930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:17.519778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:17.521199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:17.522521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:17.523365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:17.696280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:17.706532 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2f4be37f-1018-49e4-904f-e070bd6ed3b4 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.211205 Aug 25 13:58:17.712327 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3185/6443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:17 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:17.984056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6575578d-3180-4ee2-9c47-089b6fae731c", "name": "network-vif-plugged", "status": "completed", "tag": "3f32fafe-3e82-466d-9f4e-da26e392f5d7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:17.994876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:17.995917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:17.996394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:18.012084 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] Creating event network-vif-plugged:3f32fafe-3e82-466d-9f4e-da26e392f5d7 for instance 6575578d-3180-4ee2-9c47-089b6fae731c on n-h2-850468-18 Aug 25 13:58:18.017789 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e42a56b1-9733-40b9-897c-675b6cdfa172 req-15a6a1e4-7cbc-4366-ad4a-258cbf9780b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121001 Aug 25 13:58:18.018288 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3259/6444] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:18.729239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:18.729916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:18.737849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:18.738356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:18.738816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:18.739559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:18.740016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:18.740481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:18.896440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:18.905990 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a83a53f6-531e-40a8-b689-5099cd0a4f71 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1322 microversion: 2.1 time: 0.180217 Aug 25 13:58:18.906596 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3186/6445] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:18 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:19.927650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:19.928420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:19.930579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:19.932158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:19.939194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:19.939705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:19.940185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:19.940918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:19.941390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:19.941845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.104049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:20.112719 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c78f758a-1915-4ff1-b96a-efdc3803b662 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1472 microversion: 2.1 time: 0.189365 Aug 25 13:58:20.113309 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3260/6446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:19 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:20.139329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:20.199166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cc22f9ea-36ee-45f6-afe8-15b4203acc85 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '.version_select at 0x7fc6c1110160>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:20.267807 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cc22f9ea-36ee-45f6-afe8-15b4203acc85 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/2afb86c7816447b7ab8aaf573629ccfa" status: 200 len: 371 microversion: 2.1 time: 0.133854 Aug 25 13:58:20.268661 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3187/6447] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 13:58:20 2022] GET /compute/v2.1/os-quota-sets/2afb86c7816447b7ab8aaf573629ccfa => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:20.280210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2741cfa5-e0a7-44bb-9043-6a3c8b571d8b tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1132024434", "id": 994778445, "os-flavor-access:is_public": "True"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:20.299256 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2741cfa5-e0a7-44bb-9043-6a3c8b571d8b tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022968 Aug 25 13:58:20.300253 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3261/6448] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:58:20 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:20.313767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "994778445"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:20.316034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:20.322386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.322893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.323356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.324077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.324590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.325037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.415845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0e87efe01493493aa5de241d4a8ee682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb86c7816447b7ab8aaf573629ccfa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:20.422605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1132024434 {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:58:20.429384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.429891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.430346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.431093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.431566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.432145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.454158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Getting quotas for project 3e3a04f317124b7a828f347da7954668. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:58:20.459448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Getting quotas for user 7b5194d023a74250a5edffa614438075 and project 3e3a04f317124b7a828f347da7954668. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:58:20.472505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.compute.api [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] ram quota exceeded for 2afb86c7816447b7ab8aaf573629ccfa, tried to resize instance. Aug 25 13:58:20.473074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Request method failure captured: Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action HTTP/1.1 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 38 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3_wLyGPZWiY30kEZr3-fhNyGRzSqs-Tpf1PHhgNJADO5aZWp7LdN6_i_Hm7-zIUvPrc5Y_fbLthd5ky4yLouENsipHQIYQyXOJ0slsuUqTX0zbhp6y6tPAi6A4tOZQXyKoKMILLIQSTJjewmd6DsTInoeUgYqJZiH9V6VP9On_a6vM Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 2afb86c7816447b7ab8aaf573629ccfa Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Role: admin,reader,member Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: admin,reader,member Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 2afb86c7816447b7ab8aaf573629ccfa Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-1471400502-project-admin Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 0e87efe01493493aa5de241d4a8ee682 Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1471400502-project-admin Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: {"resize": {"flavorRef": "994778445"}} Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6575578d-3180-4ee2-9c47-089b6fae731c', 'body': {'resize': {'flavorRef': '994778445'}}} Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.475213 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af082fb1-0313-409b-8515-5c1eceb173a9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action" status: 403 len: 118 microversion: 2.1 time: 0.167805 Aug 25 13:58:20.479105 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3188/6449] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:58:20 2022] POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action => generated 118 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:58:20.486888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c2c13172-f745-4f77-a622-6ad516d6f90d tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:20.504312 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c2c13172-f745-4f77-a622-6ad516d6f90d tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/994778445" status: 202 len: 0 microversion: 2.1 time: 0.022135 Aug 25 13:58:20.504892 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3262/6450] 10.222.0.60 () {58 vars in 1158 bytes} [Thu Aug 25 13:58:20 2022] DELETE /compute/v2.1/flavors/994778445 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:58:20.513018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f2e35527-4d91-471b-8c7d-8599b2a34de9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:20.534982 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f2e35527-4d91-471b-8c7d-8599b2a34de9 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025720 Aug 25 13:58:20.535571 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3189/6451] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:58:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:20.560488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3793305-c397-4bea-a61e-edf6c8fe9d77 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '.version_select at 0x7fc6c186b700>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:20.651106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3793305-c397-4bea-a61e-edf6c8fe9d77 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "GET /compute/v2.1/os-quota-sets/2afb86c7816447b7ab8aaf573629ccfa" status: 200 len: 371 microversion: 2.1 time: 0.096020 Aug 25 13:58:20.651708 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3263/6452] 10.222.0.60 () {58 vars in 1242 bytes} [Thu Aug 25 13:58:20 2022] GET /compute/v2.1/os-quota-sets/2afb86c7816447b7ab8aaf573629ccfa => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:20.664740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9927f50-b249-4fff-b5fe-b0ec2c78a02c tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-179538407", "id": 1044853447, "os-flavor-access:is_public": "True"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:20.685886 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9927f50-b249-4fff-b5fe-b0ec2c78a02c tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024939 Aug 25 13:58:20.686504 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3190/6453] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:58:20 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:20.698878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1044853447"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:20.701216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:20.708382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.708897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.709343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.710073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.710534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.710967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.931051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0e87efe01493493aa5de241d4a8ee682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afb86c7816447b7ab8aaf573629ccfa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:20.939025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-179538407 {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:58:20.946225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.946709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.947156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.947895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:20.948389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:20.948824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:20.972377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Getting quotas for project 3e3a04f317124b7a828f347da7954668. Resources: {'ram', 'cores'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:58:20.977907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Getting quotas for user 7b5194d023a74250a5edffa614438075 and project 3e3a04f317124b7a828f347da7954668. Resources: {'ram', 'cores'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:58:20.992387 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] cores quota exceeded for 2afb86c7816447b7ab8aaf573629ccfa, tried to resize instance. Aug 25 13:58:20.992939 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Request method failure captured: Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action HTTP/1.1 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 39 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB3_wLyGPZWiY30kEZr3-fhNyGRzSqs-Tpf1PHhgNJADO5aZWp7LdN6_i_Hm7-zIUvPrc5Y_fbLthd5ky4yLouENsipHQIYQyXOJ0slsuUqTX0zbhp6y6tPAi6A4tOZQXyKoKMILLIQSTJjewmd6DsTInoeUgYqJZiH9V6VP9On_a6vM Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 2afb86c7816447b7ab8aaf573629ccfa Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Role: admin,reader,member Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: admin,reader,member Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2afb86c7816447b7ab8aaf573629ccfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 2afb86c7816447b7ab8aaf573629ccfa Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1471400502 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersAdminNegativeTestJSON-1471400502-project-admin Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 0e87efe01493493aa5de241d4a8ee682 Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1471400502-project-admin Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: {"resize": {"flavorRef": "1044853447"}} Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '6575578d-3180-4ee2-9c47-089b6fae731c', 'body': {'resize': {'flavorRef': '1044853447'}}} Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.995083 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-40095e17-fbd1-41f6-8c1e-ab0a0def24ea tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action" status: 403 len: 113 microversion: 2.1 time: 0.301664 Aug 25 13:58:20.998754 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3264/6454] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:58:20 2022] POST /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c/action => generated 113 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:58:21.005864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a6c5715-5524-4727-b9a3-5f9825a8c403 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:21.023339 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a6c5715-5524-4727-b9a3-5f9825a8c403 tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "DELETE /compute/v2.1/flavors/1044853447" status: 202 len: 0 microversion: 2.1 time: 0.021200 Aug 25 13:58:21.023936 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3191/6455] 10.222.0.60 () {58 vars in 1161 bytes} [Thu Aug 25 13:58:21 2022] DELETE /compute/v2.1/flavors/1044853447 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:58:21.032859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb2de4b3-0d37-4822-a2ba-264a15cddcae tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:21.053731 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb2de4b3-0d37-4822-a2ba-264a15cddcae tempest-ServersAdminNegativeTestJSON-1471400502 tempest-ServersAdminNegativeTestJSON-1471400502-project-admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025161 Aug 25 13:58:21.054334 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3265/6456] 10.222.0.60 () {58 vars in 1146 bytes} [Thu Aug 25 13:58:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:21.074678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:21.075305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:21.081841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:21.082342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:21.082799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:21.083520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:21.083988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:21.084456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:21.113065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:58:21.199812 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-af5de48d-5c5c-4830-b790-3f82f4cbf0d7 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 204 len: 0 microversion: 2.1 time: 0.128724 Aug 25 13:58:21.200890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3192/6457] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:58:21 2022] DELETE /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:58:21.210117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:21.211116 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:21.218914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:21.219399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:21.219851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:21.220780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:21.221180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:21.221620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:21.407694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:21.415810 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3159261a-38cf-4c4c-a264-b823f26ad459 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1478 microversion: 2.1 time: 0.209822 Aug 25 13:58:21.416416 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3266/6458] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:21 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:22.439289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:22.440009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:22.447852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:22.448463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:22.448961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:22.449784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:22.450284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:22.450728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:22.608262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5194d023a74250a5edffa614438075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3a04f317124b7a828f347da7954668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:22.618288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e637c245-bcab-469d-82c5-a8038cbf4765 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 200 len: 1478 microversion: 2.1 time: 0.184056 Aug 25 13:58:22.618909 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3193/6459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:22 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:23.123629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6575578d-3180-4ee2-9c47-089b6fae731c", "name": "network-vif-deleted", "tag": "3f32fafe-3e82-466d-9f4e-da26e392f5d7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:23.137527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:23.137946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:23.138490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:23.152688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] Creating event network-vif-deleted:3f32fafe-3e82-466d-9f4e-da26e392f5d7 for instance 6575578d-3180-4ee2-9c47-089b6fae731c on n-h2-850468-18 Aug 25 13:58:23.158832 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9d4e6bfd-ee6c-4048-acc6-ebe2f31ea002 req-dbd8a606-fd36-4f04-a13c-3f26d846c909 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038575 Aug 25 13:58:23.159630 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3267/6460] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:58:23.642678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:23.643369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] [instance: 6575578d-3180-4ee2-9c47-089b6fae731c] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:23.650941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:23.651449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:23.651917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:23.652683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:23.653165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:23.653617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:23.670264 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] HTTP exception thrown: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Request method failure captured: Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c HTTP/1.1 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB3_vfy-72aC4r3U7suFlbc0F9N8vzBfZl_unGmsxVz6NEbIwHossRyL7w8BA-usSiBx1P6xL90muRoIr7dPLGfWeZPcNXeFQ-797qwOFZ8mw5PsbLC7aTWpxRtdXIDF7duqdmbOsc_OS5jwmEds42d59-v9rEb-uAGkdEitYBk7IJTA Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 3e3a04f317124b7a828f347da7954668 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2119088183 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e3a04f317124b7a828f347da7954668"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e3a04f317124b7a828f347da7954668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e3a04f317124b7a828f347da7954668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e3a04f317124b7a828f347da7954668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2119088183 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 3e3a04f317124b7a828f347da7954668 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2119088183 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersAdminNegativeTestJSON-2119088183-project Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 7b5194d023a74250a5edffa614438075 Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2119088183-project Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '6575578d-3180-4ee2-9c47-089b6fae731c'} Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:23.672516 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] Returning 404 to user: Instance 6575578d-3180-4ee2-9c47-089b6fae731c could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e2c14ce-6b9b-42d2-b8f7-ee9bef0b6614 tempest-ServersAdminNegativeTestJSON-2119088183 tempest-ServersAdminNegativeTestJSON-2119088183-project] 10.222.0.60 "GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c" status: 404 len: 111 microversion: 2.1 time: 0.035753 Aug 25 13:58:23.681430 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3194/6461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:23 2022] GET /compute/v2.1/servers/6575578d-3180-4ee2-9c47-089b6fae731c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:58:30.643398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:30.716416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-60189721", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "526d7e26-7238-40c0-a1c5-8219e212a7fc"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:30.776687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] validate_networks() for [('526d7e26-7238-40c0-a1c5-8219e212a7fc', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:58:30.958900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:31.282978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:58:31.283412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:58:31.283903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:58:31.284412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:58:31.284837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:58:31.295164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:31.295665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:31.296137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:31.297801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:31.298175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:31.298617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:31.318198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Getting quotas for project d52385c7662a4226a33a4dacd3bbebff. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:58:31.325005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Getting quotas for user 3265e3985bc7467f97aae3067936c6f8 and project d52385c7662a4226a33a4dacd3bbebff. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:58:31.341241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:58:31.344383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:58:31.405072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d71501ad-cbbc-474d-9dd2-c979a0129973 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839601 Aug 25 13:58:31.405793 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3268/6462] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 13:58:31.417566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47c2a0ce-65cf-4c1a-84e8-fab96c0d6089 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:31.418853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47c2a0ce-65cf-4c1a-84e8-fab96c0d6089 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:31.428441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:31.430735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:31.496560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47c2a0ce-65cf-4c1a-84e8-fab96c0d6089 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:31.519766 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47c2a0ce-65cf-4c1a-84e8-fab96c0d6089 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1213 microversion: 2.1 time: 0.094401 Aug 25 13:58:31.519766 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3195/6463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:31 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:32.542084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:32.542633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:32.552673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:32.553141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:32.553593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:32.554510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:32.554981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:32.555420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:32.675838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:32.685092 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0a1e74a-e66f-4382-a10c-98fb7e4a166c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1283 microversion: 2.1 time: 0.147888 Aug 25 13:58:32.686052 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3269/6464] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:32 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:33.707771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:33.709361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:33.714010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:33.719194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:33.720102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:33.720819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:33.721683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:33.722384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:33.722944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:33.918901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:33.928248 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37004c69-2b88-4c88-a54e-0f027996a592 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.224785 Aug 25 13:58:33.929418 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3196/6465] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:33 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:34.095074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:34.133581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:34.134086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:34.134955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:34.156421 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] Creating event network-changed:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h2-850468-18 Aug 25 13:58:34.165070 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b4e508eb-1bbe-443e-9087-63a812fe7873 req-f92feb48-1303-45bb-8457-79c9572c3ebf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072881 Aug 25 13:58:34.166352 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3270/6466] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:34.951655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:34.952478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:34.960367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:34.961028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:34.961333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:34.962057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:34.962527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:34.962976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:35.112785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:35.121122 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9d71533-527a-4ce1-9fa4-bd3155ecfd92 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.173428 Aug 25 13:58:35.121712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3197/6467] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:34 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:36.146651 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:36.147365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:36.153791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:36.154291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:36.154730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:36.155921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:36.156832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:36.157272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:36.314550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:36.322557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-64c262e4-f2a8-47bc-ba81-29abbdaf97a5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.183048 Aug 25 13:58:36.323147 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3271/6468] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:36 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:37.344469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:37.345100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:37.352326 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:37.352833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:37.353323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:37.354034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:37.354508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:37.354979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:37.495041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:37.503391 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c8fec54-0fb8-4c86-bcf7-bb570504c5b8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.163500 Aug 25 13:58:37.503995 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3198/6469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:37 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:38.525955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:38.525955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:38.528490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:38.535539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:38.536306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:38.536512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:38.537239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:38.537698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:38.538133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:38.542202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=68 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:38.690078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:38.699365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9818a550-457b-4d9d-86fd-b5ea0e6a7c9b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.178329 Aug 25 13:58:38.700089 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3272/6470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:38 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:39.728741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:39.729283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:39.731956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:39.738329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:39.738841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:39.739303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:39.740025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:39.740526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:39.740977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:39.898680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:39.907596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d9db2e2-b7bf-490e-a258-109ab0aefeea tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.182797 Aug 25 13:58:39.908212 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3199/6471] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:39 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:39.962710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "name": "network-vif-plugged", "status": "completed", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:39.974094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:39.974577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:39.975018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:39.987067 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] Creating event network-vif-plugged:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h2-850468-18 Aug 25 13:58:39.992934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-0cde5c40-f764-4299-88a2-4ef96004d75a req-0916dece-956e-4966-abef-dd3f95140970 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Aug 25 13:58:39.993554 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3273/6472] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:58:40.928937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:40.929586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:40.936474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.936980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.937698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:40.938442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:40.938913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:40.939355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:41.085991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:41.095449 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0ab492b-88ed-402e-8a12-d9cd05b2f2a9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1313 microversion: 2.1 time: 0.170437 Aug 25 13:58:41.096045 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3200/6473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:40 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:42.118195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:42.118912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:42.121790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:42.122896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:42.129386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.129876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.130322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.131025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.131486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.131914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.280224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:42.288768 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fbce8387-4441-486b-999d-598bcf664f11 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1499 microversion: 2.1 time: 0.175232 Aug 25 13:58:42.289379 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3274/6474] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:42 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1499 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:42.309988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:58:42.313673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:42.315921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:58:42.322438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.322935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.323409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.324255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.324736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.325172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.356380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:42.364226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Old instance type m1.heat2, new instance type m1.heat {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:58:42.372861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:58:42.373212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:58:42.373699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:58:42.374858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:58:42.375616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:58:42.447067 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d500f1ec-0a6f-450b-85b4-eb876736ca0c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "POST /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8/action" status: 202 len: 0 microversion: 2.1 time: 0.141056 Aug 25 13:58:42.447970 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3201/6475] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:58:42 2022] POST /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 13:58:42.457422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:42.458199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:42.466256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.466906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.467421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.468264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:42.468831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:42.469301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:42.641446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:42.650737 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4d501dd-1e90-4a73-a45f-54c181ebde3b tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1508 microversion: 2.1 time: 0.198081 Aug 25 13:58:42.651617 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3275/6476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:42 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:43.681429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:43.682062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:43.690695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:43.691519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:43.691977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:43.692769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:43.693271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:43.693746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:43.848880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:43.857538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-673cebd4-f01f-456b-9c2f-52a674e0c5e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1508 microversion: 2.1 time: 0.181167 Aug 25 13:58:43.858852 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3202/6477] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:43 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:44.880977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:44.881649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:44.888358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:44.888759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:44.889199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:44.890358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:44.890981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:44.891415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:45.046677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:45.057588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-28fc3e1f-f89c-4bd8-a465-1b347afe975e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.182340 Aug 25 13:58:45.058198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3276/6478] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:44 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:46.081364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:46.082174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:46.092036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:46.093210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:46.093766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:46.094509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:46.094990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:46.095491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:46.250696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:46.259276 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d9ad006-da73-43a7-ac41-3de2f3cb47e9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.183514 Aug 25 13:58:46.259894 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3203/6479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:46 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:47.282411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:47.283053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:47.290439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:47.290969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:47.291421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:47.292254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:47.292712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:47.293150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:47.444320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:47.453261 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-31a2bc84-5dd8-42b5-97ee-72109e46a07f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.175189 Aug 25 13:58:47.453917 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3277/6480] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:47 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:48.476088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:48.476869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:48.486087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:48.486610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:48.487076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:48.487829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:48.488349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:48.488803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:48.660523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:48.668962 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ad5f9e6-92f1-410d-aa25-b2ce7f3079f2 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.196942 Aug 25 13:58:48.669656 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3204/6481] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:48 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:49.695696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:49.696596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:49.705956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:49.706456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:49.706902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:49.707643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:49.708403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:49.709190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:49.960890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:49.970203 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-769b0d07-888f-4d47-8a9b-4c6f75c7606f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.282164 Aug 25 13:58:49.970820 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3278/6482] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:49 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:50.991472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:50.992186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:51.001701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:51.002221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:51.002679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:51.003414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:51.003883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:51.004361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:51.151816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:51.161268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c81cfdda-4966-4d2b-af0e-8aa4a153042f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.173663 Aug 25 13:58:51.161884 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3205/6483] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:50 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:52.183017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:52.183646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:52.192152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:52.192673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:52.193115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:52.193846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:52.194308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:52.194738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:52.362819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:52.375221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3277e8e2-bd2c-48fb-956b-5fd79aab86ae tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.195942 Aug 25 13:58:52.376056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3279/6484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:52 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:53.399338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:53.399974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:53.408703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:53.409473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:53.410149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:53.411239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:53.411384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:53.411893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:53.581817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:53.591503 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f71a6283-5be4-429c-b177-b005388a0065 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.196098 Aug 25 13:58:53.592166 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3206/6485] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:53 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:54.616341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:54.617318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:54.627969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:54.628864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:54.629733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:54.631040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:54.631883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:54.632744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:54.837837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:54.850757 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d74b7db5-b736-4d2a-a415-a0a6bfa772e3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.240017 Aug 25 13:58:54.851561 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3280/6486] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:54 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:55.876461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:55.877115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:55.885498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:55.886339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:55.886612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:55.887528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:55.887920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:55.888468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:56.046518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:56.057281 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0176937d-a886-48ff-840a-57bf6dcb8307 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.186044 Aug 25 13:58:56.057971 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3207/6487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:55 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:57.086533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:57.087147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:57.095898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:57.096441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:57.096889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:57.097626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:57.098064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:57.098503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:57.272105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:57.282413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e314dd3-a475-4dec-b923-9538ee78a609 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.199837 Aug 25 13:58:57.283084 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3281/6488] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:57 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:58:58.307320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:58.307971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:58.315856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:58.316466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:58.316886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:58.317625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:58.318103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:58.319638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:58.490095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:58.498647 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d412a121-02ad-4751-8e06-b022fb019e7f tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.197195 Aug 25 13:58:58.499322 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3208/6489] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:58 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:58:59.526023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:58:59.526625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:58:59.533801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:59.534293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:59.534741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:59.535452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:58:59.535905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:58:59.536359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:58:59.681874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:58:59.691567 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5bc1a19-8c4c-45b6-8e14-8f99fb5c4e1c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.172398 Aug 25 13:58:59.692198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3282/6490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:58:59 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:00.721580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:00.722231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:00.728648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:00.729248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:00.729651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:00.730353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:00.730832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:00.731279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:00.919824 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:00.929706 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-224c7bad-5d37-419d-bdc6-d05c060dc610 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.214486 Aug 25 13:59:00.930314 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3209/6491] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:00 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:01.960903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:01.961859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:01.972456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:01.973252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:01.973829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:01.974743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:01.975337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:01.975978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:02.143457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:02.151583 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ceab7ce2-9f24-407c-95c3-bd315689b14d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.196224 Aug 25 13:59:02.152191 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3283/6492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:01 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:03.175990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:03.177356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:03.186744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:03.187745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:03.188446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:03.189617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:03.190172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:03.190669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:03.407682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:03.420979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1eb4575f-4c79-4111-834a-772744dd50de tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.250521 Aug 25 13:59:03.422088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3210/6493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:03 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:04.459807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:04.460664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:04.469696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:04.470256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:04.470803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:04.471647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:04.472211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:04.472781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:04.635833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:04.645963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-19d8b60d-73a6-49bf-8b5a-b3d84399d403 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.190754 Aug 25 13:59:04.646578 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3284/6494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:04 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:05.669106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:05.669960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:05.680686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:05.681608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:05.682469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:05.683934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:05.684921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:05.686349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:05.691100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:05.874048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:05.887232 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d22b95d-830b-4db9-a36f-54519afc0d72 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.222684 Aug 25 13:59:05.887996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3211/6495] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:05 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:06.916975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:06.917661 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:06.925050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:06.925544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:06.925984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:06.926696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:06.927160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:06.927590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:07.072518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:07.082880 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c9ba3f63-9f20-40da-be5b-d80094524023 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.169681 Aug 25 13:59:07.083667 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3285/6496] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:06 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:08.105229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:08.106125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:08.117898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:08.118415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:08.118875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:08.119626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:08.120100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:08.120586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:08.290139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:08.306343 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0beeebb6-cada-4c76-a02c-9d5fe1887d5e tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.204841 Aug 25 13:59:08.307442 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3212/6497] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:08 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:09.343003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:09.343620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:09.346444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=28 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:09.351988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:09.352537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:09.353024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:09.353733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:09.354196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:09.354628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:09.357698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=80 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:09.501894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:09.511801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-be2ede0b-4695-4fbc-891c-19b705f32a71 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.172814 Aug 25 13:59:09.512448 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3286/6498] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:09 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:10.533659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:10.534202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:10.536955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=32 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:10.543128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:10.543778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:10.544135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:10.545638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:10.546447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:10.547366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:10.696916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:10.712877 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fc56679-0e6a-49e3-95a7-03f9bf5dc94c tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1513 microversion: 2.1 time: 0.182910 Aug 25 13:59:10.713957 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3213/6499] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:10 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:11.735191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:11.735940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:11.744360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:11.748435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:11.749037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:11.749888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:11.750378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:11.750854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:11.909972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:11.918920 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-be1ac7ac-0c43-4194-a983-39f9e7192af9 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1512 microversion: 2.1 time: 0.187721 Aug 25 13:59:11.924846 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3287/6500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:11 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:12.237957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "name": "network-vif-unplugged", "status": "completed", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:12.248700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:12.249438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:12.249770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:12.262878 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Creating event network-vif-unplugged:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h1-850468-18 Aug 25 13:59:12.270321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:59:12.282778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4abf955c-d952-478d-9883-b08d4a73892c req-16540c0d-a80b-46a6-9354-2e95152839b2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048738 Aug 25 13:59:12.283396 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3214/6501] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 13:59:12.942890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:12.943514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:12.950283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:12.950813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:12.951257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:12.951982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:12.952469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:12.952926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:13.100143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:13.109310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4af2f37c-3883-4a4d-ae23-be70c471a057 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1512 microversion: 2.1 time: 0.170876 Aug 25 13:59:13.109928 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3288/6502] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:12 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:14.133022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:14.133774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:14.140571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:14.141072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:14.141528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:14.142238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:14.142705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:14.143139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:14.296587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:14.305263 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2d2b4587-af51-4752-9380-ed4c39ea6cd5 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1510 microversion: 2.1 time: 0.177601 Aug 25 13:59:14.305956 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3215/6503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:14 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:14.308225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:14.319903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:14.320497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:14.320939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:14.335097 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Creating event network-changed:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h1-850468-18 Aug 25 13:59:14.341133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 13:59:14.358917 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c3b66659-a83d-4bc2-9104-3ffde746e131 req-229268c8-822e-45d1-9e4a-5dcec2ff23db service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054464 Aug 25 13:59:14.359782 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3289/6504] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:15.327589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:15.328245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:15.335199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:15.335694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:15.336160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:15.336895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:15.337355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:15.337792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:15.486281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:15.495157 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79dcd345-f843-4f4a-8201-f9c0ea54bd0d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1510 microversion: 2.1 time: 0.171771 Aug 25 13:59:15.495759 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3216/6505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:15 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:16.524261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:16.525132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:16.535608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:16.536266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:16.536898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:16.537715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:16.538235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:16.538673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:16.749847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:16.761095 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-70bb487f-a2d4-4e83-bef7-a6060a793a03 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1510 microversion: 2.1 time: 0.245785 Aug 25 13:59:16.762074 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3290/6506] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:16 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:17.798387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:17.799037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:17.807839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:17.808542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:17.809097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:17.809954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:17.810520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:17.811222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:17.987037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:17.996911 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08dea50c-7ece-4c2d-89a2-395653b85e34 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1507 microversion: 2.1 time: 0.203939 Aug 25 13:59:17.998155 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3217/6507] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:17 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:18.019226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:18.019805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:18.027086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:18.027498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:18.027945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:18.028896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:18.029578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:18.030009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:18.059234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 13:59:18.127965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Found an unconfirmed migration during delete, id: 16, status: finished Aug 25 13:59:19.586405 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0137886-0e31-4713-b206-3de54cfb0511 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 204 len: 0 microversion: 2.1 time: 1.570756 Aug 25 13:59:19.587174 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3291/6508] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:59:18 2022] DELETE /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 0 bytes in 1573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 13:59:19.596748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:19.597377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:19.604277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:19.604776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:19.605229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:19.605935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:19.606421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:19.606905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:19.744342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:19.752420 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df9a7ec7-e115-499a-9d39-3b8a9a2417cd tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1499 microversion: 2.1 time: 0.160064 Aug 25 13:59:19.752998 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3218/6509] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:19 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:20.502790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "name": "network-vif-plugged", "status": "completed", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:20.514180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:20.515731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:20.516363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:20.528551 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] Creating event network-vif-plugged:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h1-850468-18 Aug 25 13:59:20.534644 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-770f920b-e771-4363-9dde-5696e02cb807 req-fa72ed93-4e34-4eae-88e3-6f2dbc90493f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036507 Aug 25 13:59:20.535292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3292/6510] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:20.775346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:20.776180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:20.786981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:20.787505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:20.787969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:20.788758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:20.789240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:20.789685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:20.936324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:20.945256 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6942c7f-340a-4f4e-8c00-b869a6a4c3d3 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1499 microversion: 2.1 time: 0.175068 Aug 25 13:59:20.945859 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3219/6511] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:20 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:21.714570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bad9181-3f0a-4227-adad-0bf8aa5645e8", "name": "network-vif-deleted", "tag": "0ce884fe-0142-4d01-be0f-36f61c7963b9"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:21.724577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:21.725058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:21.725498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:21.737566 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] Creating event network-vif-deleted:0ce884fe-0142-4d01-be0f-36f61c7963b9 for instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 on n-h1-850468-18 Aug 25 13:59:21.742712 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3bc52464-e9a7-472f-96cf-e175e909617f req-a841a8e5-82c3-4f8d-a25f-8dff2a054436 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Aug 25 13:59:21.743400 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3293/6512] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:21.967243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:21.968605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:21.975788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:21.976331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:21.976783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:21.977497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:21.977982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:21.978444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:22.012967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:22.013522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:22.013972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:22.014629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lazy-loading 'fault' on Instance uuid 7bad9181-3f0a-4227-adad-0bf8aa5645e8 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 13:59:22.059854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3265e3985bc7467f97aae3067936c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52385c7662a4226a33a4dacd3bbebff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:22.072552 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-007e0f6a-a388-4e79-97e3-648ca91054f8 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 200 len: 1303 microversion: 2.1 time: 0.108900 Aug 25 13:59:22.073638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3220/6513] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:21 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:23.096320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:23.097029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:23.103299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.103784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.104246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.104954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.105404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.105829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.123236 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] HTTP exception thrown: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Request method failure captured: Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 HTTP/1.1 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4AGVq8MbvfrXLsLHGB578aaaJHFQnCvmw2zabKfcQTN-B2I7Q1hTnZ6nyh73FVHCz3rRz8_Onxxv-zK-KVELSV1Z_RPhuQEEMf7w8nppYcpjLAwUMfzFXxnCy5uqE4tn9TLjfBkNKjJwn5rJN3ggsmWN0GopKwSYh11pmfeC7HLLrw Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3265e3985bc7467f97aae3067936c6f8 Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7bad9181-3f0a-4227-adad-0bf8aa5645e8'} Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.125771 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Returning 404 to user: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b4da90ce-53cb-4164-b39a-2b61c8c4e1c6 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 404 len: 111 microversion: 2.1 time: 0.036226 Aug 25 13:59:23.130001 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3294/6514] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:23 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:59:23.144724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:23.145883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:23.157748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.158322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.159131 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.161033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.161603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.162063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.179546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] HTTP exception thrown: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Request method failure captured: Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 HTTP/1.1 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4AGVq8MbvfrXLsLHGB578aaaJHFQnCvmw2zabKfcQTN-B2I7Q1hTnZ6nyh73FVHCz3rRz8_Onxxv-zK-KVELSV1Z_RPhuQEEMf7w8nppYcpjLAwUMfzFXxnCy5uqE4tn9TLjfBkNKjJwn5rJN3ggsmWN0GopKwSYh11pmfeC7HLLrw Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 3265e3985bc7467f97aae3067936c6f8 Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '7bad9181-3f0a-4227-adad-0bf8aa5645e8'} Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:23.181355 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Returning 404 to user: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3783bfec-c94c-4d17-9084-3de69f5d1e82 tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 404 len: 111 microversion: 2.1 time: 0.044718 Aug 25 13:59:23.184882 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3221/6515] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 13:59:23 2022] DELETE /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:59:23.192679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:23.193298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] [instance: 7bad9181-3f0a-4227-adad-0bf8aa5645e8] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:23.199393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.199878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.200349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.201050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:23.201506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:23.201932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:23.217461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] HTTP exception thrown: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Request method failure captured: Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 HTTP/1.1 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4AGVq8MbvfrXLsLHGB578aaaJHFQnCvmw2zabKfcQTN-B2I7Q1hTnZ6nyh73FVHCz3rRz8_Onxxv-zK-KVELSV1Z_RPhuQEEMf7w8nppYcpjLAwUMfzFXxnCy5uqE4tn9TLjfBkNKjJwn5rJN3ggsmWN0GopKwSYh11pmfeC7HLLrw Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d52385c7662a4226a33a4dacd3bbebff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d52385c7662a4226a33a4dacd3bbebff Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-DeleteServersTestJSON-784375873 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 3265e3985bc7467f97aae3067936c6f8 Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-DeleteServersTestJSON-784375873-project Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7bad9181-3f0a-4227-adad-0bf8aa5645e8'} Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 13:59:23.220056 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] Returning 404 to user: Instance 7bad9181-3f0a-4227-adad-0bf8aa5645e8 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b7c2c2b-a33a-4eb0-b7bb-090ba027791d tempest-DeleteServersTestJSON-784375873 tempest-DeleteServersTestJSON-784375873-project] 10.222.0.60 "GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8" status: 404 len: 111 microversion: 2.1 time: 0.032792 Aug 25 13:59:23.224273 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3295/6516] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:23 2022] GET /compute/v2.1/servers/7bad9181-3f0a-4227-adad-0bf8aa5645e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 13:59:33.695091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=19 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:33.695884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=61 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:33.867633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-859360979", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "43ebbd16-0875-48fa-9a5a-856544892bc3"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:33.965725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] validate_networks() for [('43ebbd16-0875-48fa-9a5a-856544892bc3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 13:59:34.586861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:59:34.589583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:59:34.590586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:59:34.591445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:59:34.592040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:59:34.613294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:34.615408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:34.615896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:34.616785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:34.617385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:34.617838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:34.642297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 13:59:34.648868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for user 9b86cb2a034b4f86895d693381009f74 and project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 13:59:34.665935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 13:59:34.670087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 13:59:34.735057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce199a7f-6685-4f76-8e57-40b139ff02d1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045024 Aug 25 13:59:34.736090 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3222/6517] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 13:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 13:59:34.747474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-064ff851-2794-4532-8c88-8d94af950152 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:34.748343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-064ff851-2794-4532-8c88-8d94af950152 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:34.752711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:34.753857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:34.852355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-064ff851-2794-4532-8c88-8d94af950152 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:34.865727 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-064ff851-2794-4532-8c88-8d94af950152 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1217 microversion: 2.1 time: 0.122833 Aug 25 13:59:34.878232 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3296/6518] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:34 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:35.895343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:35.896307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:35.906035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:35.906549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:35.907330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:35.907948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:35.908453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:35.908901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:35.984615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:35.995513 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ec1cebce-38d6-42a9-9e77-8a86394d02b5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1269 microversion: 2.1 time: 0.107774 Aug 25 13:59:35.997269 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3223/6519] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:35 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:37.026875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:37.028028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:37.039691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:37.040317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:37.040981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:37.042088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:37.042740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:37.044318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:37.314443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:37.330955 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9f2f17d-b31d-48ba-bf10-37cb40b863e2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.309016 Aug 25 13:59:37.332422 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3297/6520] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:37 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:38.130685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:38.159969 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:38.160871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:38.161622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:38.197721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] Creating event network-changed:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h2-850468-18 Aug 25 13:59:38.217175 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7e661a29-fbfd-4990-876f-c4e6636ae4be req-9a1628ea-a669-4d33-95d6-d187ef8f593d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101468 Aug 25 13:59:38.219361 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3224/6521] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:38.358122 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:38.360245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:38.378573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:38.379817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:38.380795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:38.383461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:38.384719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:38.386748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:38.613272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:38.621523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bbb71c20-ab75-41f6-8f71-87f214bb88ca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.271373 Aug 25 13:59:38.622131 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3298/6522] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:38 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:39.646167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:39.647019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:39.654158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:39.655568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:39.656048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:39.656825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:39.657306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:39.657782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:39.835339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:39.844261 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0e3da320-66f5-477d-9463-cb1933a04984 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.205337 Aug 25 13:59:39.844868 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3225/6523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:39 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:40.866715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:40.867412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:40.874935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:40.875434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:40.875885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:40.876666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:40.877124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:40.877558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:41.021440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:41.030998 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7358019-d9a6-4a78-bee3-8467f99514ee tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.168147 Aug 25 13:59:41.031616 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3299/6524] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:40 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:42.052843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:42.053509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:42.062242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:42.062759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:42.063258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:42.063998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:42.064506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:42.064958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:42.211709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:42.220856 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c9b5484-28b2-4c89-9f11-94cd33414271 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.171900 Aug 25 13:59:42.221507 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3226/6525] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:42 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:43.246164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:43.247221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:43.260526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.261405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.262207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.263531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:43.265153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:43.265965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:43.430565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:43.441526 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-05907126-9aa4-4acd-8134-e52f1a1cc521 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.202668 Aug 25 13:59:43.442153 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3300/6526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:43 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:44.447110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "name": "network-vif-plugged", "status": "completed", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:44.463591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:44.464273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:44.471353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.471852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.474642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.481315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.481825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.482281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.483746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:44.484257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:44.485068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:44.495879 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] Creating event network-vif-plugged:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h2-850468-18 Aug 25 13:59:44.502800 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3508809e-1663-472b-83a5-077adca6dd1a req-376b161a-4c86-4ebf-a58f-ab2b9e7dfaee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061311 Aug 25 13:59:44.504103 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3227/6527] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 13:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 13:59:44.668156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:44.680212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7473882-c87a-46de-bdfb-5507e87dd199 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.221259 Aug 25 13:59:44.681060 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3301/6528] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:44 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:45.713662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:45.714748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:45.723403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:45.724299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:45.735285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.735825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.736356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.737273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:45.737771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:45.738270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:45.989776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:46.008300 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-23489e97-1edc-4127-9cda-05ce9c5ec10d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1317 microversion: 2.1 time: 0.295462 Aug 25 13:59:46.009697 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3228/6529] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:45 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.036347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:47.037193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:47.039255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 13:59:47.047905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.048439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.048892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.049639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.050115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.050554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.256657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:47.266468 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-52fa84af-b0cd-4068-8027-d418a1a148f3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1507 microversion: 2.1 time: 0.235185 Aug 25 13:59:47.267113 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3302/6530] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:47 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.291177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:47.291977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:47.300164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.300773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.301347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.302206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.302799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.303425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.473502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:47.488184 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dda726e0-176d-4496-953e-badd53df869d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1507 microversion: 2.1 time: 0.201998 Aug 25 13:59:47.489296 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3229/6531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:47 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.526915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:47.531546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:47.542571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.543381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.544214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.545543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.546408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.547203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.660841 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-50a94727-2e88-4efb-96e6-ae43fa406d29 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "PUT /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1079 microversion: 2.1 time: 0.141572 Aug 25 13:59:47.661700 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3303/6532] 10.222.0.60 () {60 vars in 1256 bytes} [Thu Aug 25 13:59:47 2022] PUT /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1079 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.694754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:47.695940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:47.707816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.708791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.709552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.710881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.711723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.712582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.916499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:47.927481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-17d225d2-4cb4-42da-aa0c-e4ab5be58c18 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1505 microversion: 2.1 time: 0.239936 Aug 25 13:59:47.928100 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3230/6533] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:47 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:47.948460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:47.949104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:47.960737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.962137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.962947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:47.964453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:47.965310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:47.966287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.145976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:48.157845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae0b4fa7-61bf-4be0-980d-81173618d092 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1505 microversion: 2.1 time: 0.213593 Aug 25 13:59:48.158606 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3304/6534] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:47 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:48.184426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 13:59:48.189815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:48.198974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.199476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.199932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.200945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.202849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.203447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.242173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:48.251886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 13:59:48.262739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 13:59:48.263348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 13:59:48.265455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 13:59:48.265899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 13:59:48.266395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 13:59:48.365207 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-382351ce-fdeb-4dda-bfe9-5e86d9187d73 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d/action" status: 202 len: 0 microversion: 2.1 time: 0.186063 Aug 25 13:59:48.373670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3231/6535] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 13:59:48 2022] POST /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 13:59:48.384755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:48.385373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:48.394810 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 13:59:48.395146 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 13:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d (ip 10.222.0.60) !!! Aug 25 13:59:48.403062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.403660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.404221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.407875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:48.408523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:48.408993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:48.648962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:48.664797 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-13f78a14-cfd5-4db1-b737-d82f63005a13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1516 microversion: 2.1 time: 0.285963 Aug 25 13:59:48.665855 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3305/6536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:48 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:49.703105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:49.703934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:49.715323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.716099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.716829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.718177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:49.719039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:49.719870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:49.922234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:49.932097 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63ed5faf-6a54-4ee7-930c-e5df8426a9ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1516 microversion: 2.1 time: 0.236425 Aug 25 13:59:49.933008 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3232/6537] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:49 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:50.955224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:50.955866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:50.964249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.964759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.965205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:50.965926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:50.966389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:50.966855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:51.163877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:51.173997 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ddbd83e-f1bc-4d4b-8747-ad3efcc0cd6e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.223334 Aug 25 13:59:51.174784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3306/6538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:50 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:52.200211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:52.200843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:52.208997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:52.209510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:52.209973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:52.210713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:52.211189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:52.211640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:52.366014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:52.375641 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4895edf-c759-41fa-a6e2-f1b59618de38 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.180185 Aug 25 13:59:52.376465 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3233/6539] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:52 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:53.399749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:53.400444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:53.409012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:53.409509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:53.409952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:53.410669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:53.411132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:53.411582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:53.589396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:53.603461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-530520f1-64ce-4d49-b1e9-9a8136fa382e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.208260 Aug 25 13:59:53.604205 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3307/6540] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:53 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:54.628441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:54.629346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:54.639168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:54.639870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:54.640554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:54.641552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:54.642158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:54.642695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:54.824846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:54.834061 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a580df73-6397-438f-ae8b-0078a0a44e84 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.209979 Aug 25 13:59:54.834768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3234/6541] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:54 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 13:59:55.858475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:55.859367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:55.866417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:55.866944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:55.867350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:55.868072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:55.868666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:55.868988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:56.064777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:56.078385 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cecf873c-6492-4d2b-9e75-870e2b372b42 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.225013 Aug 25 13:59:56.078992 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3308/6542] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:55 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:57.105259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:57.106456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:57.118277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:57.118874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:57.119523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:57.120784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:57.121594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:57.122089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:57.331916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:57.348298 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-652d8645-0633-4dc6-8417-02f86e56072d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.249983 Aug 25 13:59:57.349447 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3235/6543] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:57 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:58.391371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:58.392590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:58.406587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:58.407532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:58.408411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:58.409788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:58.410658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:58.411481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:58.615464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:58.628555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-58a6eba2-422c-4bc4-86c6-cff83bbf9201 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.245875 Aug 25 13:59:58.629662 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3309/6544] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:58 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 13:59:59.655874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 13:59:59.656637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 13:59:59.665501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:59.666016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:59.666477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:59.667222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 13:59:59.667691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 13:59:59.668155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 13:59:59.909538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 13:59:59.927260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d2cae56-3e50-4c65-9b6b-87e1a72f07c7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.274161 Aug 25 13:59:59.927260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3236/6545] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 13:59:59 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:00.963132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:00.964173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:00.980693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:00.982263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:00.983152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:00.984526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:00.985428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:00.986263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:01.201866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:01.211502 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-456574bf-ff6f-4d0e-96b0-5276a4b4b83d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.255911 Aug 25 14:00:01.212399 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3310/6546] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:00 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:02.235685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:02.236426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:02.245102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:02.245663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:02.246147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:02.246945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:02.247570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:02.248101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:02.393300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:02.403698 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9f89c16-d234-4c15-ac5e-2727e3899720 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.172969 Aug 25 14:00:02.405478 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3237/6547] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:02 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:03.429182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:03.430041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:03.438147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:03.438628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:03.439483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:03.439775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:03.440257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:03.440686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:03.601715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:03.612270 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-867ec011-3df6-4554-9fd9-912aeccc8be2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.186877 Aug 25 14:00:03.612871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3311/6548] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:03 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:04.635206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:04.635871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:04.639817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:04.646316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.646886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.647342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.648065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:04.648575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:04.649012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:04.652690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:04.800809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:04.811392 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-63cbee92-89c9-45f8-8927-7970ee1aeb72 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.178783 Aug 25 14:00:04.812106 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3238/6549] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:04 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:05.837019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:05.837694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:05.842495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=35 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:05.851457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:05.852317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:05.852954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:05.854221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:05.855094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:05.855898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:05.865318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:06.071667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:06.081673 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4780b90c-f270-4e8c-9392-42cb0f9c1065 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.249498 Aug 25 14:00:06.082227 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3312/6550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:05 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:07.106358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:07.107901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:07.115820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:07.116360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:07.116814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:07.117544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:07.118016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:07.118455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:07.302845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:07.318893 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-929136ae-0c80-4141-863e-70ce03ba8ace tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.216347 Aug 25 14:00:07.319959 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3239/6551] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:07 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:08.357145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:08.358195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:08.366790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:08.367293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:08.367747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:08.368538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:08.369004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:08.369454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:08.536414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:08.546723 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d89a837-13cf-4988-b52a-3f17336535ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.195023 Aug 25 14:00:08.547331 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3313/6552] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:08 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:09.570350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:09.570963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:09.578967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:09.579486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:09.579936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:09.580710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:09.581174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:09.581605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:09.725017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:09.734858 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d328cb23-b9ad-4ca1-909c-4ec4d1964169 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.168578 Aug 25 14:00:09.735452 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3240/6553] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:09 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:10.757947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:10.758556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:10.766463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:10.766951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:10.767398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:10.768125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:10.768590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:10.769016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:10.916587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:10.926416 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-613719d9-a239-4fbe-b0d0-54825d9651c0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.172321 Aug 25 14:00:10.926820 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3314/6554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:10 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:11.948945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:11.949646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:11.957760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:11.958271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:11.958731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:11.959503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:11.959982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:11.960462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:12.110810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:12.118727 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ddf0a6ff-cc32-4793-9098-c69cae5cfef1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.173827 Aug 25 14:00:12.119822 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3241/6555] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:11 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:13.141953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:13.142575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:13.149671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:13.150166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:13.150607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:13.151316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:13.151763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:13.152217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:13.323146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:13.333585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-43615b6c-c2b6-42b5-8a11-450ed92f6e48 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.196258 Aug 25 14:00:13.334198 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3315/6556] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:13 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:14.355094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:14.355734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:14.365460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:14.365991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:14.366437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:14.367176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:14.367651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:14.368096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:14.518841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:14.527507 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aaa296ff-1dd0-4a44-a3c3-7febeaf2851b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.176254 Aug 25 14:00:14.528229 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3242/6557] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:14 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:15.550080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:15.550677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:15.558003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:15.559540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:15.559540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:15.559834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:15.560207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:15.560647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:15.711602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:15.721577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5476b0f-a2f3-468f-9840-c241a67d9e1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.175200 Aug 25 14:00:15.721800 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3316/6558] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:15 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:16.743083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:16.743718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:16.751996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:16.752534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:16.752992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:16.753709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:16.754183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:16.754621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:16.898018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:16.907140 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7af0f0f5-7475-4b45-b969-a7f3a5b9823a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.168544 Aug 25 14:00:16.907723 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3243/6559] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:16 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:17.928907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:17.929584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:17.937181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:17.937672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:17.938115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:17.938832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:17.939289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:17.939717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:18.080392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:18.088342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-edf8e82b-1838-4ced-85a8-331c2bae1896 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.163393 Aug 25 14:00:18.088931 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3317/6560] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:17 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:19.110998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:19.111631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:19.119020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:19.119527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:19.119988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:19.120753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:19.121222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:19.121723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:19.259909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:19.268608 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0358a3b4-e98a-4fc0-8af5-740ff16102ac tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.162160 Aug 25 14:00:19.269208 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3244/6561] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:19 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:20.290640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:20.291288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:20.301169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:20.301677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:20.302128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:20.302878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:20.303337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:20.303776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:20.470372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:20.478472 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b309c6a9-bf5c-48b3-8564-83ce6936a26d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.191924 Aug 25 14:00:20.479065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3318/6562] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:20 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:21.501383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:21.501947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:21.508955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:21.509458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:21.509910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:21.510628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:21.511106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:21.511540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:21.654385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:21.664397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-08fc0b5b-b331-4d23-b2a4-45b6c24c8ccf tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.168694 Aug 25 14:00:21.665003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3245/6563] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:21 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:22.686220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:22.686871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:22.694731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:22.695311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:22.695801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:22.696559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:22.697614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:22.698054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:22.858841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:22.868263 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32400054-2d15-4327-b342-5e31b4cbe097 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1521 microversion: 2.1 time: 0.186407 Aug 25 14:00:22.868938 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3319/6564] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:22 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:23.317054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "name": "network-vif-unplugged", "status": "completed", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:23.330801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:23.331311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:23.331776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:23.348034 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Creating event network-vif-unplugged:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h1-850468-18 Aug 25 14:00:23.355108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:00:23.370093 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c4bdf639-ad30-4c04-8f39-188c8b4cd10a req-e9a6c65b-f0b0-48a9-b33e-64c960820e12 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057053 Aug 25 14:00:23.370979 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3246/6565] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:00:23.895476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:23.896351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:23.905265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:23.905779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:23.906231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:23.907079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:23.907552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:23.908001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:24.085822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:24.096144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9efd27e-329d-4af3-ac91-cc2933d86849 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1520 microversion: 2.1 time: 0.205063 Aug 25 14:00:24.096968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3320/6566] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:23 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:25.120167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:25.120996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:25.128423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:25.128934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:25.129394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:25.130128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:25.130605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:25.131049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:25.290322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:25.298925 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-545a2863-aa37-4651-a11f-14f3a30f1794 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1518 microversion: 2.1 time: 0.184126 Aug 25 14:00:25.299638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3247/6567] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:25 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:25.393654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:25.404358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:25.404777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:25.405280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:25.418775 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Creating event network-changed:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h1-850468-18 Aug 25 14:00:25.425244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:00:25.438343 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-31e6ef27-32f6-4960-adb8-ee4455037e6f req-49318ccc-d486-4181-9675-1d378aad8dea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048423 Aug 25 14:00:25.438957 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3321/6568] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:00:26.322886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:26.323629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:26.334063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:26.334691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:26.335294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:26.336355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:26.336888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:26.337328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:26.502074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:26.510564 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fd99f24f-09b0-446b-9705-74dce7103573 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1518 microversion: 2.1 time: 0.192958 Aug 25 14:00:26.511190 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3248/6569] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:26 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:27.535908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:27.536650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:27.543187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.543687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.544156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:27.544885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.545341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.545781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:27.707146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:27.716794 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41eb76ca-64b2-460a-8721-42970e4cc9c2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1515 microversion: 2.1 time: 0.186132 Aug 25 14:00:27.717398 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3322/6570] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:27 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:27.738618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:27.739212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:27.747336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.748073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.748614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:27.749478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.749936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.750432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:27.828676 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-772a36b3-c422-4035-bfe0-cfdcd046a204 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d/action" status: 204 len: 0 microversion: 2.1 time: 0.094455 Aug 25 14:00:27.829358 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3249/6571] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:00:27 2022] POST /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:00:27.843252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:27.844461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:27.854486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.855326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.857073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:27.858277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:27.858979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:27.859538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:28.024520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:28.033371 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09be0cf6-3ad0-4809-9b33-38492d60dd9b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1515 microversion: 2.1 time: 0.198861 Aug 25 14:00:28.033959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3323/6572] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:27 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:29.055959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:29.056643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:29.065060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:29.065578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:29.066036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:29.066769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:29.067255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:29.067680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:29.240541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:29.249314 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c6d03d35-6f75-4683-981f-2253ad87d816 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1515 microversion: 2.1 time: 0.197790 Aug 25 14:00:29.249908 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3250/6573] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:29 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:30.274132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:30.274984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:30.284555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:30.285191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:30.285984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:30.286916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:30.287389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:30.287831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:30.435341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:30.444507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f35c64cc-16a6-4bef-9fb0-64bfb12063d8 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1507 microversion: 2.1 time: 0.175239 Aug 25 14:00:30.445133 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3324/6574] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:30 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:30.467083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:30.467722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:30.474762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:30.475256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:30.475714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:30.476592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:30.477139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:30.477697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:30.501014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "name": "network-vif-plugged", "status": "completed", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:30.511212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:30.512698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:30.513226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:30.529447 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] Creating event network-vif-plugged:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h1-850468-18 Aug 25 14:00:30.535156 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ac54a76a-345b-45c2-b11a-dd89fcd69182 req-d4927528-86ad-4bcf-952c-a4041a07814b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038537 Aug 25 14:00:30.536096 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3325/6575] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:00:30.637594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:30.648846 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-309ace5a-56fa-417e-a2c9-1dc5b0da2a1f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1507 microversion: 2.1 time: 0.186690 Aug 25 14:00:30.649447 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3251/6576] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:30 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:30.675176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ba97449-4643-4439-a1da-21c5a55855f2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'create', calling method: .version_select at 0x7fc6c6b23700>, body: {"keypair": {"name": "tempest-keypair-1254210374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtpjERYJPY8Kle2wz0XwCRZEnlJhebSfymOjCPzAaZ87Fha78/beN3ixY37lSIRNWq6Xoe3eBi/UndX1z1xQi98YizEUOStri/WzQVJ7/uCR5CZ6YgQMC/EhT1lfN0vsQ=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:30.703029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5ba97449-4643-4439-a1da-21c5a55855f2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:00:30.712764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-5ba97449-4643-4439-a1da-21c5a55855f2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for user 9b86cb2a034b4f86895d693381009f74 and project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:00:30.750264 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ba97449-4643-4439-a1da-21c5a55855f2 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080422 Aug 25 14:00:30.750885 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3326/6577] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:00:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:00:32.143314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:32.143956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:32.151636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:32.152143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:32.153171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:32.153952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:32.154428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:32.154879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:32.309240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:32.318393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41562f63-2f3c-4b28-97b1-53fcc07dabf0 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 200 len: 1507 microversion: 2.1 time: 0.178964 Aug 25 14:00:32.319012 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3252/6578] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:32 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:32.338893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:32.339527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:32.348218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:32.348898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:32.349162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:32.349877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:32.350344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:32.350778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:32.377471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:00:32.460354 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-232b52b3-07af-40de-943a-b8016700331e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "DELETE /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 204 len: 0 microversion: 2.1 time: 0.125066 Aug 25 14:00:32.460911 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3327/6579] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:00:32 2022] DELETE /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:00:32.522075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1028498628", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "43ebbd16-0875-48fa-9a5a-856544892bc3"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:32.588328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] validate_networks() for [('43ebbd16-0875-48fa-9a5a-856544892bc3', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:00:32.989130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:00:32.989576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:00:32.990077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:00:32.990507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:00:32.990935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:00:33.001312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:33.001810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:33.002262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:33.003003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:33.003471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:33.003911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:33.021419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:00:33.027249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Getting quotas for user 9b86cb2a034b4f86895d693381009f74 and project d5e6adba54c44cba97ede9fcb7b5044b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:00:33.040720 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:00:33.043484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:00:33.094266 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53f58762-a6ae-4331-9cdd-8d703e22fb0d tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576304 Aug 25 14:00:33.094940 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3253/6580] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:00:33.108034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-771477ed-a8cc-470c-873d-830129cbf762 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:33.108880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-771477ed-a8cc-470c-873d-830129cbf762 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:33.180949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-771477ed-a8cc-470c-873d-830129cbf762 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:33.190856 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-771477ed-a8cc-470c-873d-830129cbf762 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1218 microversion: 2.1 time: 0.088270 Aug 25 14:00:33.191471 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3328/6581] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:33 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:34.218178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:34.219567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:34.228575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:34.229410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:34.229906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:34.230697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:34.231738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:34.232239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:34.258402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:34.310086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:34.322544 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-75e853ad-fbb6-42c5-88a4-4dab8ac65980 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1288 microversion: 2.1 time: 0.110688 Aug 25 14:00:34.323980 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3254/6582] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:34 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:35.097365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b6a17d-9a22-428e-9a45-2f3580d81c4d", "name": "network-vif-deleted", "tag": "e102f244-5de0-4636-b03b-f824bc778944"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:35.132616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:35.133776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:35.135070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:35.159902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] Creating event network-vif-deleted:e102f244-5de0-4636-b03b-f824bc778944 for instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d on n-h1-850468-18 Aug 25 14:00:35.166189 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-50da672f-e222-4855-99dc-29a859947146 req-5f55429e-003f-4392-bf6a-e2c4424c59ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084725 Aug 25 14:00:35.167112 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3329/6583] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:00:35.347058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:35.347809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:35.350444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:35.356459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:35.357536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:35.358216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:35.364319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:35.364874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:35.365461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:35.549638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:35.559202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c4aae0a-77d7-4d8b-8ace-8a36475aa767 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.215677 Aug 25 14:00:35.560022 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3255/6584] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:35 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:36.585507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:36.586782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:36.589885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:36.598272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:36.599188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:36.600712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:36.601466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:36.602363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:36.603465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:36.614526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:36.773677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:36.786855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3de124b7-7a19-48e6-8c3a-3117a6fb54af tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.208256 Aug 25 14:00:36.787813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3330/6585] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:36 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:37.187999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:37.198776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:37.200704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:37.201735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:37.214259 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] Creating event network-changed:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h2-850468-18 Aug 25 14:00:37.220638 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-66d6f8ae-be3c-4137-9b62-c852ab3c35aa req-4f77efcf-84b3-4544-8c01-403257ee236c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037629 Aug 25 14:00:37.221300 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3256/6586] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:00:37.809351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:37.810176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:37.818259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:37.818772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:37.819221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:37.819972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:37.820482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:37.820923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:38.003305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:38.012399 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b14c3a5e-821f-4907-9fc1-4c4835679cf5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.206969 Aug 25 14:00:38.013043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3331/6587] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:37 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:39.035771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:39.036575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:39.043731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:39.044274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:39.044740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:39.045478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:39.045953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:39.046407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:39.228711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:39.239550 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e113b917-07cd-41d2-8412-464dbf7fd2b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.209800 Aug 25 14:00:39.240184 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3257/6588] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:39 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:40.263509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:40.263509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:40.274063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:40.274992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:40.275837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:40.277501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:40.278254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:40.279062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:40.453211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:40.462557 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c813cebf-fda1-431e-95a9-d6230ac5ee0a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.204753 Aug 25 14:00:40.463402 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3332/6589] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:40 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:41.485615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:41.486289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:41.493925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:41.494442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:41.494904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:41.496291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:41.496968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:41.497828 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:41.667474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:41.677296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df224b37-b29c-4d9c-a399-85fc0f7e9cec tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.195569 Aug 25 14:00:41.677877 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3258/6590] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:41 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:42.700298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:42.701084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:42.710915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:42.711416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:42.711860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:42.712609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:42.713069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:42.713501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:42.735808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "name": "network-vif-plugged", "status": "completed", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:42.749788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:42.750303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:42.750827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:42.763144 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] Creating event network-vif-plugged:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h2-850468-18 Aug 25 14:00:42.768798 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ef1b9616-56a8-49c1-8f0a-e3db5e454ef0 req-51096edd-c1a0-4a47-9a77-3ad670780e45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038487 Aug 25 14:00:42.769786 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3259/6591] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:00:42.880173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:42.900062 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2a388141-6108-4437-b018-0e63a24b4dd7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.205139 Aug 25 14:00:42.900716 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3333/6592] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:42 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:43.919009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:43.920166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:43.926102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:43.926992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:43.935762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:43.936645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:43.937118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:43.937992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:43.938611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:43.939214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:44.124352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:44.138487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-73d20dbf-cc66-4890-81cc-e2be233e09ae tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1318 microversion: 2.1 time: 0.221144 Aug 25 14:00:44.139193 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3260/6593] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:43 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:45.161537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:45.162231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:45.164253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:00:45.172726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.173233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.173687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.174409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.174869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.175315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.343161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:45.353448 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5df583a5-bf63-4af3-b66f-13168ddcd371 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1508 microversion: 2.1 time: 0.195737 Aug 25 14:00:45.354201 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3334/6594] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:45 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:45.376451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:45.377460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:45.385807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.386894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.387515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.388307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.388780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.389229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.548742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:45.557751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e9e8688a-e637-4125-867c-84b12b62ec13 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1508 microversion: 2.1 time: 0.185936 Aug 25 14:00:45.558690 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3261/6595] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:45 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:45.579304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:00:45.581639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:45.588057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.588578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.589022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.590269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.590871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.591323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.639573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:45.646871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:00:45.657108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:00:45.657534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:00:45.658017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:00:45.658431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:00:45.658884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:00:45.736034 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-222e5798-6c90-46ec-ba4f-41739d32ec86 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3/action" status: 202 len: 0 microversion: 2.1 time: 0.161020 Aug 25 14:00:45.736880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3335/6596] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:00:45 2022] POST /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:00:45.745603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:45.746262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:45.753172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.753630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.754034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.754759 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:45.755231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:45.755667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:45.924979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:45.935165 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9c19a1c8-7b5f-4309-8d31-8378239cd7e5 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1515 microversion: 2.1 time: 0.193564 Aug 25 14:00:45.936386 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3262/6597] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:45 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:46.958609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:46.959239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:46.966742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:46.967239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:46.967683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:46.968443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:46.968904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:46.969345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:47.133339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:47.143938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3802c81-519d-4151-9f75-091c053cf05f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1515 microversion: 2.1 time: 0.190447 Aug 25 14:00:47.144707 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3336/6598] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:46 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:48.169707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:48.171016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:48.181056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:48.182315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:48.182505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:48.183573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:48.184061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:48.184538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:48.394609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:48.410046 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-15b10d6b-e244-4541-a1d2-d2b9a2e3af3c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.247082 Aug 25 14:00:48.411138 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3263/6599] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:48 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:49.447682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:49.448432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:49.458298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:49.458813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:49.459390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:49.460415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:49.461079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:49.461438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:49.651759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:49.667113 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae6c13a4-8dc7-4e30-9c08-1e742f5320dd tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.223574 Aug 25 14:00:49.668304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3337/6600] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:49 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:50.696538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:50.697163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:50.705664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:50.706168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:50.706811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:50.707602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:50.708148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:50.708588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:50.864199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:50.874120 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e489293c-73c9-4780-9903-ea57ada48aca tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.181439 Aug 25 14:00:50.874731 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3264/6601] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:50 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:51.895832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:51.896588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:51.904304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:51.904798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:51.905239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:51.905956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:51.906417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:51.906845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:52.415174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:52.424444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a09f6b31-6db1-4633-80a1-da9eb247a930 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.532808 Aug 25 14:00:52.425056 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3338/6602] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:51 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:53.447794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:53.449270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:53.457156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:53.457694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:53.458147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:53.458875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:53.459347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:53.459788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:53.633223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:53.642616 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b7fc2d8-b5ad-479b-aa92-4d16496e461b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.198838 Aug 25 14:00:53.643229 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3265/6603] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:53 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:54.667105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:54.667772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:54.675282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:54.675776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:54.676258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:54.676984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:54.677443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:54.677874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:54.833976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:54.842523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c3f47314-acd6-46c4-9fab-fbb4de2a2e6b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.179303 Aug 25 14:00:54.843152 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3339/6604] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:54 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:55.874166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:55.875033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:55.883654 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:55.884381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:55.884899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:55.885792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:55.886916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:55.887570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:56.050592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:56.060962 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4edd4ebf-7d42-4015-b371-21e7b27fcb4a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.191427 Aug 25 14:00:56.061708 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3266/6605] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:55 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:57.085420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:57.086041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:57.094263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:57.094890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:57.095198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:57.096004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:57.096420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:57.096975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:57.255327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:57.264206 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a59b0657-1bca-430c-b8c7-17e644ab8074 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.182507 Aug 25 14:00:57.264781 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3340/6606] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:57 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:00:58.286458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:58.287091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:58.294518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:58.295027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:58.295505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:58.296248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:58.296714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:58.297150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:58.454500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:58.463501 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f5f55ec2-d9c8-4d75-b210-e355a9ab39c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.181132 Aug 25 14:00:58.464926 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3267/6607] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:58 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:00:59.486167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:00:59.487165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:00:59.495948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:59.496705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:59.496883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:59.497521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:00:59.497997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:00:59.498455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:00:59.668577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:00:59.676829 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e365f34-b835-4a61-b468-5a8b4ca2d97e tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.194593 Aug 25 14:00:59.677417 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3341/6608] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:00:59 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:00.699901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:00.700597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:00.708169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:00.708797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:00.709151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:00.709894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:00.710549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:00.710996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:00.873631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:00.886115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-389f44be-f89c-4a00-bb6a-b0b25de5a2aa tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.190181 Aug 25 14:01:00.887057 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3268/6609] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:00 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:01.914177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:01.914795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:01.922439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:01.922977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:01.923421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:01.924162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:01.924629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:01.925061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:02.063693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:02.071762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-483a18b4-c86d-4a2a-98ae-d8221f439861 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.161759 Aug 25 14:01:02.072388 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3342/6610] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:01 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:03.093877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:03.094492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:03.102116 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:03.102619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:03.103072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:03.103801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:03.104815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:03.105564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:03.254908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:03.263419 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c759adab-9b4e-4893-81a2-3dd5c96268b4 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.173479 Aug 25 14:01:03.264019 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3269/6611] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:03 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:04.285241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:04.285936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:04.293223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:04.293721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:04.294162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:04.294876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:04.295339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:04.295771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:04.433334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:04.442702 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee187dd9-d3e5-46d6-b5f7-bc18a75498da tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.161296 Aug 25 14:01:04.443288 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3343/6612] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:04 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:05.464882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:05.465433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:05.468220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=30 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:05.473676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:05.474186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:05.474644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:05.475367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:05.475839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:05.476323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:05.479369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=85 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:05.629752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:05.638548 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5b22c53f-ff79-40de-99d5-c52bed3025b3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.178380 Aug 25 14:01:05.639139 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3270/6613] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:05 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:01:06.659928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:06.660684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:06.663675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:06.670508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:06.671386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:06.671877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:06.672670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:06.673134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:06.673572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:06.676687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:06.816754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:06.825202 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-45d49f70-928a-46f2-8868-d9f7f646551b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.169557 Aug 25 14:01:06.825799 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3344/6614] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:06 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:07.845681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:07.846323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:07.853795 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:07.854148 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:07.854572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:07.855310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:07.855782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:07.856267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:08.010083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:08.018672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-14e06927-d062-4574-8102-c10ddf6483c3 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.176845 Aug 25 14:01:08.019272 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3271/6615] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:07 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:09.040922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:09.041569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:09.049323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:09.050135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:09.050255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:09.050920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:09.051370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:09.051799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:09.189160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:09.197043 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23e5a4e2-8825-4cc0-9234-3252015680ef tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.160027 Aug 25 14:01:09.197621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3345/6616] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:09 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:01:10.218581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:10.219256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:10.229366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:10.229869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:10.230949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:10.231696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:10.232189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:10.232637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:10.382418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:10.391143 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1899272b-eb80-4022-9e10-5dd7b699afde tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.176517 Aug 25 14:01:10.391953 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3272/6617] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:10 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:11.416545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:11.418434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:11.430327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:11.431226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:11.432129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:11.434241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:11.435124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:11.436252 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:11.614070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:11.624420 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0a189146-75ef-4936-a976-6c77223bcc74 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.215106 Aug 25 14:01:11.625151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3346/6618] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:11 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:12.646405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:12.647034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:12.656145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:12.656653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:12.657106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:12.657835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:12.658297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:12.658738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:12.796143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:12.804464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d39dad6-352b-4acc-9220-2d61480eb66b tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.162146 Aug 25 14:01:12.805056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3273/6619] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:12 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:13.826028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:13.826571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:13.833570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:13.834060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:13.834534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:13.835237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:13.835698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:13.836145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:13.976745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:13.985694 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04b34263-e3c0-4718-89ff-8de9e49701dc tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1520 microversion: 2.1 time: 0.163733 Aug 25 14:01:13.986287 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3347/6620] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:13 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:15.007389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:15.008050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:15.015334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:15.015831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:15.016314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:15.017029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:15.017495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:15.017935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:15.160560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:15.169440 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-00eba30d-0a7a-4a7e-96d5-78bd1228830a tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1519 microversion: 2.1 time: 0.166191 Aug 25 14:01:15.170044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3274/6621] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:15 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:01:15.233939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "name": "network-vif-unplugged", "status": "completed", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:15.247367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:15.248794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:15.249243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:15.264534 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Creating event network-vif-unplugged:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h1-850468-18 Aug 25 14:01:15.271260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:01:15.283204 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-607c8de8-e10f-4a7d-90d5-7d1aff9013d1 req-50b64cb4-00f1-49f6-801e-622248809b48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054537 Aug 25 14:01:15.284010 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3348/6622] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:16.191750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:16.192404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:16.199489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:16.200798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:16.201270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:16.202016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:16.202485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:16.202925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:16.339047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:16.347207 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3fc68fab-3da6-408a-adf6-3ff8d5563049 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1517 microversion: 2.1 time: 0.159388 Aug 25 14:01:16.347810 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3275/6623] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:16 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:17.304533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:17.316545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:17.317029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:17.317468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:17.329812 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Creating event network-changed:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h1-850468-18 Aug 25 14:01:17.335399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:01:17.346392 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3fa07355-9dd4-48fc-ac9d-ada081cc5b2d req-dca22400-b672-4212-9f7d-f3263c77b917 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047060 Aug 25 14:01:17.347022 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3349/6624] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:17.369190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:17.369889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:17.377628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:17.378145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:17.378612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:17.379336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:17.379839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:17.380294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:17.534543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:17.542813 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f5fc3c1d-faf1-4ed9-a8c9-623e794f2129 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1517 microversion: 2.1 time: 0.177766 Aug 25 14:01:17.543520 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3276/6625] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:17 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:18.566923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:18.567542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:18.574479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:18.575112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:18.575592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:18.576342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:18.576807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:18.577246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:18.718527 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:18.726493 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-567deda6-eb1b-4699-91a4-9b1e1fce9ba9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1517 microversion: 2.1 time: 0.164814 Aug 25 14:01:18.727069 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3350/6626] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:18 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:19.749790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:19.750415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:19.757482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:19.758012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:19.758464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:19.759164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:19.759627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:19.760064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:19.901368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:19.910145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-41878ad3-70cf-4b02-9039-ea394b3acbfb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1514 microversion: 2.1 time: 0.165158 Aug 25 14:01:19.910715 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3277/6627] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:19 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:19.931555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:19.932099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:19.940308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:19.940783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:19.941225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:19.941927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:19.942422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:19.942870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:20.004003 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32a9b9fc-779d-4d56-9570-ec89fda20ad9 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "POST /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3/action" status: 204 len: 0 microversion: 2.1 time: 0.076107 Aug 25 14:01:20.004706 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3351/6628] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:01:19 2022] POST /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:01:20.013199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:20.013843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:20.021013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:20.021511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:20.021983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:20.022694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:20.023161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:20.023640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:20.170834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:20.179045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-93bdfee7-813a-47b1-8af5-5d776289b005 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1514 microversion: 2.1 time: 0.169790 Aug 25 14:01:20.180205 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3278/6629] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:20 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:21.201493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.202451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.210063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.210634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.211425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.212108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.212897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.213400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.362008 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:21.370574 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4e687887-4667-4594-8496-6a8b64230a9f tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1506 microversion: 2.1 time: 0.174057 Aug 25 14:01:21.371164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3352/6630] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:21 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:21.390817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.391457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.398565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.399065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.399518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.400269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.400740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.401178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.546526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:21.554477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0dc2c4ea-80da-4268-9f5a-af23a79a29b1 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1506 microversion: 2.1 time: 0.167608 Aug 25 14:01:21.555095 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3279/6631] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:21 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:21.574509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.575879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.582173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.582654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.583095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.583795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.584288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.584721 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.724289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:21.733970 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-228c60eb-f8fa-4d71-8b25-ea6efe129f28 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1506 microversion: 2.1 time: 0.163380 Aug 25 14:01:21.734553 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3353/6632] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:21 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:21.754374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.754892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.761014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.761515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.761978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.763077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.763565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.764015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.789253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:01:21.872304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4a177d5e-3ccc-4802-a69f-444225baef87 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 204 len: 0 microversion: 2.1 time: 0.121366 Aug 25 14:01:21.872922 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3280/6633] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:21 2022] DELETE /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:01:21.891399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.891915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.899045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.899535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.899976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.900745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.901348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.901627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.929030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:01:21.976522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.compute.api [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Instance is already in deleting state, ignoring this request Aug 25 14:01:21.977339 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-476b46d5-216b-452a-904f-4a5eb27dba61 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 204 len: 0 microversion: 2.1 time: 0.090926 Aug 25 14:01:21.977902 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3354/6634] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:21 2022] DELETE /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:01:21.986998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:21.987705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:21.993823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.994325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.994784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:21.995508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:21.995979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:21.996459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:22.138527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:22.146465 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5a7acaf8-2fef-4303-b048-b80fd7ecfa49 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1512 microversion: 2.1 time: 0.163808 Aug 25 14:01:22.147041 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3281/6635] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:21 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:22.656953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "name": "network-vif-plugged", "status": "completed", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:22.667817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:22.669331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:22.669331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:22.684938 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] Creating event network-vif-plugged:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h1-850468-18 Aug 25 14:01:22.690212 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b910b15e-5dc0-49ac-8dfc-19ea6f90a6f4 req-9b9e3032-19db-49f5-bf53-f2d9f4c9327d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 Aug 25 14:01:22.690897 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3355/6636] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:23.168395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:23.169179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:23.176439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:23.176949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:23.177452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:23.178172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:23.178643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:23.179084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:23.315766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b86cb2a034b4f86895d693381009f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e6adba54c44cba97ede9fcb7b5044b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:23.323804 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e87204fa-f9e3-41b1-a485-a72c22bba044 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 200 len: 1512 microversion: 2.1 time: 0.159458 Aug 25 14:01:23.324435 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3282/6637] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:23 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:23.805015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef36cf5-1b09-4175-8022-3d6fe8b4eeb3", "name": "network-vif-deleted", "tag": "5b9506d6-92a4-4a6f-9c59-43e155ab0491"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:23.816676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:23.817162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:23.817607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:23.829629 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] Creating event network-vif-deleted:5b9506d6-92a4-4a6f-9c59-43e155ab0491 for instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 on n-h1-850468-18 Aug 25 14:01:23.834855 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6eac5e4b-4983-4ea7-9517-66009d77dbd8 req-88ef5304-8895-4df3-a748-62aff27647f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033911 Aug 25 14:01:23.835696 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3356/6638] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:01:24.346760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:24.347286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: bef36cf5-1b09-4175-8022-3d6fe8b4eeb3] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:24.353451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:24.353948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:24.354398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:24.355109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:24.355572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:24.356730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:24.370762 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] HTTP exception thrown: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Request method failure captured: Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 HTTP/1.1 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4BFyN0GZN_FwzaxmZdHGTclzk3yNcdxw6_ol0MKAiIiBT_sAgRvlkd724s-AhnyEJL4HPBmGcfLVZe5un4JaZ318gNP5kXL6GUMg6jAve8quFL62ruFQVqbNo-H3YBCg_j4AnlKA0PShoGX9Ze30AHYYHuH0CSlzhq33KSWX68rLLY Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9b86cb2a034b4f86895d693381009f74 Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'bef36cf5-1b09-4175-8022-3d6fe8b4eeb3'} Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:24.373082 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Returning 404 to user: Instance bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ccdf309-e883-4632-9e5b-3f6d4eef6e46 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3" status: 404 len: 111 microversion: 2.1 time: 0.032925 Aug 25 14:01:24.377083 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3283/6639] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:24 2022] GET /compute/v2.1/servers/bef36cf5-1b09-4175-8022-3d6fe8b4eeb3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:24.383910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1af2380-5d76-42ec-bd99-ed7635a00dbb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '.version_select at 0x7fc6c2585430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:24.406161 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1af2380-5d76-42ec-bd99-ed7635a00dbb tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254210374" status: 202 len: 0 microversion: 2.1 time: 0.026481 Aug 25 14:01:24.406855 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3357/6640] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 14:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254210374 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:01:25.035136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:25.035674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:25.042206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:25.042722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:25.043164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:25.044490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:25.044958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:25.045395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:25.059823 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] HTTP exception thrown: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Request method failure captured: Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d HTTP/1.1 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4BFyN0GZN_FwzaxmZdHGTclzk3yNcdxw6_ol0MKAiIiBT_sAgRvlkd724s-AhnyEJL4HPBmGcfLVZe5un4JaZ318gNP5kXL6GUMg6jAve8quFL62ruFQVqbNo-H3YBCg_j4AnlKA0PShoGX9Ze30AHYYHuH0CSlzhq33KSWX68rLLY Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 9b86cb2a034b4f86895d693381009f74 Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '38b6a17d-9a22-428e-9a45-2f3580d81c4d'} Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:25.061691 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Returning 404 to user: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7b36f0cc-4fac-4677-b3d7-e650f8c4bee7 tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "DELETE /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 404 len: 111 microversion: 2.1 time: 0.032146 Aug 25 14:01:25.065302 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3284/6641] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:01:25 2022] DELETE /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:25.073564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:25.074343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] [instance: 38b6a17d-9a22-428e-9a45-2f3580d81c4d] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:25.081871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:25.082359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:25.082803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:25.083530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:25.083987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:25.084448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:25.097958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] HTTP exception thrown: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Request method failure captured: Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d HTTP/1.1 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4BFyN0GZN_FwzaxmZdHGTclzk3yNcdxw6_ol0MKAiIiBT_sAgRvlkd724s-AhnyEJL4HPBmGcfLVZe5un4JaZ318gNP5kXL6GUMg6jAve8quFL62ruFQVqbNo-H3YBCg_j4AnlKA0PShoGX9Ze30AHYYHuH0CSlzhq33KSWX68rLLY Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d5e6adba54c44cba97ede9fcb7b5044b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: d5e6adba54c44cba97ede9fcb7b5044b Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303049543 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9b86cb2a034b4f86895d693381009f74 Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerDiskConfigTestJSON-303049543-project Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '38b6a17d-9a22-428e-9a45-2f3580d81c4d'} Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:01:25.099676 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] Returning 404 to user: Instance 38b6a17d-9a22-428e-9a45-2f3580d81c4d could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b0c253f9-4390-414b-8fac-6bd609b5959c tempest-ServerDiskConfigTestJSON-303049543 tempest-ServerDiskConfigTestJSON-303049543-project] 10.222.0.60 "GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d" status: 404 len: 111 microversion: 2.1 time: 0.032484 Aug 25 14:01:25.103139 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3358/6642] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:25 2022] GET /compute/v2.1/servers/38b6a17d-9a22-428e-9a45-2f3580d81c4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:01:33.936075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c27b2f2-4bd1-4f8e-a2db-2cbe64e72b08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: .version_select at 0x7fc6c1398b80>, body: {"keypair": {"name": "tempest-keypair-1315040552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaTtOUbgmRWNVuTEnSr3mnpfreR/3yABYfH+r7/rXNzOnBWOXOnUb+CJyAEqqgStw0ybZ3SbeKvUljPpDVTe9m6srOVJeqmnh7VOa2qmcknCFbfLw6lDmAwTlnpGWCdKQ=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:33.958204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4c27b2f2-4bd1-4f8e-a2db-2cbe64e72b08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:01:33.964240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4c27b2f2-4bd1-4f8e-a2db-2cbe64e72b08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:01:33.994033 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c27b2f2-4bd1-4f8e-a2db-2cbe64e72b08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.211778 Aug 25 14:01:33.994647 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3285/6643] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:01:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:35.546278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-836905166", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7f24ba6-69ec-44bb-a1bd-176191f4c3d4"}], "security_groups": [{"name": "tempest-securitygroup--726228393"}], "key_name": "tempest-keypair-1315040552", "user_data": "}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:35.555691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.556397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:35.831570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] validate_networks() for [('d7f24ba6-69ec-44bb-a1bd-176191f4c3d4', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:01:36.261245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:01:36.261785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:01:36.263157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:01:36.263840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:01:36.264498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:01:36.278743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:36.279261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:36.284427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:36.284427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:36.284427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:36.284427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:36.303263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:01:36.311152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:01:36.326778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:01:36.329256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:01:36.393496 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bfa6d7f9-2e93-4e1c-8433-94e2bc95c9bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.853393 Aug 25 14:01:36.394718 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3359/6644] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:01:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:01:36.405983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a1d7aba-0392-4b57-aa22-3aea964fd4a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:36.407350 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a1d7aba-0392-4b57-aa22-3aea964fd4a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:36.411374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:36.414299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:36.576023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8a1d7aba-0392-4b57-aa22-3aea964fd4a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:36.584527 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a1d7aba-0392-4b57-aa22-3aea964fd4a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1238 microversion: 2.1 time: 0.182736 Aug 25 14:01:36.586181 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3286/6645] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:36 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:37.609067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:37.610574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:37.619285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:37.619784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:37.620420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:37.621852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:37.622514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:37.623078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:37.712228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:37.724674 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9801a611-82d8-4e28-b393-0c41966958fa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1290 microversion: 2.1 time: 0.120950 Aug 25 14:01:37.728832 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3360/6646] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:37 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:38.756896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:38.758061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:38.771077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:38.772002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:38.772873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:38.774195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:38.775068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:38.775881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:38.967296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:38.977882 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6fca6728-82f4-4b0f-8f58-dd70316dd96e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.227634 Aug 25 14:01:38.978600 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3287/6647] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:38 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:39.733636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:39.749751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:39.750454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:39.751058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:39.765807 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] Creating event network-changed:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h2-850468-18 Aug 25 14:01:39.771788 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d288bced-dc6a-48ba-a26e-60820f107e6f req-f9130603-7734-4b6c-8c31-b6464250a77b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042346 Aug 25 14:01:39.773120 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3361/6648] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:40.000452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:40.001188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:40.008780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:40.009379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:40.009903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:40.010694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:40.011228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:40.011831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:40.156532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:40.164682 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-808bfac5-0486-41cc-9e5f-546dabb6c43c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.168547 Aug 25 14:01:40.165282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3288/6649] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:39 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:41.189044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:41.189767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:41.196254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:41.196753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:41.197205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:41.197920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:41.198384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:41.198826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:41.343808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:41.351581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-626fa896-e20e-4fa2-8f6f-d10495eb161a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.168643 Aug 25 14:01:41.352173 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3362/6650] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:41 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:42.375584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:42.376263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:42.382767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:42.383304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:42.383853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:42.384623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:42.385104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:42.385554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:42.536042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:42.546966 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f85a45cd-6d03-4564-8345-1558722ead95 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.177627 Aug 25 14:01:42.547567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3289/6651] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:42 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:43.567789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:43.568439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:43.576417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:43.576667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:43.577363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:43.578114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:43.578578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:43.579010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:43.729451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:43.738630 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b96f9ab2-571f-4387-a9e5-60f2f6606ede tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.174654 Aug 25 14:01:43.739229 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3363/6652] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:43 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:44.759888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:44.760656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:44.769087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:44.769598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:44.770069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:44.770812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:44.771284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:44.771726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:44.941959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:44.952805 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e467c85-415c-49cf-8280-be3ad35a46d2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.197157 Aug 25 14:01:44.953420 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3290/6653] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:44 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:45.099985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "name": "network-vif-plugged", "status": "completed", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:45.112564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:45.113304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:45.114078 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:45.130683 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] Creating event network-vif-plugged:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h2-850468-18 Aug 25 14:01:45.136413 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ea44f60d-8531-4ab2-ac09-d255108b0c91 req-e85063d7-4e58-469c-839c-1673c383713d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039988 Aug 25 14:01:45.138274 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3364/6654] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:45.978070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:45.978744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:45.987186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:45.987693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:45.988166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:45.988881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:45.989346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:45.989785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:46.133168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:46.142403 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e2410d9e-236e-43a8-818a-5cd75cf89818 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1363 microversion: 2.1 time: 0.168793 Aug 25 14:01:46.143005 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3291/6655] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:45 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:47.163541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:47.164281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:47.169471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:47.170229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:47.178466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:47.179175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:47.179631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:47.180502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:47.180959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:47.181417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:47.337123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:01:47.346588 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cf564129-43b4-46e7-b474-5292fc996e8a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1550 microversion: 2.1 time: 0.185059 Aug 25 14:01:47.347194 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3365/6656] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:01:47 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1550 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:01:47.367699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:01:47.368765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:01:47.370244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:01:47.376983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:47.377503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:47.377972 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:47.378716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:47.379191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:47.379645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:47.473693 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52122035-f958-4f73-8081-e5eb8cc9a159 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109921 Aug 25 14:01:47.474306 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3292/6657] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:01:47 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:01:48.791801 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:01:48.802963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:01:48.803454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:01:48.803901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:01:48.817329 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] Creating event network-changed:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h2-850468-18 Aug 25 14:01:48.822420 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c6ece274-6de8-4596-a7f2-e6ee0ce809a1 req-09117fe1-9f8a-465a-8ebe-62140ae3a4c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109369 Aug 25 14:01:48.823043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3366/6658] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:18.441531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=15 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:18.442797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=34 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:18.449967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:18.451051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:18.462979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.464529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.465346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.466642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.467504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.468343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.615702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:18.624160 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47ebbbc0-b66e-4845-992a-889c023a0b84 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.186026 Aug 25 14:02:18.624749 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3293/6659] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:18 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:18.643950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:18.644825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:18.649125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:18.649863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:18.658823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.659433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.659911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.660720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.661196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.661732 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.807254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:18.817518 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2557a580-c4c7-4229-ae0c-31cca1df0973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.175545 Aug 25 14:02:18.818113 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3367/6660] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:18 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:18.837635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:18.838264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:18.845522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.846033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.846493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.847217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:18.848099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:18.848099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:18.997530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:19.007171 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8350952a-2388-4d81-b507-bb69baa69896 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.173419 Aug 25 14:02:19.007683 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3294/6661] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:18 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:19.028650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:19.031085 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:19.037800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:19.038386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:19.038936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:19.039416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:19.039872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:19.040411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:19.070848 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:19.077254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:02:19.084140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:02:19.084587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:02:19.085067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:02:19.085481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:02:19.085898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:02:19.160786 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb6f0d80-b6c0-4fb1-874e-6d0b15442e6b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/action" status: 202 len: 0 microversion: 2.1 time: 0.136983 Aug 25 14:02:19.161528 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3368/6662] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:02:19 2022] POST /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:02:19.171554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:19.172262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:19.179827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:19.180382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:19.180848 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:19.181611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:19.182141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:19.183478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:19.340274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:19.348920 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-dcfe8ed1-eadc-4e2e-b53e-d747f046a423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1678 microversion: 2.1 time: 0.182036 Aug 25 14:02:19.349522 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3295/6663] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:19 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:20.372475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:20.373514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:20.380202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:20.380741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:20.381351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:20.381997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:20.382555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:20.382907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:20.540863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:20.555748 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9912fb4a-7c4e-44e2-92db-d5278d2672b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1678 microversion: 2.1 time: 0.189036 Aug 25 14:02:20.556711 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3369/6664] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:20 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:21.578312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:21.578959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:21.586394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:21.586899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:21.587357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:21.588100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:21.588585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:21.589031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:21.735798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:21.744157 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4986e4c4-5b4d-4d9e-9e04-344330fa0ae3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.170520 Aug 25 14:02:21.744748 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3296/6665] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:21 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:22.767686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:22.768424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:22.775318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:22.775814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:22.776458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:22.777179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:22.778056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:22.778056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:22.936889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:22.945470 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2fde962-c729-4d2e-aea3-750d869c3abc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.181619 Aug 25 14:02:22.946097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3370/6666] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:22 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:23.969903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:23.970566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:23.983108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:23.983495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:23.983952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:23.984730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:23.985203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:23.985648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:24.144142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:24.153501 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-207e8291-9f6b-43ea-b9ce-083c6f88500a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.187660 Aug 25 14:02:24.154121 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3297/6667] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:23 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:25.178143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:25.179079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:25.190153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:25.190649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:25.191091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:25.191807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:25.192302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:25.192730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:25.344249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:25.353708 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f3650426-f7d9-438d-be22-44baa718982b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.180567 Aug 25 14:02:25.353708 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3371/6668] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:25 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:26.375431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:26.376098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:26.383328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:26.383827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:26.384311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:26.385661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:26.386181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:26.386718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:26.529119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:26.537609 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5cf7c598-4840-45f0-becd-5febc77d3917 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.166364 Aug 25 14:02:26.538199 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3298/6669] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:26 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:27.561063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:27.561640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:27.568806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:27.569299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:27.569739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:27.570453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:27.570916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:27.571344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:27.708581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:27.716728 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-376b106a-44c2-4f6b-8f32-f4b5d1709ff3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.160722 Aug 25 14:02:27.717310 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3372/6670] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:27 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:28.738804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:28.739358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:28.746413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:28.746938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:28.747416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:28.748170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:28.748629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:28.749079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:28.887598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:28.895646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0711d86e-7ec3-423a-8b6b-3fe9caa3f4b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.160992 Aug 25 14:02:28.896254 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3299/6671] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:28 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:29.917876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:29.918508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:29.924960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:29.925453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:29.925901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:29.926620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:29.927087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:29.927563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:30.062250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:30.071071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ca3d806-6105-4bbb-9fb0-2fc12753aeee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.157080 Aug 25 14:02:30.072053 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3373/6672] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:29 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:31.096058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:31.096745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:31.103661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:31.104193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:31.105287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:31.106166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:31.106639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:31.107088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:31.247031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:31.254960 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-48f29ea0-06bb-440d-8b31-d2243b1c545f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.162797 Aug 25 14:02:31.255539 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3300/6673] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:31 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:32.278157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:32.278857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:32.286022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:32.286532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:32.286981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:32.287702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:32.288184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:32.288624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:32.450331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:32.458560 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5cef0053-8ff4-47c4-80b4-97fdb2f96c99 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1683 microversion: 2.1 time: 0.185172 Aug 25 14:02:32.459199 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3374/6674] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:32 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:33.485407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:33.486063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:33.493242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:33.493688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:33.494145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:33.495511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:33.495885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:33.496369 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:33.622947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "name": "network-vif-unplugged", "status": "completed", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:33.633928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:33.634416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:33.634845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:33.649036 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Creating event network-vif-unplugged:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h1-850468-18 Aug 25 14:02:33.657235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] Instance 0b587c23-1cad-4143-9da1-5c615dfaffde is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:02:33.661725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:33.670767 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-157d2503-c225-4be4-ba82-f927caeac9bb req-3734d0e9-63cb-4c9d-ba3c-48afc2509df8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139951 Aug 25 14:02:33.671806 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3375/6675] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:33.675654 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d5b0d687-1c21-49d0-89ba-57a4b344c8d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1682 microversion: 2.1 time: 0.194055 Aug 25 14:02:33.676317 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3301/6676] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:33 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:34.701300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:34.701967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:34.708362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:34.708857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:34.709312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:34.710045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:34.710482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:34.711359 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:34.845958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:34.853892 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f4e01f3f-5f17-4094-b08f-252571ffa809 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1680 microversion: 2.1 time: 0.158681 Aug 25 14:02:34.855252 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3376/6677] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:34 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:35.695935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:35.706678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:35.707196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:35.707647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:35.720239 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Creating event network-changed:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h1-850468-18 Aug 25 14:02:35.725852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] Instance 0b587c23-1cad-4143-9da1-5c615dfaffde is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:02:35.737619 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c8635c66-9cc0-43ab-9865-dda631cf6a18 req-4ccd68c1-248a-4d18-ab33-2455f27d64bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045437 Aug 25 14:02:35.738267 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3302/6678] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:35.876457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:35.879936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:35.884993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:35.885354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:35.886454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:35.887172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:35.887628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:35.888095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:36.041936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:36.051610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36e212bf-b3dc-4bf4-9145-b5e36cfa3885 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1680 microversion: 2.1 time: 0.179225 Aug 25 14:02:36.052374 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3377/6679] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:35 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:37.077454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:37.078181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:37.085517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.086029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.086476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.087194 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:37.087891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:37.088451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:37.236774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:37.244948 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1fbb32bb-f0c4-4395-adaa-fbb436c671b4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1680 microversion: 2.1 time: 0.173683 Aug 25 14:02:37.245768 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3303/6680] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:37 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:38.267512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:38.268208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:38.275109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.275597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.276688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.277398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.277861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.278297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.411259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:38.419318 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d1480c01-0406-4ed2-8c12-d335d9d5c0bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1677 microversion: 2.1 time: 0.155656 Aug 25 14:02:38.419910 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3378/6681] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:38 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:38.440686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:38.441239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:38.449070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.449567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.450022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.450742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.451305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.451749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.514620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-39df4aa8-8e6a-4b1a-b355-321dee02a132 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/action" status: 204 len: 0 microversion: 2.1 time: 0.077853 Aug 25 14:02:38.515321 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3304/6682] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:02:38 2022] POST /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:02:38.523543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:38.524227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:38.531276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.531864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.532407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.533224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:38.533882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:38.534562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:38.684353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:38.692964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-debd56a0-ab69-4c4b-9fae-e22c6e488821 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1677 microversion: 2.1 time: 0.173315 Aug 25 14:02:38.694004 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3379/6683] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:38 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:39.718236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:39.719251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:39.726166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:39.726675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:39.727133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:39.727877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:39.728373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:39.728819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:39.895799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:39.905335 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6aede8ba-86d2-46dd-a0d0-fc09a6637aa3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.193183 Aug 25 14:02:39.905942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3305/6684] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:39 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:39.929156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:39.930075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:39.939353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:39.939980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:39.940497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:39.941317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:39.941851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:39.942358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.096499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:40.105149 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34c3f4db-9a6f-4d33-a41d-2652fa192aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.181719 Aug 25 14:02:40.105756 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3380/6685] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:39 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:40.126568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:40.127221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:40.137493 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.138093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.138588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.139395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.140130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.140415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.291129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:40.300438 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c48332e-d86f-409a-8582-07830233434a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1669 microversion: 2.1 time: 0.177759 Aug 25 14:02:40.301048 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3306/6686] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:40 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:40.322259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:40.323474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:40.330299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.330798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.331247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.331963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.332466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.332904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.361326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:02:40.398626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:40.458670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92ef1e83-4db9-4ad8-8a5b-615586fd26b1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 204 len: 0 microversion: 2.1 time: 0.140417 Aug 25 14:02:40.459286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3381/6687] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:02:40 2022] DELETE /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:02:40.468471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:40.469104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:40.475201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.475700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.476192 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.476903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.477366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.477810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.612302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:40.620993 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2c93fb97-0863-4ade-b31f-d146e4064252 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1675 microversion: 2.1 time: 0.156267 Aug 25 14:02:40.621571 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3307/6688] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:40 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:40.866497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "name": "network-vif-plugged", "status": "completed", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:40.877444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:40.877687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:40.878138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:40.891426 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] Creating event network-vif-plugged:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h1-850468-18 Aug 25 14:02:40.896444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e9a5a992-c267-4878-aa18-beae33ce8096 req-14dde703-d1b5-454a-bb05-6c5881764900 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Aug 25 14:02:40.897217 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3382/6689] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:41.642895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:41.643543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:41.651081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:41.651600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:41.652062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:41.653551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:41.653889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:41.654338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:41.801220 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:41.803719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:41.810936 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3320622-99e5-40fd-9360-e0f188f2dfd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1675 microversion: 2.1 time: 0.172128 Aug 25 14:02:41.811544 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3308/6690] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:41 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:42.833811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:42.834530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:42.842123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:42.842630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:42.843090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:42.843807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:42.844297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:42.844740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:42.996369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:43.005013 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4abc1fda-f82f-4ece-9a04-54ee71bc69e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 200 len: 1675 microversion: 2.1 time: 0.176296 Aug 25 14:02:43.005489 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3383/6691] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:42 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:43.464897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b587c23-1cad-4143-9da1-5c615dfaffde", "name": "network-vif-deleted", "tag": "04a412fe-9e70-481e-8f2e-98a4a1e56a20"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:43.478316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:43.478865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:43.479264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:43.493397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] Creating event network-vif-deleted:04a412fe-9e70-481e-8f2e-98a4a1e56a20 for instance 0b587c23-1cad-4143-9da1-5c615dfaffde on n-h1-850468-18 Aug 25 14:02:43.500311 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ea4d0f55-471b-415e-8cc7-2b3f5984395e req-419a50a4-05c6-4a68-b592-1a5e7c66b2ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Aug 25 14:02:43.501670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3309/6692] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:44.027174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:44.028879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:44.036717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.037322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.037780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.038521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.038987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.039452 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.054698 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde HTTP/1.1 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b587c23-1cad-4143-9da1-5c615dfaffde'} Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:44.056437 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e68be42d-21b4-4743-a51b-3cb103be73cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 404 len: 111 microversion: 2.1 time: 0.034654 Aug 25 14:02:44.063042 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3384/6693] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:44 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:02:44.075956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:44.076857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:44.083371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.083979 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.084527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.085317 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.085867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.086368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.101636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde HTTP/1.1 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0b587c23-1cad-4143-9da1-5c615dfaffde'} Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:02:44.103456 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:02:44.108887 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f79a898-c595-4d24-8fe8-5c6f88ef6875 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 404 len: 111 microversion: 2.1 time: 0.036947 Aug 25 14:02:44.110104 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3310/6694] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:44 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:02:44.162201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-686318596", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "d7f24ba6-69ec-44bb-a1bd-176191f4c3d4"}], "security_groups": [{"name": "tempest-securitygroup--726228393"}], "key_name": "tempest-keypair-1315040552", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:44.295548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] validate_networks() for [('d7f24ba6-69ec-44bb-a1bd-176191f4c3d4', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:02:44.832042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:02:44.832506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:02:44.833002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:02:44.833615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:02:44.833853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:02:44.849924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.850733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.851507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.852824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:44.853638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:44.854390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:44.890470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:02:44.900890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:02:44.916835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:02:44.919891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:02:44.974677 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42c2b8a8-46dc-4684-86ff-9dea3665a32c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816324 Aug 25 14:02:44.976387 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3385/6695] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:02:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:02:44.987989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c49c80d-87f1-4c1d-a4e8-f712ecd7027b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:44.988959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c49c80d-87f1-4c1d-a4e8-f712ecd7027b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:45.062760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4c49c80d-87f1-4c1d-a4e8-f712ecd7027b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:45.074780 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c49c80d-87f1-4c1d-a4e8-f712ecd7027b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1238 microversion: 2.1 time: 0.090156 Aug 25 14:02:45.076805 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3311/6696] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:44 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:46.102637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:46.103203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:46.111581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:46.112071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:46.112543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:46.113262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:46.113750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:46.114182 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:46.540461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:46.550322 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6135074-7df7-4e35-8180-7f2f55a39b6e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1290 microversion: 2.1 time: 0.452603 Aug 25 14:02:46.550976 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3386/6697] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:46 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1290 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:47.575956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:47.577872 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:47.587645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:47.589193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:47.589729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:47.591140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:47.591953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:47.592782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:47.759504 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:47.772410 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-df64c888-308d-4378-a206-8031e3f09311 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.201839 Aug 25 14:02:47.773622 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3312/6698] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:47 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:48.047124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:48.063727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:48.064347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:48.065032 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:48.080475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] Creating event network-changed:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h1-850468-18 Aug 25 14:02:48.085757 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5fa0b47a-7b77-437d-aaa3-eefb482ce7ee req-86818f3d-daf5-40b9-abbe-f288908bdc13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044624 Aug 25 14:02:48.086560 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3387/6699] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:02:48.799362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:48.799975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:48.802920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=43 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:48.808581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:48.809129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:48.809814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:48.810821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:48.811292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:48.811732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:48.966843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:48.975487 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9ae1b3f9-5764-45f8-b65b-f456a96ae921 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.180259 Aug 25 14:02:48.976101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3313/6700] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:48 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:50.000620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:50.001502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:50.003864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:50.010139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:50.010632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:50.011073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:50.012033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:50.012476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:50.013104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:50.156679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:50.165014 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c56dc2d-8a23-40a6-94dc-051d2ec7e315 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.170822 Aug 25 14:02:50.165608 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3388/6701] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:49 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:51.188762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:51.189930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:51.198222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:51.198783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:51.200047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:51.200909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:51.201464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:51.201917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:51.357165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:51.366049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f64ae24-111c-4f3b-ae29-ca64f99b8dd6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.183904 Aug 25 14:02:51.366646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3314/6702] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:51 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:52.390107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:52.390868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:52.400172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:52.400775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:52.401258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:52.402101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:52.402621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:52.403381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:52.581637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:52.591175 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8488009d-0bbd-4f3b-90e1-7df477114bea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.205892 Aug 25 14:02:52.591871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3389/6703] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:52 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:02:53.614591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:53.615227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:53.622441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:53.622947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:53.623412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:53.624151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:53.624627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:53.625066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:53.777164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:53.786296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1046250a-75d8-41a0-986b-4b13c539e80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.175584 Aug 25 14:02:53.787095 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3315/6704] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:53 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:54.808560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:54.809628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:54.820169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:54.820700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:54.821152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:54.821930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:54.822392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:54.822820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:54.869473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:54.910769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:54.968222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "name": "network-vif-plugged", "status": "completed", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:54.981802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:54.982575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:54.983395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:54.983788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:54.993636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af43972c-e566-455b-9b89-8d281bc47984 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.189247 Aug 25 14:02:54.994260 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3390/6705] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:54 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:55.000222 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] Creating event network-vif-plugged:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h1-850468-18 Aug 25 14:02:55.003600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0e567a49-2579-4f1c-aa6f-2f26e88b3e91 req-517eae6b-46d5-443e-8229-81b9b243c923 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040051 Aug 25 14:02:55.004427 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3316/6706] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:02:56.017053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:56.017665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:56.025072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:56.025575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:56.026012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:56.026731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:56.027718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:56.028163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:56.175449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:56.184558 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f9db99b1-bc51-422b-8549-224f866c7423 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1363 microversion: 2.1 time: 0.171035 Aug 25 14:02:56.185467 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3391/6707] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:56 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:57.203595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:02:57.208925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:57.209650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:57.216845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.217349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.218319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.219034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.219497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.219934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.358669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:02:57.366730 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6b03832-96df-4b4f-aad9-efe9d39278fd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1550 microversion: 2.1 time: 0.164082 Aug 25 14:02:57.367318 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3317/6708] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:02:57 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:02:57.388861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:02:57.389431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:02:57.397538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.398121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.398643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.399349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:57.399874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:57.400274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:57.485909 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-899a954b-3b3d-45fb-b96c-c3bbd106f2c8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102204 Aug 25 14:02:57.486507 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3392/6709] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:02:57 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:02:58.489380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:02:58.499857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:02:58.500781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:02:58.500892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:02:58.512493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] Creating event network-changed:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h1-850468-18 Aug 25 14:02:58.518039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-36aa8785-575e-4733-8510-c2017b3232ea req-23cb9df4-9990-4f9b-be28-524988d17b17 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 Aug 25 14:02:58.518652 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3318/6710] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:10.495951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=9 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:10.496716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:10.498222 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:04:10.498377 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action (ip 10.222.0.60) !!! Aug 25 14:04:10.505206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:10.514080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:10.514561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:10.515007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:10.540213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Going to try to stop instance {{(pid=122701) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 14:04:10.585536 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3fc64bc0-dbac-4545-a260-f03d43be0ad8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action" status: 202 len: 0 microversion: 2.1 time: 0.092103 Aug 25 14:04:10.586151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3393/6711] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:10 2022] POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:04:10.593539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:10.594340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=39 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:10.596006 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:04:10.596211 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 (ip 10.222.0.60) !!! Aug 25 14:04:10.603371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:10.604108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:10.614074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:10.614576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:10.615028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:10.615770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:10.616281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:10.616724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:10.755059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:10.763505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d3ae6d2c-6602-4ac9-a5ea-f0addadbcf08 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.172724 Aug 25 14:04:10.764085 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3319/6712] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:10 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:11.787555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:11.788643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:11.795870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:11.796489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:11.796935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:11.797644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:11.798175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:11.798598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:11.939884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:11.947744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cbd672c2-5087-4ab9-935b-751d66920664 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.166588 Aug 25 14:04:11.948349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3394/6713] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:11 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:12.971669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:12.972333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:12.979437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:12.979941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:12.980430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:12.981146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:12.981714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:12.982074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:13.119983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:13.129221 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ab46035d-4d53-4805-937c-5443ea585027 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.162346 Aug 25 14:04:13.129836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3320/6714] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:12 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:14.151471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:14.152086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:14.160804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:14.161297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:14.161735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:14.162439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:14.162893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:14.163320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:14.297238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:14.306166 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-342cacf8-14ad-44f6-8f59-bed968d5179e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.158614 Aug 25 14:04:14.306750 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3395/6715] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:14 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:15.327314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:15.327951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:15.335320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:15.335852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:15.336332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:15.337063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:15.337532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:15.337976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:15.480677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:15.489894 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-77521900-40a8-45dc-9949-ed2102c9071b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.166420 Aug 25 14:04:15.490482 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3321/6716] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:15 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:16.513391 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:16.513946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:16.521245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:16.521729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:16.522176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:16.522887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:16.523335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:16.523762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:16.687674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:16.697217 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-46eb1404-c0d4-4104-8eb6-0c1aa10af861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.187066 Aug 25 14:04:16.697863 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3396/6717] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:16 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:17.719045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:17.719681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:17.727845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:17.728418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:17.728906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:17.729728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:17.730207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:17.730703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:17.873487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:17.881834 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bdd4bce-754f-4f6c-83cb-95b3fbd173df tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.166658 Aug 25 14:04:17.882435 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3322/6718] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:17 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:18.902919 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:18.903541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:18.910654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:18.911162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:18.911606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:18.912347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:18.912812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:18.913245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:19.048025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:19.056576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2eb46369-8383-4f24-8a74-33f110a42169 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.157515 Aug 25 14:04:19.057287 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3397/6719] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:18 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:20.077951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:20.078585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:20.085612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:20.086057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:20.086513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:20.087227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:20.087697 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:20.088160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:20.231144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:20.240219 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ef96dcf-367e-4794-9d52-f4205a7079d9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.165503 Aug 25 14:04:20.240809 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3323/6720] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:20 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:21.262097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:21.262910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:21.270945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.271442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.271879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.272616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.273074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.273498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.413127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:21.420995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-12683eb5-1162-4d0c-9283-7b4981f87261 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1656 microversion: 2.1 time: 0.162857 Aug 25 14:04:21.421575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3398/6721] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:21 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:21.443064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:21.445386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:21.452604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.453104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.453559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.454278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.454751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.455203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.484324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:21.490890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122700) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:04:21.497847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:04:21.498281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:04:21.498771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:04:21.499193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:04:21.499621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:04:21.577722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37ef1b7a-700a-4c81-8aa5-01ec3727f8cd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action" status: 202 len: 0 microversion: 2.1 time: 0.139354 Aug 25 14:04:21.578345 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3324/6722] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:21 2022] POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:04:21.587211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:21.587844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:21.593997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.594495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.594943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.595656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:21.596139 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:21.596575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:21.737539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:21.746078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-09212a4f-50b6-4f4a-8310-b723d4d486bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.163391 Aug 25 14:04:21.746667 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3399/6723] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:21 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:22.769260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:22.770532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:22.777863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:22.778430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:22.778830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:22.779547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:22.780023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:22.780502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:22.929256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:22.938288 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8ec58fd-242b-46e9-9bcd-4d036cb7286b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1679 microversion: 2.1 time: 0.173821 Aug 25 14:04:22.939233 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3325/6724] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:22 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:23.960666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:23.961299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:23.968871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:23.969368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:23.969822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:23.970536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:23.971000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:23.971437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:24.105800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:24.114112 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7bcf64aa-d23d-4ff3-836a-bec11bd290e9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1684 microversion: 2.1 time: 0.157151 Aug 25 14:04:24.114704 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3400/6725] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:23 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:25.135758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:25.136461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:25.143284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:25.143788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:25.144277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:25.144996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:25.145465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:25.145902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:25.280482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:25.289095 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-88c1bdd2-881b-407f-af1e-14ce8c3047ea tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1684 microversion: 2.1 time: 0.157225 Aug 25 14:04:25.289677 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3326/6726] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:25 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:26.281669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "name": "network-vif-unplugged", "status": "completed", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:26.293153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:26.293629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:26.294170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:26.308142 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Creating event network-vif-unplugged:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h2-850468-18 Aug 25 14:04:26.311992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:26.312662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:26.314322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:04:26.322571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:26.323092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:26.323551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:26.324305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:26.325809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:26.326152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:26.326434 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-75d63c74-1aa3-4e7e-9c2d-f30f5d2bdc35 req-d2567d91-ec4d-4444-b4cb-f5714a1be7cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048799 Aug 25 14:04:26.327233 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3401/6727] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:26.470962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:26.480664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-84075145-e913-4b4f-bfc8-4862d1ac6cb0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1683 microversion: 2.1 time: 0.173035 Aug 25 14:04:26.481260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3327/6728] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:26 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:27.505089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:27.505705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:27.511988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:27.512509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:27.512956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:27.513658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:27.514118 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:27.514548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:27.656107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:27.664349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-110ce58d-f90f-4712-8add-b2ac62ad36cf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1681 microversion: 2.1 time: 0.165061 Aug 25 14:04:27.664937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3402/6729] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:27 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:28.364696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:28.374257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.374752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.375198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.388781 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Creating event network-changed:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h2-850468-18 Aug 25 14:04:28.394488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:04:28.408101 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3981786b-dc59-4e9c-9b1f-285805bf7b12 req-7d5abb72-ebc2-4425-ad44-9db19c74cc62 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047931 Aug 25 14:04:28.408927 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3328/6730] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:28.686642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:28.687392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:28.694929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.695508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.696012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.696929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.697479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.697795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.839092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:28.847324 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-88c85b8e-33bf-4895-84c1-7fb7208a6898 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1677 microversion: 2.1 time: 0.165511 Aug 25 14:04:28.848604 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3403/6731] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:28 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:28.870894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:28.871632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:28.880274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.881172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.881501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.882703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.883155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.883913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.951225 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64dd7aee-045b-420f-bac3-36e09b2492a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action" status: 204 len: 0 microversion: 2.1 time: 0.084479 Aug 25 14:04:28.951907 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3329/6732] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:28 2022] POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:04:28.963153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:28.964156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:28.972257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.973057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.973620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:28.974380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:28.974829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:28.975266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:29.217780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:29.226808 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f252e31-277f-4cdc-a557-befd3657a69e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1677 microversion: 2.1 time: 0.269529 Aug 25 14:04:29.227418 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3404/6733] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:28 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:30.250273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:30.250997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:30.258368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:30.258880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:30.259339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:30.260062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:30.260566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:30.261034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:30.412729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:30.420981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b47a0a40-f8d1-48e6-98f9-dbadb755d11f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1677 microversion: 2.1 time: 0.174962 Aug 25 14:04:30.421575 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3330/6734] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:30 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:31.443724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:31.444533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:31.452263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.452759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.453202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.453909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.454817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.454817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.528423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "name": "network-vif-plugged", "status": "completed", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:31.553531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.554322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.554784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.569890 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] Creating event network-vif-plugged:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h2-850468-18 Aug 25 14:04:31.575953 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4c2a91ea-ad9b-4a5a-aa6a-ca581152d430 req-2179b365-9010-4ab3-8188-40b1fe90bfaf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124949 Aug 25 14:04:31.576629 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3331/6735] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:04:31.637896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:31.647102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f1f57151-fd2e-4f71-8dd8-fbf003117cbd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1656 microversion: 2.1 time: 0.208433 Aug 25 14:04:31.647712 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3405/6736] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:31 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1656 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:31.670096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:31.670871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:31.678485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.679003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.679460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.680191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.680661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.681136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.829106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:31.837224 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f58b44fe-46be-4df9-9e9c-51c6e596a3f7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1656 microversion: 2.1 time: 0.171374 Aug 25 14:04:31.837819 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3332/6737] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:31 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:31.858369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:31.865377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.865895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.866333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.890161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Going to try to start instance {{(pid=122701) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 14:04:31.935888 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ec7a97b-4a29-49dd-afe7-06487782c700 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action" status: 202 len: 0 microversion: 2.1 time: 0.081879 Aug 25 14:04:31.936539 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3406/6738] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:04:31 2022] POST /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:04:31.944980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:31.945657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:31.951771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.952314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.952770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:31.953480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:31.954040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:31.954489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:32.094065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:32.102107 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-12279baa-8c8d-4920-9e20-c5e27e18ec98 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1665 microversion: 2.1 time: 0.161083 Aug 25 14:04:32.102688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3333/6739] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:31 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:33.124561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:33.125262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:33.133114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:33.133617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:33.134056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:33.134743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:33.135200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:33.135628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:33.270349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:33.274531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:33.280524 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b3b48cbc-f202-4fb1-b32c-0f7e15252b4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1665 microversion: 2.1 time: 0.161011 Aug 25 14:04:33.281125 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3407/6740] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:33 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:34.302631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:34.303678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:34.311140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.311649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.312123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.312852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.313324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.313773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.317931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:34.465604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:34.475573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1fb48083-9092-4906-ae2c-b5b6604aad64 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1669 microversion: 2.1 time: 0.177514 Aug 25 14:04:34.476222 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3334/6741] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:34 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:34.496604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:34.497290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:34.505529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.506035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.506488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.507217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.507687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.508151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.539362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:04:34.634800 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a11193c-8e5b-404b-bdb4-b1aab3a2384f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 204 len: 0 microversion: 2.1 time: 0.141958 Aug 25 14:04:34.635627 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3408/6742] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:04:34 2022] DELETE /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:04:34.645099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:34.646359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:34.656028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.656682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.657155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.657922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:34.658403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:34.658857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:34.813508 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:34.822780 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a4ed21f-166e-4a2b-95c2-a1d334a01fb3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1675 microversion: 2.1 time: 0.181909 Aug 25 14:04:34.823391 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3335/6743] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:34 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:35.844425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:35.845136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:35.853121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:35.853612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:35.854051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:35.854942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:35.855877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:35.856339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:36.009237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:36.023903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8757246c-22df-4a0f-a86d-717f8b23a6a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1675 microversion: 2.1 time: 0.183841 Aug 25 14:04:36.038593 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3409/6744] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:35 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:36.929981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0541899-d67e-46a5-aa4e-ec5ab6ff69a2", "name": "network-vif-deleted", "tag": "146de82d-daa0-4871-8b8d-f61526cfa3bd"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:36.945090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:36.945896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:36.946531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:36.963396 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] Creating event network-vif-deleted:146de82d-daa0-4871-8b8d-f61526cfa3bd for instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 on n-h2-850468-18 Aug 25 14:04:36.971928 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-66164e18-1658-4d37-b3c3-0daaf95db413 req-2bce3687-dc28-4a4f-8485-bd4d3a4f4dfb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046987 Aug 25 14:04:36.972866 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3336/6745] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:37.046977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:37.047854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:37.056626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:37.057813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:37.058396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:37.059837 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:37.060498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:37.061058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:37.105854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:37.106349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:37.106806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:37.107259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lazy-loading 'fault' on Instance uuid d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:04:37.153624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:37.162429 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c5d58cd3-f24b-41fb-910e-3c83f0de6414 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 200 len: 1328 microversion: 2.1 time: 0.119440 Aug 25 14:04:37.163176 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3410/6746] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:37 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:38.187694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:38.188575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:38.196728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.197243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.198012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.200754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.200754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.200754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.214803 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 HTTP/1.1 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd0541899-d67e-46a5-aa4e-ec5ab6ff69a2'} Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:04:38.216530 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9073b053-7c4f-439f-bfb5-252d8e2662f3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 404 len: 111 microversion: 2.1 time: 0.035295 Aug 25 14:04:38.221574 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3337/6747] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:38 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:04:38.234310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:38.235677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:38.244055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.244633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.245136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.245855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.246317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.246771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.266545 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 HTTP/1.1 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd0541899-d67e-46a5-aa4e-ec5ab6ff69a2'} Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:04:38.268358 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b65043d3-2190-4271-81a7-63f6fb9621d8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 404 len: 111 microversion: 2.1 time: 0.039547 Aug 25 14:04:38.273096 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3411/6748] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:38 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:04:38.322590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-962656947", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "d7f24ba6-69ec-44bb-a1bd-176191f4c3d4"}], "security_groups": [{"name": "tempest-securitygroup--726228393"}], "key_name": "tempest-keypair-1315040552", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:38.433976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] validate_networks() for [('d7f24ba6-69ec-44bb-a1bd-176191f4c3d4', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:04:38.927762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:04:38.928243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:04:38.928742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:04:38.929169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:04:38.929600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:04:38.939885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.940656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.941151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.941913 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:38.942521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:38.942964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:38.962216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:04:38.968004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:04:38.983280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:04:38.985806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:04:39.041632 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b1b8c3e6-76fb-46e3-9602-910d3eaa1820 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.723110 Aug 25 14:04:39.042443 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3338/6749] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:04:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:04:39.058262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e0c4c42e-f8d3-4893-ad2e-5202bb821e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:39.060319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e0c4c42e-f8d3-4893-ad2e-5202bb821e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:39.135356 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e0c4c42e-f8d3-4893-ad2e-5202bb821e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:39.143915 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e0c4c42e-f8d3-4893-ad2e-5202bb821e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1238 microversion: 2.1 time: 0.093630 Aug 25 14:04:39.144549 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3412/6750] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:39 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:04:40.169419 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:40.170324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:40.180085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.181029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.181661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.182626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:40.183281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:40.184108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:40.255933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:40.269984 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2ead3298-3ebf-4217-8b37-63564e463624 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1298 microversion: 2.1 time: 0.105647 Aug 25 14:04:40.282345 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3339/6751] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:40 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:41.293468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:41.294146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:41.300525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:41.303481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.304393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.305121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.305945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.306639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.307186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.459199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:41.467293 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d5a26600-1f18-4f87-89f1-71530eedbd6a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.178015 Aug 25 14:04:41.467878 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3413/6752] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:41 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:41.765482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:41.774815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:41.784288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:41.784914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:41.785435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:41.804673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] Creating event network-changed:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:04:41.811503 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c3cc124d-eae2-46f5-89f0-95dc1531e2c9 req-0870c2a0-e37c-4d46-b59f-382ac7cabf36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050141 Aug 25 14:04:41.812417 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3340/6753] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:42.491921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:42.492657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:42.500533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:42.501040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:42.502181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:42.502993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:42.503486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:42.503931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:42.662378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:42.670289 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6ed0e21f-dc53-412f-b01a-89e2b1116e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.183006 Aug 25 14:04:42.670888 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3414/6754] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:42 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:43.692831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:43.695444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:43.703514 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.704019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.704575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.705241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:43.705705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:43.706146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:43.859376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:43.869126 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a3b849f4-2087-4d0b-b3c1-30f641cf9ed4 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.181368 Aug 25 14:04:43.869739 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3341/6755] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:43 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:44.895806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:44.896479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:44.904282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:44.904781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:44.905221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:44.905939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:44.906515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:44.906949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:45.056142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:45.065495 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-883e807c-7ef8-48a3-b675-b6cf22ea198a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.177667 Aug 25 14:04:45.066108 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3415/6756] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:44 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:46.109907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:46.110833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:46.127840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:46.128803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:46.130314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:46.131688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:46.132630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:46.133374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:46.350178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:46.363031 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fb2f24c3-43bd-4cdb-a33d-e647b48357bd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.260778 Aug 25 14:04:46.363545 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3342/6757] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:46 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:47.390947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:47.391992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:47.401432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:47.401966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:47.402430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:47.403249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:47.403852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:47.404455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:47.558000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "name": "network-vif-plugged", "status": "completed", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:47.566380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:47.574155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:47.574660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:47.575676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:47.576361 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36ee0d6f-0521-4c1e-86a6-48f157d9c9ec tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.190054 Aug 25 14:04:47.577150 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3416/6758] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:47 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:47.597626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] Creating event network-vif-plugged:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:04:47.605132 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-20128c57-860b-4e13-ad09-78064ca57c6f req-0df9f367-1190-4a9a-bfb7-cf2c20301301 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051341 Aug 25 14:04:47.606022 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3343/6759] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:48.599733 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:48.600336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:48.607755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:48.608259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:48.608717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:48.609447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:48.609927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:48.610353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:48.768876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:48.784977 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ae0722f-bfdb-4d21-9004-6469c04f49b0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1363 microversion: 2.1 time: 0.188635 Aug 25 14:04:48.785992 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3417/6760] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:48 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:49.813475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:49.814199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:49.818599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:49.819345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:49.828169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:49.828688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:49.829147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:49.829875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:49.830354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:49.830806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:49.979011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:04:49.989390 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f693674-c703-43a1-9fad-8b95127ee49d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1551 microversion: 2.1 time: 0.177796 Aug 25 14:04:49.990011 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3344/6761] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:04:49 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:04:50.010895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:04:50.011461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:04:50.013236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:04:50.019724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:50.021029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:50.021562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:50.022307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:50.022763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:50.023192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:50.104785 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67cd1c41-6d03-4e00-ad95-bef788504032 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097747 Aug 25 14:04:50.105401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3418/6762] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:04:50 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:04:51.478253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:04:51.490540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:04:51.491058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:04:51.491485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:04:51.503805 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] Creating event network-changed:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:04:51.510229 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ab4f4d06-8be2-43e2-b486-d7b0eee3a05b req-dfe8e6df-aca7-43df-a39a-8f6cfd509d6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 Aug 25 14:04:51.511134 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3345/6763] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:26.682951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=11 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:26.683891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:26.688830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:26.691667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:26.701236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:26.701932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:26.702378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:26.703096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:26.703552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:26.703972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:26.741707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:26.748702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:05:26.756402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:05:26.756833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:05:26.757315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:05:26.757756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:05:26.758155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:05:26.826166 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:05:27.833612 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [0226b62a-6f3b-4f9f-a117-ec7222be01fb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 52202. Aug 25 14:05:27.838344 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4d296c51-6eb9-4f81-85ef-73bf6783db5d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/action" status: 202 len: 0 microversion: 2.1 time: 1.158053 Aug 25 14:05:27.838991 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3419/6764] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:05:26 2022] POST /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/action => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:05:27.846075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:27.846943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=47 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:27.852581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:27.853309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:27.861559 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:27.862077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:27.862675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:27.864154 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:27.864636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:27.865079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:28.013749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:28.022254 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71801d21-6464-48f7-9d14-e2cb27ca0fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1679 microversion: 2.1 time: 0.178430 Aug 25 14:05:28.022944 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3346/6765] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:27 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:29.044994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:29.045621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:29.053238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:29.053726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:29.054170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:29.054904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:29.055535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:29.055971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:29.203888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:29.212248 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7bb9382a-fadc-488e-9f7b-a366d68034c6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1679 microversion: 2.1 time: 0.171939 Aug 25 14:05:29.212852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3420/6766] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:29 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:30.234053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:30.234755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:30.242015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:30.242531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:30.242995 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:30.243725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:30.244247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:30.244704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:30.386177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:30.394074 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92d806f8-2265-4dd2-ae48-a9ef08b4a770 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.164048 Aug 25 14:05:30.394651 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3347/6767] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:30 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:31.415959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:31.416594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:31.423880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.424404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.424841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.426722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:31.427181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:31.427613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:31.576961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:31.586716 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b234eaff-03db-448f-a773-636d6807c651 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.174539 Aug 25 14:05:31.587322 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3421/6768] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:31 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:32.610098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:32.611029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:32.619016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:32.619523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:32.620214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:32.621096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:32.621734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:32.622304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:32.774645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:32.783013 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b172deac-2e05-4854-8dbd-84025d6dd876 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.176928 Aug 25 14:05:32.783684 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3348/6769] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:32 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:33.809631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:33.810883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:33.822985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:33.823504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:33.823950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:33.824703 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:33.825194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:33.825633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:33.995912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:34.006984 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b9130f44-e842-4836-9132-d38973ed75d1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.204234 Aug 25 14:05:34.007698 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3422/6770] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:33 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:35.034078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:35.035431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:35.042781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:35.043241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:35.043693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:35.044455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:35.044922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:35.045371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:35.190740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:35.199089 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aafbab4b-22e8-4269-abb1-02f3a6165861 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.168995 Aug 25 14:05:35.199688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3349/6771] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:35 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:36.221024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:36.221657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:36.229760 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:36.230270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:36.230716 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:36.231438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:36.231896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:36.232358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:36.387566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:36.396192 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d6a4e74-43bc-4951-9d51-33f0bc925583 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.178988 Aug 25 14:05:36.396810 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3423/6772] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:36 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:37.418713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:37.419344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:37.427975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.428523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.428976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.429706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:37.430179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:37.430618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:37.595708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:37.607627 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c22c178f-2bb1-4af7-941f-c3ba6c7644f9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.193459 Aug 25 14:05:37.608511 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3350/6773] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:37 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:38.630340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:38.631010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:38.638823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:38.639317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:38.639766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:38.640523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:38.640982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:38.641456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:38.812596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:38.822086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92cdc74c-0089-4924-b46d-73c9ee7e04fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.195624 Aug 25 14:05:38.823083 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3424/6774] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:38 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:39.846230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:39.847596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:39.855583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:39.856101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:39.856609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:39.857410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:39.857901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:39.858353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:40.030253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:40.039260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ffaee25-2a77-4a2f-a1f1-d04c26551133 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.197974 Aug 25 14:05:40.039876 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3351/6775] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:39 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:41.066480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:41.067684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:41.080762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:41.082176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:41.082992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:41.084162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:41.085081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:41.085718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:41.265756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:41.275672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4e2196e-1cf0-48ee-9f74-1f77119a9e1b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1684 microversion: 2.1 time: 0.216744 Aug 25 14:05:41.276772 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3425/6776] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:41 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1684 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:42.303785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:42.304630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:42.312441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:42.312962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:42.313417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:42.314157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:42.314634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:42.315153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:42.487008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:42.498099 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37a45600-aede-485d-a23b-16edd96a8a22 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1683 microversion: 2.1 time: 0.198274 Aug 25 14:05:42.498961 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3352/6777] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:42 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:42.597936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "name": "network-vif-unplugged", "status": "completed", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:42.609073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:42.609569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:42.609996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:42.622387 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Creating event network-vif-unplugged:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h1-850468-18 Aug 25 14:05:42.628432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:42.640592 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-90e7d197-d7b2-4841-aab9-86e878a16423 req-afb1543d-35aa-4b30-afde-907cde628d66 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049164 Aug 25 14:05:42.641342 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3426/6778] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:43.521763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:43.522574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:43.529728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:43.530235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:43.530688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:43.531420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:43.531890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:43.532428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:43.697050 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:43.708285 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b6d11a73-9af0-4754-8cc3-866e0bdbadba tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1683 microversion: 2.1 time: 0.191319 Aug 25 14:05:43.708904 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3353/6779] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:43 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:44.692090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:44.702478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:44.703071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:44.703404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:44.717780 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Creating event network-changed:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h1-850468-18 Aug 25 14:05:44.724323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:44.734157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:44.735309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:44.737834 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-14b046b3-a246-4031-9491-11b7e9ff47a6 req-72116e4c-8e3e-416e-9012-f6a5dcfe4285 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051063 Aug 25 14:05:44.739035 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3427/6780] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:44.749965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:44.750867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:44.751932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:44.754111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:44.754989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:44.755808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:44.926589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:44.937037 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be8a749a-fb67-4c3a-ba26-59d8e253b062 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1681 microversion: 2.1 time: 0.209805 Aug 25 14:05:44.937670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3354/6781] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:44 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:05:45.961559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:45.962387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:45.969361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:45.969873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:45.970316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:45.971058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:45.972502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:45.972966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:46.127573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:46.136875 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-871f6e9b-c4cd-4503-834e-a0a2d4296884 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1681 microversion: 2.1 time: 0.181144 Aug 25 14:05:46.137484 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3428/6782] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:45 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:47.164784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:47.166367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:47.176859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.177510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.178052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.178851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.179420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.180049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.352810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:47.361700 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-266e2de7-ff63-41eb-944b-b5a850cc8fd0 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1678 microversion: 2.1 time: 0.204473 Aug 25 14:05:47.363118 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3355/6783] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:47 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:47.385200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:47.386100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:47.395197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.395696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.396190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.396913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.397376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.397814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.447208 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.448365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.448365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.448961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.449439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.449945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.475998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'ram', 'cores'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:05:47.482347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'ram', 'cores'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:05:47.619707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e98fc45a-ac54-4f34-bf24-03dcaba7ac28 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.237453 Aug 25 14:05:47.620395 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3429/6784] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:05:47 2022] POST /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:05:47.633719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:47.634999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:47.651954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:47.885572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:47.901423 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2503319a-e040-4a55-a4ad-e18e95a95269 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.274713 Aug 25 14:05:47.902568 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3356/6785] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:47 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:48.936882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:48.937784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:48.946520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:48.947048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:48.947457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:48.948210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:48.948669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:48.949098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:49.118745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:49.127706 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c19e7362-3b56-4583-ba34-a184794db80b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.195609 Aug 25 14:05:49.128342 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3430/6786] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:48 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:49.861427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "name": "network-vif-plugged", "status": "completed", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:49.883026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:49.883026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:49.887418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:49.905538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Creating event network-vif-plugged:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h1-850468-18 Aug 25 14:05:49.916801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:49.945811 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f9d13e81-f071-40bc-95f8-c7d52445af4c req-824660d0-5f05-4843-aaf1-9f86bff803cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088829 Aug 25 14:05:49.946666 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3357/6787] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:05:50.155499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:50.156691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:50.170090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:50.170730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:50.171227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:50.176390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:50.177075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:50.177638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:50.361786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:50.367137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:50.377020 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c1821602-08cc-4971-b6cd-12ab98bfa742 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.226713 Aug 25 14:05:50.378199 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3431/6788] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:50 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:51.398624 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:05:51.399299 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab (ip 10.222.0.60) !!! Aug 25 14:05:51.406673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:51.407490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:51.419240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:51.419889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:51.420398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:51.421174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:51.421686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:51.422084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:51.462830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "name": "network-vif-unplugged", "status": "completed", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:51.478200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:51.478692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:51.479138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:51.494999 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Creating event network-vif-unplugged:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:05:51.502163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:51.519279 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-567f4283-8502-4ebb-abf3-313c24257535 req-7b9e961b-4008-485f-a4f6-c2d7e457a082 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059276 Aug 25 14:05:51.520151 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3432/6789] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:05:51.606090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:51.618862 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cdcde572-4700-4880-a399-dd0509453d34 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.222249 Aug 25 14:05:51.619814 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3358/6790] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:51 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:52.641522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:52.642269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:52.650491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:52.651100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:52.651543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:52.652668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:52.653133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:52.653559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:52.804816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:52.813295 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aad36f53-d1f4-4baa-b062-e5e55837f973 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.177022 Aug 25 14:05:52.813894 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3433/6791] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:52 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:53.546076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:53.557035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:53.557533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:53.557982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:53.571728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Creating event network-changed:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:05:53.577765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:05:53.589740 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6b9fcccb-ce87-4d14-80eb-91b983567af2 req-54ed195c-3442-40b6-88cb-42d44b4a5601 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047331 Aug 25 14:05:53.590361 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3359/6792] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:05:53.835671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:53.836510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:53.849400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:53.850279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:53.851095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:53.852438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:53.853303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:53.854120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:54.030011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:54.039581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23f12d4d-1276-442d-afb0-f9c8f5f6de70 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1677 microversion: 2.1 time: 0.207728 Aug 25 14:05:54.040075 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3434/6793] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:53 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:55.065813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.066538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.073327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.073942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.074382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.075180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.075662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.076207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.224323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:55.232610 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98ce1bfe-a5e9-452c-8a0d-fb7c64ace211 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1670 microversion: 2.1 time: 0.172081 Aug 25 14:05:55.233236 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3360/6794] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:55 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:55.257310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.258180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.265469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.266003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.266429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.267170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.267619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.268141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.414261 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:55.423074 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0b43864f-2076-4fcb-a0f8-a8fa24f47e06 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1670 microversion: 2.1 time: 0.171507 Aug 25 14:05:55.423692 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3435/6795] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:55 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:55.445405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.445966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.453105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.453623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.454086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.454827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.455309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.455918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.609868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:55.619024 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b6b4851-1038-4130-9e66-04c20e9de89c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1670 microversion: 2.1 time: 0.178416 Aug 25 14:05:55.619749 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3361/6796] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:55 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:55.641237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.641761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.650132 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.650640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.651096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.651831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.652334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.652774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.683430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:05:55.780636 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d85c122-f692-409b-8180-4e169a526c85 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 204 len: 0 microversion: 2.1 time: 0.143332 Aug 25 14:05:55.781498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3436/6797] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:05:55 2022] DELETE /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:05:55.791067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:55.791727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:55.798450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.798956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.800245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.801301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:55.802051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:55.802563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:55.953298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:55.962272 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e28ca3a1-c84f-43d4-9317-0f67afc28eab tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1676 microversion: 2.1 time: 0.175370 Aug 25 14:05:55.962872 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3362/6798] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:55 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:56.990213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:56.991500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:56.995476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:57.002879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:57.003993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:57.004458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:57.005169 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:57.005626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:57.006054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:57.149579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:57.157487 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e51ad9c7-67b5-4ab8-bb55-e8bea1f367aa tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1676 microversion: 2.1 time: 0.176271 Aug 25 14:05:57.158065 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3437/6799] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:56 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:58.181195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:58.183262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:58.186191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:58.193434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:58.194082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:58.194621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:58.195604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:58.196179 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:58.196719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:58.200184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=99 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:58.219409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cf99ca-93af-473c-bd66-ba61fd06a1ab", "name": "network-vif-deleted", "tag": "82aa3bca-2902-4609-a263-e117a1a0f5e2"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:58.228726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:05:58.234713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:58.235372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:58.235712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:58.249288 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] Creating event network-vif-deleted:82aa3bca-2902-4609-a263-e117a1a0f5e2 for instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab on n-h2-850468-18 Aug 25 14:05:58.266781 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1ec0245b-5ba6-4194-ab32-8ac5fdec572d req-1df43ead-13dd-42aa-a458-a804e5091fef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039760 Aug 25 14:05:58.267799 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3438/6800] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:05:58.295770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:05:58.305782 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d40efa4a-5241-4f3f-b2c6-688fd08d2405 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 200 len: 1609 microversion: 2.1 time: 0.129028 Aug 25 14:05:58.306586 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3363/6801] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:58 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 1609 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:05:59.330075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:59.330878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:59.338326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.338819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.339260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.339969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.340465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.340897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.355587 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab HTTP/1.1 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '93cf99ca-93af-473c-bd66-ba61fd06a1ab'} Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:59.357302 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-87ba4870-e1c8-4741-87c6-88184a3c9425 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 404 len: 111 microversion: 2.1 time: 0.033352 Aug 25 14:05:59.361498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3439/6802] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:59 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:05:59.376465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:05:59.377118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:05:59.385030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.385891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.386522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.387351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:05:59.387909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:05:59.388536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:05:59.404404 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab HTTP/1.1 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '93cf99ca-93af-473c-bd66-ba61fd06a1ab'} Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:05:59.406106 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa2b1832-6503-4967-9751-ae367d6f2616 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 404 len: 111 microversion: 2.1 time: 0.035562 Aug 25 14:05:59.411254 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3364/6803] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:05:59 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:05:59.459569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-431976226", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "d7f24ba6-69ec-44bb-a1bd-176191f4c3d4"}], "security_groups": [{"name": "tempest-securitygroup--726228393"}], "key_name": "tempest-keypair-1315040552", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:05:59.583046 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] validate_networks() for [('d7f24ba6-69ec-44bb-a1bd-176191f4c3d4', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:06:00.041320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:06:00.041759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:06:00.042383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:06:00.042798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:06:00.043216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:06:00.054496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:00.054990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:00.055682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:00.056736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:00.057317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:00.057641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:00.077137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:06:00.083473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:06:00.099567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:06:00.101975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:06:00.157867 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9f50979e-8943-4e91-8834-f9957f3c930b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702514 Aug 25 14:06:00.159431 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3440/6804] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:05:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:06:00.170224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8a16300-0be6-4444-910e-dca167349978 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:00.170870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8a16300-0be6-4444-910e-dca167349978 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:00.242121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b8a16300-0be6-4444-910e-dca167349978 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:00.255276 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8a16300-0be6-4444-910e-dca167349978 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1238 microversion: 2.1 time: 0.088732 Aug 25 14:06:00.268822 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3365/6805] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:00 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:01.294355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:01.295130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:01.302643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:01.303147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:01.303599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:01.304341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:01.304825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:01.305588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:01.375713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:01.386351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-501fab47-1038-4796-b101-2447e919e2a7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1298 microversion: 2.1 time: 0.097059 Aug 25 14:06:01.387235 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3441/6806] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:01 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:02.410269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:02.410932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:02.419812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.420992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.421454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.422300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.422657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.423092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.566529 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:02.574703 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-25d9ee86-c563-4424-a7de-691bf81e8528 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.169464 Aug 25 14:06:02.575277 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3366/6807] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:02 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:02.726086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:02.743018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:02.743507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:02.743938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:02.759005 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] Creating event network-changed:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:06:02.764513 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-324459bb-bec0-417f-8b28-e1ee230c3b83 req-b5bdd859-7a90-4991-8004-fb96c00f47e1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044740 Aug 25 14:06:02.765705 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3442/6808] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:03.603063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:03.604286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:03.618253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:03.619182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:03.620019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:03.621401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:03.622231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:03.622749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:03.809868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:03.819546 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0944d65-1793-4cdd-8490-9addf2aada8f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.224923 Aug 25 14:06:03.820657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3367/6809] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:03 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:04.842365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:04.843398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:04.858167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:04.858680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:04.859136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:04.859933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:04.860360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:04.860798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:05.026340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:05.036828 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c0e9f5d-d489-4f86-9be8-4b3918dbeba3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.198971 Aug 25 14:06:05.037436 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3443/6810] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:04 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:06.060478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:06.061210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:06.069502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:06.070048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:06.070576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:06.071314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:06.071794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:06.072268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:06.226362 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:06.234506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-457f0bf3-a7d0-4f0e-8af9-4617e2c3c8f1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.178312 Aug 25 14:06:06.235099 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3368/6811] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:06 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:06:07.256845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:07.257513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:07.265074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:07.265713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:07.266000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:07.266710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:07.267247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:07.267602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:07.404136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:07.412253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cd1657c6-dc78-4ac5-939d-101c4a941f9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.159959 Aug 25 14:06:07.412854 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3444/6812] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:07 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:08.002878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-plugged", "status": "completed", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:08.015608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:08.016166 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:08.016658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:08.032607 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] Creating event network-vif-plugged:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:06:08.039030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ad902ce6-0ebe-4272-913a-3793a0fe0d82 req-ad162174-d16b-4c04-9ee5-02880715ac89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040176 Aug 25 14:06:08.039841 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3369/6813] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:08.434806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:08.435412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:08.443443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:08.444600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:08.444600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:08.445123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:08.445585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:08.446023 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:08.599959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:08.609153 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-998f8588-336e-4eb6-b63f-a2f786d983bf tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1363 microversion: 2.1 time: 0.178330 Aug 25 14:06:08.609838 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3445/6814] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:08 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:09.634224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:09.634955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:09.641655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:09.642214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:09.643281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:09.644008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:09.644506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:09.644948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:09.781247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:09.790279 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66ea69f7-d431-4447-a137-afe230369277 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1550 microversion: 2.1 time: 0.161204 Aug 25 14:06:09.790874 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3370/6815] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:09 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:09.812475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:09.813043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:09.820640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:09.821179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:09.821626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:09.822338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:09.822797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:09.823232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:09.904634 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-278ba50d-f2d5-4611-8cf5-49e0b17bb6b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096244 Aug 25 14:06:09.905259 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3446/6816] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:06:09 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:10.941604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:10.946897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:10.953750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:10.954253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:10.954702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:10.967651 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] Creating event network-changed:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:06:10.974216 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-400af7d1-258f-4c9e-94c7-1ac216cb43ee req-95bd6312-0d72-49f3-a364-762a6be4166c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037446 Aug 25 14:06:10.975124 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3371/6817] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:47.422205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.423026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.424923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.425600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.430146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:47.430762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:47.439124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:47.439554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:47.439994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:47.440722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:47.441180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:47.441608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:47.666472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:47.675677 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-537c7d91-3842-4410-a31c-1b4f3d7cc831 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1669 microversion: 2.1 time: 0.254210 Aug 25 14:06:47.676526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3447/6818] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:47 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:06:47.696584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=19 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.697499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=35 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:47.702558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3795a686-0596-40c5-b752-a52667d06f6d"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:47.705175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:47.712687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:47.713200 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:47.713651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:47.714377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:47.714854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:47.715289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:48.124756 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-706b9501-2da8-4fc7-8318-40b5d567e353 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431084 Aug 25 14:06:48.125442 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3372/6819] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:06:47 2022] POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:06:58.982376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:06:58.985279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:58.987682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:58.988398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:58.996061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:58.996604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:58.997057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:58.997795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:58.998265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:58.998704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:59.039159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:59.046737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:06:59.059711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:06:59.060525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:06:59.061203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:06:59.061787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:06:59.062512 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:06:59.138305 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4cd25259-97ed-4579-a8cc-16257fe10bdd tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/action" status: 202 len: 0 microversion: 2.1 time: 0.160397 Aug 25 14:06:59.138860 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3448/6820] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:06:58 2022] POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:06:59.148150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:06:59.148887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:06:59.152263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:59.153022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:06:59.159599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:59.160183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:59.160649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:59.162076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:06:59.162564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:06:59.163199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:06:59.343402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:06:59.360920 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-027825ec-9bc7-4f52-aa38-37bd8fb3ccc1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1724 microversion: 2.1 time: 0.216837 Aug 25 14:06:59.362019 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3373/6821] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:06:59 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:00.383850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:00.384518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:00.395934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:00.396854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:00.397655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:00.398962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:00.399805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:00.400640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:00.603295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:00.620398 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec02651d-ce61-447c-8dca-c1b5247c59ee tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1724 microversion: 2.1 time: 0.240565 Aug 25 14:07:00.621252 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3449/6822] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:00 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:01.644275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:01.644943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:01.654675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:01.655186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:01.655638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:01.656418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:01.656879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:01.657355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:01.820986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:01.830484 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4599a23a-6134-43da-8d32-dc187753e3b8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.190466 Aug 25 14:07:01.831080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3374/6823] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:01 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:02.854385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:02.855012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:02.862310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:02.862795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:02.863235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:02.863942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:02.865058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:02.865644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:03.012746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:03.022018 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-08ae3539-c5b5-4cfc-aeb3-ec645c12a760 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.171541 Aug 25 14:07:03.022613 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3450/6824] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:02 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:04.048482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:04.049482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:04.062128 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:04.062953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:04.064623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:04.067076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:04.068871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:04.070096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:04.238015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:04.248006 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6abc7c54-0970-4950-94af-d2729e0499bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.206687 Aug 25 14:07:04.248638 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3375/6825] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:04 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:05.272743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:05.273620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:05.281436 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:05.281950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:05.282372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:05.283083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:05.283540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:05.284160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:05.439153 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:05.448966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-211b17fb-5978-4fc2-addb-e8c5dede7646 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.180573 Aug 25 14:07:05.449581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3451/6826] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:05 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:06.472025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:06.472615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:06.480721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:06.481266 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:06.481730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:06.482468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:06.482943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:06.483383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:06.634434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:06.643592 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fefe6116-2745-4499-98af-31c5ad9983bc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.175600 Aug 25 14:07:06.644258 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3376/6827] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:06 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:07.667233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:07.667854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:07.675016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:07.675509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:07.675946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:07.676687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:07.677834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:07.678425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:07.819831 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:07.828342 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e9710e2f-487e-4b0d-bbba-82c8b2aa1da5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.165004 Aug 25 14:07:07.828977 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3452/6828] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:07 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:08.851361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:08.851993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:08.859382 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:08.859888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:08.860371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:08.861094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:08.861564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:08.862004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:09.001534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:09.011583 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d10bbfe-b08e-4bdb-adad-ce4e49a540a2 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.164966 Aug 25 14:07:09.012214 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3377/6829] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:08 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:10.037175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:10.037175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:10.043712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:10.044313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:10.044779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:10.045514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:10.045979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:10.046414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:10.203696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:10.213535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62cf1b03-65c0-478c-b111-6304e3634e4d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.182968 Aug 25 14:07:10.214133 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3453/6830] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:10 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:11.243385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:11.244865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:11.255178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:11.255878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:11.260809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:11.260809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:11.260809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:11.260809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:11.416681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:11.425626 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f9c6a5bc-eca1-43db-b4a6-3149327d668d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.189976 Aug 25 14:07:11.426119 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3378/6831] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:11 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:12.448007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:12.448593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:12.455422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:12.455905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:12.456375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:12.457068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:12.457524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:12.457957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:12.597618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:12.606298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3e4ddeb4-7e42-4654-a99a-43fd578437b9 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.162922 Aug 25 14:07:12.606889 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3454/6832] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:12 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:13.632649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:13.633303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:13.642181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:13.642896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:13.643485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:13.644384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:13.645009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:13.645623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:13.799641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:13.810355 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47abf57d-1a82-4164-bd6a-464111178068 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.183075 Aug 25 14:07:13.810969 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3379/6833] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:13 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:14.833659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:14.834268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:14.842659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:14.843159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:14.843596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:14.844497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:14.845040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:14.845499 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:15.019449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:15.028301 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47725ace-e310-437a-b050-9915618d5aed tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1729 microversion: 2.1 time: 0.198900 Aug 25 14:07:15.029236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3455/6834] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:14 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:16.051002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:16.052187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:16.061222 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:16.061743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:16.062199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:16.062973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:16.063448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:16.063891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:16.112166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-unplugged", "status": "completed", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:16.125841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:16.126426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:16.127113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:16.149241 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Creating event network-vif-unplugged:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h1-850468-18 Aug 25 14:07:16.155665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:16.170516 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c506fe52-d1c4-428d-a44f-595928730ebc req-f02a8bc8-0a00-4887-adc3-782f66d3d63c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062383 Aug 25 14:07:16.171903 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3456/6835] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:16.258281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:16.267993 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5fd73670-51d6-4e8f-8549-2a60c09a272a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1728 microversion: 2.1 time: 0.221023 Aug 25 14:07:16.280240 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3380/6836] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:16 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:17.293572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:17.294342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:17.300999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:17.301492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:17.301937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:17.302655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:17.303123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:17.303736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:17.441865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:17.450720 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ca15a30c-65dc-4eb9-9d49-f2f800a04bc8 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1728 microversion: 2.1 time: 0.164087 Aug 25 14:07:17.451306 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3457/6837] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:17 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:18.188705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:18.201549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:18.202147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:18.202665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:18.218237 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Creating event network-changed:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h1-850468-18 Aug 25 14:07:18.224721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:18.238496 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0e391c6f-ffb8-425c-9353-c022bca3b867 req-f6050a5a-7b27-4799-85ab-7d9aa6253bcb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053991 Aug 25 14:07:18.239118 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3381/6838] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:18.472956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:18.473777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:18.481387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:18.482292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:18.482980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:18.484013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:18.484602 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:18.485253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:18.653430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:18.667665 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0753699b-c757-42ba-99e9-504f8d398201 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.198772 Aug 25 14:07:18.680141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3458/6839] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:18 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:19.692554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:19.693316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:19.699731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:19.700272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:19.700732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:19.701446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:19.701918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:19.702360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:19.844803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:19.853942 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-296786f4-5de3-4320-9db9-909d69bca53c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.166441 Aug 25 14:07:19.854567 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3382/6840] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:19 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:20.876930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:20.877742 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:20.886932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:20.887477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:20.887925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:20.888659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:20.889114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:20.889544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:21.055444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:21.064383 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dd59250a-1b47-432f-9800-759a6d9b9e7d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.192177 Aug 25 14:07:21.064968 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3459/6841] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:20 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:22.088333 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:22.088901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:22.096318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:22.096838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:22.097288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:22.098007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:22.098489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:22.098926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:22.239502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:22.248793 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eae51368-5e30-4dfa-83e7-42bcf320415d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.165844 Aug 25 14:07:22.249655 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3383/6842] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:22 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:23.270987 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:23.271610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:23.279188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:23.279683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:23.280158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:23.280878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:23.281345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:23.281779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:23.434673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:23.443271 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-05df3d59-05d2-44fc-8bf9-79aae342e65d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.176240 Aug 25 14:07:23.443863 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3460/6843] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:23 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:24.468031 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:24.468613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:24.475973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:24.476534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:24.476992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:24.477717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:24.478189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:24.478633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:24.624574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:24.634133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51015704-0c96-4156-b7cc-5f2e9319c8e3 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.171261 Aug 25 14:07:24.634753 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3384/6844] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:24 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:25.656265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:25.656924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:25.664475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:25.664998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:25.665409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:25.666145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:25.666613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:25.667071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:25.803648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:25.812817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0e5441a7-e46e-438a-b4ab-1a05b0fd375b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.160534 Aug 25 14:07:25.813424 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3461/6845] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:25 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:26.835118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:26.835809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:26.843338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:26.843854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:26.844373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:26.845105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:26.845581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:26.846041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:26.993210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:27.002457 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d0f8c1ff-ab7f-4f38-90f4-97d7525f0d0b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.171287 Aug 25 14:07:27.003042 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3385/6846] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:26 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:28.024989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:28.025617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:28.031951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:28.032465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:28.032905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:28.033610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:28.034063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:28.034492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:28.182873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:28.193284 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3eb810e2-1afa-4416-abb7-ed40ef75da45 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.172356 Aug 25 14:07:28.193908 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3462/6847] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:28 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:29.220853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:29.222038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:29.226056 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=27 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:29.235462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.236434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.237278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.238636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:29.239500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:29.240339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:29.246254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=77 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:29.444507 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:29.454685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5636fda6-4830-43e8-af48-416412ea60fc tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.241380 Aug 25 14:07:29.455304 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3386/6848] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:29 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:30.482345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:30.487613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:30.490707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=35 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:30.497313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.497816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.498262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.498992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:30.499450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:30.499885 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:30.503256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:30.650883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:30.659663 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1d2cefb8-d4b6-4bf7-93ea-249032804213 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.185324 Aug 25 14:07:30.660281 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3463/6849] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:30 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:31.683851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:31.684776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:31.688873 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:07:31.689095 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 (ip 10.222.0.60) !!! Aug 25 14:07:31.703012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:31.703524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:31.703983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:31.704830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:31.705318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:31.705831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:31.857065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:31.866441 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-975aa937-2714-4ce2-a351-2c56a0c09e0f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1726 microversion: 2.1 time: 0.188468 Aug 25 14:07:31.867059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3387/6850] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:31 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:32.891473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:32.892319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:32.896176 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:07:32.896418 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:07:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 (ip 10.222.0.60) !!! Aug 25 14:07:32.902851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:32.903541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:32.903995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:32.904751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:32.905220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:32.905640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.059554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:33.069540 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f205cd00-0ba9-4b1d-b138-a777ac708b5e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1723 microversion: 2.1 time: 0.182282 Aug 25 14:07:33.070144 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3464/6851] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:32 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:33.092010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:33.092735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:33.100219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.100725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.101178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.101912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.102374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.102811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.146061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.146552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.147048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.147808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.148306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.148741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.172765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for project a948f68c8ac6410a869e10d5b6022ced. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:07:33.178843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Getting quotas for user 5b615ceccbec48c788e8190cccf44e45 and project a948f68c8ac6410a869e10d5b6022ced. Resources: {'ram', 'cores'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:07:33.302582 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-144873bd-1533-4d48-9dd7-04b9bb322980 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/action" status: 202 len: 0 microversion: 2.1 time: 0.214528 Aug 25 14:07:33.303228 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3388/6852] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:07:33 2022] POST /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:07:33.313884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:33.314205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:33.320956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.322528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.323203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.324021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:33.324521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:33.324956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:33.896969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:33.913972 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-706d5756-ffcd-4b81-bad2-745da21110e7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.604899 Aug 25 14:07:33.915098 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3465/6853] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:33 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:34.361717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-plugged", "status": "completed", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:34.374556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.375155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.375509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.388516 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Creating event network-vif-plugged:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h1-850468-18 Aug 25 14:07:34.395589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:34.410039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-3d17f19a-ce30-46dd-ba38-f3f940eff412 req-1990c867-1172-49a8-81b3-773f1d20dd9b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053218 Aug 25 14:07:34.411351 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3389/6854] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:07:34.950231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:34.951031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:34.958807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.959476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.959928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:34.960713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:34.961175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:34.961610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:35.154786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:35.171778 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-23e8f723-a821-45db-a7eb-1a2a48ad787e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.225433 Aug 25 14:07:35.172916 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3466/6855] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:34 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:36.206677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:36.207817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:36.214955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:36.215465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:36.215946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:36.216707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:36.217183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:36.217632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:36.430651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:36.443747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d7af820-5b0d-442b-9b95-612da0577004 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.242229 Aug 25 14:07:36.444397 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3390/6856] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:36 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:37.467497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:37.468515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:37.476819 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:37.477404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:37.477963 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:37.478830 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:37.479397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:37.479845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:37.671467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:37.688377 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-860d6997-1b52-4e0c-b12f-f278b6e83258 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.226715 Aug 25 14:07:37.688987 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3467/6857] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:37 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:38.318669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-unplugged", "status": "completed", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:38.335057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:38.335958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:38.336784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:38.366890 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Creating event network-vif-unplugged:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h1-850468-18 Aug 25 14:07:38.378509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:38.403322 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-c06ca78f-539e-4e1f-944a-9815e30f5a42 req-095c3ce2-fb4d-4732-8269-f8838f3cb233 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090241 Aug 25 14:07:38.404831 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3391/6858] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:07:38.716257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:38.716863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:38.724654 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:38.725162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:38.725616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:38.726542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:38.727031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:38.727469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:38.913635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:38.924400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e39dff6f-90b1-4d98-866d-11a778cac48b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.213027 Aug 25 14:07:38.940732 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3468/6859] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:38 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:39.886207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:39.897335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:39.897871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:39.898318 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:39.913185 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Creating event network-changed:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:07:39.920249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:07:39.933557 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-f8452886-264f-4088-bd4b-5d31e8315547 req-20428bbb-eb9b-4d14-82b4-d4435aa4a021 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109937 Aug 25 14:07:39.934629 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3392/6860] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:07:39.951005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:39.951637 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:39.958917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:39.959414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:39.959859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:39.960719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:39.961183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:39.961614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:40.174988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:40.186484 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2bb411a6-6123-4ae5-927f-3036788d339f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.239424 Aug 25 14:07:40.187179 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3469/6861] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:39 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:41.211914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:41.212723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:41.219675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:41.220235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:41.220702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:41.221487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:41.221953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:41.222406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:41.390324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:41.402936 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c2140b43-0a44-4871-ba67-6c035dd583c7 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.196312 Aug 25 14:07:41.403692 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3393/6862] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:41 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:42.433165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:42.434982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:42.450529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:42.451609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:42.452672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:42.454501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:42.455364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:42.456442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:42.664489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:42.676577 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2802cd29-bbc2-48b4-9abd-ebf34f2e693b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.252713 Aug 25 14:07:42.677219 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3470/6863] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:42 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:43.711132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:43.711770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:43.715263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:43.721624 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:43.722139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:43.722593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:43.723399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:43.723845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:43.724270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:43.905306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:43.920280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8306e88-ddfb-4809-b701-87df20352c43 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.212892 Aug 25 14:07:43.921023 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3394/6864] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:43 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:44.945427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:44.947275 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:44.959559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:44.960243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:44.960879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:44.962617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:44.963493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:44.964312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:45.199178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:45.211287 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e62ef260-4925-4dcf-aebd-64249303c3d5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.270752 Aug 25 14:07:45.211820 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3471/6865] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:44 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:46.233908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:46.234553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:46.241890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.242398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.242851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.244088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:46.244581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:46.245035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:46.403352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:46.412484 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7179bfe5-9386-4dbf-b0b7-1aec45b7d684 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.183039 Aug 25 14:07:46.413117 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3395/6866] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:46 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:07:47.436735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:47.437390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:47.447362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:47.448731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:47.449404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:47.450524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:47.451915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:47.452394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:47.608632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:47.617461 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f90dd6b7-376a-44ad-8668-59bccac44e3b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.185081 Aug 25 14:07:47.618069 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3472/6867] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:47 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:48.651309 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:48.653983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:48.666833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:48.667418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:48.667933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:48.668801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:48.669336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:48.669857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:48.902862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:48.914674 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ccab6361-44cf-4f8d-89e9-dc327040c101 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.274712 Aug 25 14:07:48.916059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3396/6868] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:48 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:49.942150 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:49.942891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:49.953956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:49.954487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:49.954943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:49.955844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:49.956553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:49.956972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:50.106277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:50.115191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1961004d-bdc2-4a24-99e2-2f0357ae3665 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.177925 Aug 25 14:07:50.115813 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3473/6869] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:49 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:51.138977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:51.139618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:51.146812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:51.147421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:51.148079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:51.148817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:51.149898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:51.150415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:51.294092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:51.302731 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-89ff46af-6dae-4fe8-9aab-dfa232921957 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.168208 Aug 25 14:07:51.303334 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3397/6870] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:51 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:52.326253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:52.326909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:52.336211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:52.337729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:52.338554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:52.339710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:52.340393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:52.340973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:52.487961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:52.497776 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0209d3b1-c82b-4b46-8ad1-3770fe1fa8f5 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1722 microversion: 2.1 time: 0.175648 Aug 25 14:07:52.498368 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3474/6871] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:52 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:53.519067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:53.519621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:53.527015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.527522 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.527978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:53.528746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.529215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.529657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:53.689725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:53.699644 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-18604eb7-2cc1-492c-b573-3028419af0fe tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1715 microversion: 2.1 time: 0.184444 Aug 25 14:07:53.700307 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3398/6872] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:53 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1715 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:53.723126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:53.723824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:53.734881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.735617 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.736468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:53.737797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.738669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.739479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:53.922537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:53.932744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f99dffe-a12a-4df0-ae85-d17ee7b2b327 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1715 microversion: 2.1 time: 0.213353 Aug 25 14:07:53.933574 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3475/6873] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:53 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1715 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:53.956036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:53.957010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:53.965783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.966352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.967113 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:53.967927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:53.968446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:53.968906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:54.136945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:54.147142 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-48825f5b-bacd-4c03-9b31-26d9f954d61a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1715 microversion: 2.1 time: 0.195904 Aug 25 14:07:54.147926 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3399/6874] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:53 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1715 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:54.169196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:54.169706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:54.176433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:54.177181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:54.177631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:54.178849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:54.179331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:54.179765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:54.210291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:07:54.334846 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fcf1903e-54b8-4b14-90df-5849507b8191 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 204 len: 0 microversion: 2.1 time: 0.169421 Aug 25 14:07:54.335954 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3476/6875] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:07:54 2022] DELETE /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:07:54.347631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:54.348802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:54.358593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:54.359319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:54.359967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:54.361152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:54.361816 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:54.362552 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:54.543641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:54.547064 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:54.555551 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cf880794-3519-41e3-92d7-10ec5d9ba562 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1721 microversion: 2.1 time: 0.213559 Aug 25 14:07:54.556998 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3400/6876] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:54 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:55.584566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:55.585826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:55.599317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:55.600245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:55.601059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:55.602355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:55.603260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:55.604322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:55.792320 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:55.809374 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3a71193-46cb-4bc3-98e9-df8e75805d2e tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1721 microversion: 2.1 time: 0.232734 Aug 25 14:07:55.810488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3477/6877] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:55 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:56.477265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-plugged", "status": "completed", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:56.500310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:56.501196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:56.501986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:56.525945 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] Creating event network-vif-plugged:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:07:56.533613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-45648468-f198-4005-a054-8f024545e004 req-6b4425da-8465-4cba-b6f5-af9f08923f33 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068514 Aug 25 14:07:56.534617 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3401/6878] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:56.848523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:56.849839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:56.859626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:56.860317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:56.860605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:56.861329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:56.861794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:56.862226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:56.867014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:07:56.969317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:56.987580 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-62e58268-46e5-4a64-bb44-d3e355dd4e5f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1654 microversion: 2.1 time: 0.142645 Aug 25 14:07:56.988588 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3478/6879] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:56 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1654 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:57.188891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e1b0ee-c05d-440a-b871-a59ebe880b48", "name": "network-vif-deleted", "tag": "55ffce31-dd2f-4342-a7b1-d5c8902a9426"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:07:57.211278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:57.213071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:57.214115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:57.238595 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] Creating event network-vif-deleted:55ffce31-dd2f-4342-a7b1-d5c8902a9426 for instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 on n-h2-850468-18 Aug 25 14:07:57.244215 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-08321151-6ab7-4dc0-bddc-28dde95c8468 req-d70614d8-704b-4d42-890b-aa960e411237 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065837 Aug 25 14:07:57.245504 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3402/6880] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:07:58.013643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:58.014363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:58.022198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:58.022897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:58.023864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:58.027290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:58.027933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:58.029301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:58.111048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:58.125123 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ed282cd7-7f80-4757-a2ea-b89a4cd8d087 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1369 microversion: 2.1 time: 0.115289 Aug 25 14:07:58.126700 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3479/6881] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:58 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:07:59.151700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:07:59.152576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:07:59.159086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:59.159594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:59.160051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:59.160804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:07:59.161279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:07:59.161723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:07:59.235485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:07:59.252220 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-afcaebf7-658d-4968-828d-1b596ba4d99b tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1369 microversion: 2.1 time: 0.107222 Aug 25 14:07:59.252836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3403/6882] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:07:59 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:00.281036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:00.281999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:00.293332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:00.293332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:00.293996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:00.294840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:00.296702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:00.296702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:00.386393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:00.395583 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-25befe35-0d8d-4f9f-8095-15590eeb99b6 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1369 microversion: 2.1 time: 0.124757 Aug 25 14:08:00.396539 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3480/6883] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:00 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1369 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:01.418894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:01.419537 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:01.422867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:01.428874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:01.429403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:01.429897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:01.430750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:01.431977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:01.432738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:01.506443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b615ceccbec48c788e8190cccf44e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a948f68c8ac6410a869e10d5b6022ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:01.516783 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56afdcc8-9aea-4308-968f-3d8842fbe39c tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 200 len: 1369 microversion: 2.1 time: 0.103333 Aug 25 14:08:01.517394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3404/6884] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:01 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:02.539503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:02.540371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:02.544170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:02.550582 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:02.551075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:02.551535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:02.552287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:02.552752 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:02.553183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:02.570170 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 HTTP/1.1 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e8e1b0ee-c05d-440a-b871-a59ebe880b48'} Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:02.571952 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34a2b52d-fcce-4759-b4db-05774a15301f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 404 len: 111 microversion: 2.1 time: 0.038504 Aug 25 14:08:02.579411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3481/6885] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:02 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:02.653342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:02.655610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:02.663359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:02.663877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:02.664367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:02.665112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:02.666247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:02.667401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:02.683030 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-volume_attachments HTTP/1.1 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'e8e1b0ee-c05d-440a-b871-a59ebe880b48'} Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:02.685141 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-adf7103d-bef0-4066-8046-af775fa3d00a tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038770 Aug 25 14:08:02.692188 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3405/6886] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:08:02 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:08:06.114439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.115096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.127811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.128402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.128865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.129650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.130121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.130559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.146968 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 HTTP/1.1 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e8e1b0ee-c05d-440a-b871-a59ebe880b48'} Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.148640 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-93f12aeb-ae11-4d3e-bb0d-224d748fdf15 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 404 len: 111 microversion: 2.1 time: 0.039973 Aug 25 14:08:06.154966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3482/6887] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:06 2022] DELETE /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.168802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.170120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: e8e1b0ee-c05d-440a-b871-a59ebe880b48] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.185329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.186445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.187340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.188838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.189791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.190597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.218728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 HTTP/1.1 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'e8e1b0ee-c05d-440a-b871-a59ebe880b48'} Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.221790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance e8e1b0ee-c05d-440a-b871-a59ebe880b48 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.229983 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ce2b5378-f9f2-43ee-a960-1043fb2d9332 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48" status: 404 len: 111 microversion: 2.1 time: 0.065507 Aug 25 14:08:06.230996 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3406/6888] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:06 2022] GET /compute/v2.1/servers/e8e1b0ee-c05d-440a-b871-a59ebe880b48 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.237239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.237750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.245467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.246146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.246411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.247247 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.247718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.248173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.272006 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab HTTP/1.1 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '93cf99ca-93af-473c-bd66-ba61fd06a1ab'} Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.274964 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a207ef2-1c6a-4ea8-81ba-b0a1d83fc19f tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 404 len: 111 microversion: 2.1 time: 0.045367 Aug 25 14:08:06.283608 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3483/6889] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:06 2022] DELETE /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.291181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.292251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 93cf99ca-93af-473c-bd66-ba61fd06a1ab] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.300686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.301403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.302027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.303487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.304368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.305069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.334502 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab HTTP/1.1 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '93cf99ca-93af-473c-bd66-ba61fd06a1ab'} Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.336414 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 93cf99ca-93af-473c-bd66-ba61fd06a1ab could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8528348b-d871-407b-816c-1700d3f30fa1 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab" status: 404 len: 111 microversion: 2.1 time: 0.054234 Aug 25 14:08:06.348618 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3407/6890] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:06 2022] GET /compute/v2.1/servers/93cf99ca-93af-473c-bd66-ba61fd06a1ab => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.354349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.355124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.365934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.366829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.367497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.369369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.370266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.371103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.399424 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 HTTP/1.1 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'd0541899-d67e-46a5-aa4e-ec5ab6ff69a2'} Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.402687 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.407233 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4020a1e6-068a-4558-b012-ed069effb473 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 404 len: 111 microversion: 2.1 time: 0.056045 Aug 25 14:08:06.408925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3484/6891] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:06 2022] DELETE /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.417860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.418868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: d0541899-d67e-46a5-aa4e-ec5ab6ff69a2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.426183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.426695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.427156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.427907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.428423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.428869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.445652 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 HTTP/1.1 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'd0541899-d67e-46a5-aa4e-ec5ab6ff69a2'} Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.447887 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be64ddcb-1982-454d-85b5-4338df15c8da tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2" status: 404 len: 111 microversion: 2.1 time: 0.036528 Aug 25 14:08:06.455917 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3408/6892] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:06 2022] GET /compute/v2.1/servers/d0541899-d67e-46a5-aa4e-ec5ab6ff69a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:08:06.459967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.460546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.467796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.468483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.468862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.469658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.470137 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.470580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.487007 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde HTTP/1.1 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b587c23-1cad-4143-9da1-5c615dfaffde'} Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.488679 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fbb32b31-42d9-4a69-9612-547c73792054 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 404 len: 111 microversion: 2.1 time: 0.034440 Aug 25 14:08:06.501368 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3485/6893] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:06 2022] DELETE /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:08:06.504598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.505256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] [instance: 0b587c23-1cad-4143-9da1-5c615dfaffde] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:06.512642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.513156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.513614 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.514352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:06.514968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:06.515418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:06.532384 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] HTTP exception thrown: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Request method failure captured: Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde HTTP/1.1 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4C9heNS00dbWoH0rw_4Wf7aKs0qCZmBWETh63ObUXLqgt-6O7LmJutRlZ8OYtcRo6LjgFvIeQNcMKpTUXrFUgqRLYvfKu6LJydKemnczeF2wLyIiLgKcsop8KO7HBcIU7QUtN_BES_5HjbkFmSKSVlmdBYXgoWIMplqp6FVM1DfWyw Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a948f68c8ac6410a869e10d5b6022ced"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: a948f68c8ac6410a869e10d5b6022ced Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServerActionsTestJSON-870337887 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 5b615ceccbec48c788e8190cccf44e45 Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServerActionsTestJSON-870337887-project Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0b587c23-1cad-4143-9da1-5c615dfaffde'} Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:06.534274 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Returning 404 to user: Instance 0b587c23-1cad-4143-9da1-5c615dfaffde could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28e60ad9-1ebc-4bd8-ac19-9f94ba42f679 tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde" status: 404 len: 111 microversion: 2.1 time: 0.037696 Aug 25 14:08:06.541897 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3409/6894] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:06 2022] GET /compute/v2.1/servers/0b587c23-1cad-4143-9da1-5c615dfaffde => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:06.545644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b85f79ce-715a-419d-b63d-2127ac2e9b9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] Calling method '.version_select at 0x7fc6c6d0e310>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:06.574991 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b85f79ce-715a-419d-b63d-2127ac2e9b9d tempest-ServerActionsTestJSON-870337887 tempest-ServerActionsTestJSON-870337887-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315040552" status: 202 len: 0 microversion: 2.1 time: 0.033958 Aug 25 14:08:06.576384 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3486/6895] 10.222.0.60 () {58 vars in 1221 bytes} [Thu Aug 25 14:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315040552 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:08:18.360891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:18.362256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=27 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:18.499245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-348847818", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "222a0cf3-fdd7-4076-8157-d1f837e7085d"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:18.559458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] validate_networks() for [('222a0cf3-fdd7-4076-8157-d1f837e7085d', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:08:19.054788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:08:19.055235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:08:19.055767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:08:19.056569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:08:19.057102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:08:19.067101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:19.067605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:19.068051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:19.068847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:19.069314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:19.069748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:19.088134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Getting quotas for project 15f88f62391146f4988c4ad187f1554b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:08:19.093573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Getting quotas for user 43cc08ae142242bba709e49bccfb7c43 and project 15f88f62391146f4988c4ad187f1554b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:08:19.106820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:08:19.109171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:08:19.159692 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d053aa3-402e-4019-b3eb-925df780b555 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804239 Aug 25 14:08:19.160402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3410/6896] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:08:19.170951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=27 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:19.171713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:19.175785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3ab618b9-9e94-4418-ab54-a14ed1297776 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:19.176451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3ab618b9-9e94-4418-ab54-a14ed1297776 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:19.253927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3ab618b9-9e94-4418-ab54-a14ed1297776 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:19.263268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3ab618b9-9e94-4418-ab54-a14ed1297776 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1216 microversion: 2.1 time: 0.094020 Aug 25 14:08:19.272601 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3487/6897] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:19 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:20.285736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:20.286635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:20.296999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:20.297532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:20.298120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:20.299405 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:20.299900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:20.300376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:20.370393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:20.379265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d95157d8-3d5f-4c16-b110-0a03c7c1149d tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1268 microversion: 2.1 time: 0.098029 Aug 25 14:08:20.379890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3411/6898] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:20 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1268 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:21.402326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:21.403099 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:21.411364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:21.411874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:21.412397 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:21.413200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:21.413844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:21.414494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:21.616051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:21.626253 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72538a27-6859-414e-8001-3bfecbe49ab6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.228783 Aug 25 14:08:21.627975 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3488/6899] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:21 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:22.236475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "616673fa-38ea-48c2-ba2c-5e51f51be234", "tag": "3d5d812a-a3ca-420c-a6a1-45bef6a886a2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:22.247741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:22.248388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:22.248916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:22.266769 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] Creating event network-changed:3d5d812a-a3ca-420c-a6a1-45bef6a886a2 for instance 616673fa-38ea-48c2-ba2c-5e51f51be234 on n-h1-850468-18 Aug 25 14:08:22.272631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-29563615-efaf-43e9-9437-58dac47f095b req-e2e366b5-5def-4390-b750-3957b6a99109 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113997 Aug 25 14:08:22.273287 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3412/6900] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:08:22.651805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:22.652808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:22.661389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:22.661784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:22.662227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:22.662942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:22.663591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:22.664212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:22.814511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:22.823015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e43be332-eeb2-47b4-bf0b-40003639e408 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.178041 Aug 25 14:08:22.823614 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3489/6901] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:22 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:23.844883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:23.845604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:23.852832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:23.853387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:23.853954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:23.854669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:23.855136 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:23.855576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:23.999906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:24.008202 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c86305b5-ec2d-4a93-9c75-271082b371d6 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.168382 Aug 25 14:08:24.008988 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3413/6902] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:23 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:25.029610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:25.030240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:25.037960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:25.038458 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:25.038939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:25.040014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:25.040286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:25.040696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:25.182686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:25.191832 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68f4f4ea-1c21-4092-a697-2dbd9f3a68f5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.166141 Aug 25 14:08:25.192556 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3490/6903] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:25 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:26.214291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:26.214923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:26.221957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:26.222455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:26.222907 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:26.223620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:26.224137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:26.224580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:26.369689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:26.379397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1758ef3-2863-45e8-82ee-c531c434c0eb tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.169033 Aug 25 14:08:26.379997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3414/6904] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:26 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:27.404450 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:27.405095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:27.412731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:27.413234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:27.413687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:27.414401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:27.414893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:27.415544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:27.561088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:27.570023 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb4aa948-240c-4c02-a185-e85c74da962f tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.170410 Aug 25 14:08:27.570628 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3491/6905] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:27 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:28.547826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616673fa-38ea-48c2-ba2c-5e51f51be234", "name": "network-vif-plugged", "status": "completed", "tag": "3d5d812a-a3ca-420c-a6a1-45bef6a886a2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:28.561597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:28.562122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:28.562584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:28.575653 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] Creating event network-vif-plugged:3d5d812a-a3ca-420c-a6a1-45bef6a886a2 for instance 616673fa-38ea-48c2-ba2c-5e51f51be234 on n-h1-850468-18 Aug 25 14:08:28.580739 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a239a199-ba71-4f5b-9238-5049d988d2d6 req-7cee7611-35ad-4d66-bb17-46adac2c6c7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036836 Aug 25 14:08:28.581369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3415/6906] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:08:28.592186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:28.592806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:28.599331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:28.599827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:28.600297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:28.601002 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:28.601453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:28.601879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:28.752870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:28.761670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9aa6e255-d04b-4915-9c72-1bc492ca7297 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.174466 Aug 25 14:08:28.762215 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3492/6907] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:28 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:29.783412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:29.784160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:29.786144 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:29.787008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:29.794859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:29.795366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:29.795844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:29.796565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:29.797040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:29.797484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:29.948881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:29.956662 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-579f86e6-5271-465e-ad20-778b4e92698e tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1316 microversion: 2.1 time: 0.177572 Aug 25 14:08:29.957274 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3416/6908] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:29 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:30.978366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:30.979009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:30.980999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:30.987304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:30.987803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:30.988288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:30.989014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:30.989479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:30.989917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:31.132562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:31.141615 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e3df3296-aa6a-4f20-92b4-c116738c4073 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.167179 Aug 25 14:08:31.142196 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3493/6909] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:30 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:31.202707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1719531128", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "222a0cf3-fdd7-4076-8157-d1f837e7085d"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:31.258121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] validate_networks() for [('222a0cf3-fdd7-4076-8157-d1f837e7085d', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:08:31.659163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:08:31.659608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:08:31.660122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:08:31.660562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:08:31.660989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:08:31.672438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:31.672936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:31.673387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:31.674121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:31.674580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:31.675012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:31.695368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Getting quotas for project 15f88f62391146f4988c4ad187f1554b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:08:31.703138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Getting quotas for user 43cc08ae142242bba709e49bccfb7c43 and project 15f88f62391146f4988c4ad187f1554b. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:08:31.717223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:08:31.719897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:08:31.768378 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3f6809db-7e18-4b15-a6c4-545e7c859c41 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569377 Aug 25 14:08:31.769051 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3417/6910] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:08:31.780433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-090fdb6f-535c-4678-aafc-cf0e28fccef5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:31.781075 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-090fdb6f-535c-4678-aafc-cf0e28fccef5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:31.839425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-090fdb6f-535c-4678-aafc-cf0e28fccef5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:31.846400 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-090fdb6f-535c-4678-aafc-cf0e28fccef5 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1217 microversion: 2.1 time: 0.069824 Aug 25 14:08:31.847292 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3494/6911] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:31 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:32.869615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:32.871077 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:32.882900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:32.884152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:32.884895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:32.885885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:32.886579 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:32.887245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:32.952931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:32.960831 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b2e88ff-081c-4096-b05e-d7ef6ae8059c tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1287 microversion: 2.1 time: 0.097035 Aug 25 14:08:32.961403 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3418/6912] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:32 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:33.983662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:33.984429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:33.995815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:33.996504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:33.996993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:33.997735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:33.998438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:33.998648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:34.237806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:34.247266 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-150dfe40-9d5c-47ee-b15e-7441f93033dd tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1317 microversion: 2.1 time: 0.267887 Aug 25 14:08:34.247869 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3495/6913] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:33 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:34.475695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68722a99-4ece-48a2-8db4-39b0bca791cf", "tag": "f1f8579c-eafe-4895-b35c-db96e9533aa2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:34.489661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:34.490485 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:34.490942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:34.505825 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] Creating event network-changed:f1f8579c-eafe-4895-b35c-db96e9533aa2 for instance 68722a99-4ece-48a2-8db4-39b0bca791cf on n-h2-850468-18 Aug 25 14:08:34.512584 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-220a1925-b570-4f78-bb4c-bd0c899a128b req-73e4b3e7-8249-4237-b191-a517899655d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049073 Aug 25 14:08:34.513221 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3419/6914] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:08:35.268893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:35.269551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:35.277600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:35.278102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:35.278548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:35.279266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:35.279729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:35.280189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:35.417916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:35.426888 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b6ad632-1db4-42c1-87f2-583fa268dc11 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1317 microversion: 2.1 time: 0.161870 Aug 25 14:08:35.427482 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3496/6915] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:35 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:36.451414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:36.452169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:36.458530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:36.459183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:36.459632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:36.460371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:36.460844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:36.461281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:36.610768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:36.619281 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9e7b9f56-b3da-4483-b450-3d796f7ace70 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1317 microversion: 2.1 time: 0.174196 Aug 25 14:08:36.620064 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3420/6916] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:36 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:08:37.645050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:37.645674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:37.653565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:37.654068 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:37.654519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:37.655240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:37.655709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:37.656163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:37.803615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:37.815133 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-612693e8-7bd0-4d28-96d6-2a9124cfec69 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1317 microversion: 2.1 time: 0.173925 Aug 25 14:08:37.815713 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3497/6917] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:37 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:38.666870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68722a99-4ece-48a2-8db4-39b0bca791cf", "name": "network-vif-plugged", "status": "completed", "tag": "f1f8579c-eafe-4895-b35c-db96e9533aa2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:38.677770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:38.678269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:38.678755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:38.691268 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] Creating event network-vif-plugged:f1f8579c-eafe-4895-b35c-db96e9533aa2 for instance 68722a99-4ece-48a2-8db4-39b0bca791cf on n-h2-850468-18 Aug 25 14:08:38.697240 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b4a9e0c4-c099-4b7b-9202-71ea0e44db86 req-5ae5e757-6d13-4518-b69e-9ac34134bbc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034339 Aug 25 14:08:38.698117 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3421/6918] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:08:38.835386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:38.836040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:38.843996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:38.844516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:38.844961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:38.845686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:38.846146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:38.846574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:38.987149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:38.996176 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-454b67fd-5d2a-478c-a1f2-7f66c110e5d9 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1317 microversion: 2.1 time: 0.164532 Aug 25 14:08:38.996683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3498/6919] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:38 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:40.019645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:40.021413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:40.029263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.029773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.030276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.030984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.031453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.031884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.261249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:40.271166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-105a1290-e491-48ee-b0d5-fb375563fbc3 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1507 microversion: 2.1 time: 0.257908 Aug 25 14:08:40.271884 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3422/6920] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:40 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:40.293276 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:40.293875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:40.300912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.301400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.301836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.302543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.303001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.303557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.333021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:08:40.425487 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1459adc1-6bc4-4a4e-9732-d2be1a1aed29 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 204 len: 0 microversion: 2.1 time: 0.137210 Aug 25 14:08:40.426401 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3499/6921] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:40 2022] DELETE /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:08:40.435555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:40.436226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:40.442383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.442887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.443341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.444058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:40.444707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:40.445152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:40.584901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:40.593721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-59cdb5f9-efac-4f07-8cfe-d489fdeebaad tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1513 microversion: 2.1 time: 0.162971 Aug 25 14:08:40.594325 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3423/6922] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:40 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:41.617563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:41.619325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:41.626692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:41.627180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:41.627620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:41.628363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:41.628817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:41.629245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:41.819301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:41.828681 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-96d22b7d-7161-43a4-9569-87c03fec3cd0 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 200 len: 1513 microversion: 2.1 time: 0.215403 Aug 25 14:08:41.829283 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3500/6923] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:41 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:42.255544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68722a99-4ece-48a2-8db4-39b0bca791cf", "name": "network-vif-deleted", "tag": "f1f8579c-eafe-4895-b35c-db96e9533aa2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:42.270209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:42.271688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:42.274696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:42.275630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:42.276963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:42.294818 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] Creating event network-vif-deleted:f1f8579c-eafe-4895-b35c-db96e9533aa2 for instance 68722a99-4ece-48a2-8db4-39b0bca791cf on n-h2-850468-18 Aug 25 14:08:42.301510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e73dac77-ae1c-4941-8857-ba91ab3596ef req-c3fff0e6-665b-4743-ab7a-4aa133410bb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048643 Aug 25 14:08:42.302431 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3424/6924] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:08:42.850555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:42.851159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:42.853739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:42.860019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:42.860556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:42.860999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:42.861709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:42.862175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:42.862601 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:42.878158 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf HTTP/1.1 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '68722a99-4ece-48a2-8db4-39b0bca791cf'} Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:42.879871 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 404 to user: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-088c5b80-8de2-475e-a666-a76cffcf2c49 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 404 len: 111 microversion: 2.1 time: 0.034863 Aug 25 14:08:42.884396 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3501/6925] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:42 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:42.892745 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:42.893527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:42.900062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:42.900588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:42.901044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:42.901760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:42.902255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:42.902702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.044665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:43.052698 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d5361b0-6aeb-4bec-a2d6-3cec491b005a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.164134 Aug 25 14:08:43.053294 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3425/6926] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:42 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:08:43.073646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:43.076630 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 7277886f-8268-4785-84f9-503932794d65] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:43.082435 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/7277886f-8268-4785-84f9-503932794d65/action HTTP/1.1 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 32 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: {"resize": {"flavorRef": "452"}} Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '7277886f-8268-4785-84f9-503932794d65', 'body': {'resize': {'flavorRef': '452'}}} Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:43.084292 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 404 to user: Instance 7277886f-8268-4785-84f9-503932794d65 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84077f1e-9dba-4d9b-802f-25a0887e0d25 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "POST /compute/v2.1/servers/7277886f-8268-4785-84f9-503932794d65/action" status: 404 len: 111 microversion: 2.1 time: 0.016400 Aug 25 14:08:43.089624 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3502/6927] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:08:43 2022] POST /compute/v2.1/servers/7277886f-8268-4785-84f9-503932794d65/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:43.095247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:43.095883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:43.102585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.103516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.103985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.104742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.105215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.105660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.245352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:43.253636 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-874930dd-fe37-4f93-9217-fe6c71dfd47b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.162221 Aug 25 14:08:43.254229 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3426/6928] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:43 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:08:43.275706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:43.276367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:43.283615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.284108 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.284575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.285352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.285805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.286233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.771211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:43.779142 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9e22bf67-1b77-4678-9310-0d8dd75e7f37 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.508015 Aug 25 14:08:43.779719 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3503/6929] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:43 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:43.799678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "218993a3-288b-4d6c-a5f4-8d6fde123453"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:43.802229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:43.811499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.812018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.812519 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.813259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.813778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.814224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.861225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:43.867112 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: request: POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action HTTP/1.1 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 65 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: {"resize": {"flavorRef": "218993a3-288b-4d6c-a5f4-8d6fde123453"}} Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: exception: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '616673fa-38ea-48c2-ba2c-5e51f51be234', 'body': {'resize': {'flavorRef': '218993a3-288b-4d6c-a5f4-8d6fde123453'}}} Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:43.876494 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 400 to user: Flavor 218993a3-288b-4d6c-a5f4-8d6fde123453 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-407f433b-c31c-4ad9-8173-5a5103f6fc09 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action" status: 400 len: 107 microversion: 2.1 time: 0.082529 Aug 25 14:08:43.880862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3427/6930] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:08:43 2022] POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action => generated 107 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 14:08:43.889886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:43.890511 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:43.897446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.897941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.898380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:43.899926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:43.900629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:43.901083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.035999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:44.044844 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7fbd0206-5c71-40de-9830-ea4a0337f1ea tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.158775 Aug 25 14:08:44.045427 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3504/6931] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:43 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:44.066471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.067101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.073978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.074474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.074924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.075634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.076471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.076611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.228783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:44.237125 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c08093da-dcab-4a2d-b513-f37fe62e0643 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.174498 Aug 25 14:08:44.237804 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3428/6932] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:44 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:44.258206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba39cec-6688-41ec-b695-64a103296d4a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba39cec-6688-41ec-b695-64a103296d4a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: request: POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action HTTP/1.1 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 29 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: {"resize": {"flavorRef": ""}} Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '616673fa-38ea-48c2-ba2c-5e51f51be234', 'body': {'resize': {'flavorRef': ''}}} Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise error Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi '' Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.262379 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ba39cec-6688-41ec-b695-64a103296d4a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ba39cec-6688-41ec-b695-64a103296d4a tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action" status: 400 len: 113 microversion: 2.1 time: 0.009695 Aug 25 14:08:44.266621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3505/6933] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:08:44 2022] POST /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 14:08:44.272954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.273592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.280213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.280726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.281185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.281911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.282420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.282864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.418994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:44.428106 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-89c10fef-1a49-40f9-870c-751fda4a622b tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1505 microversion: 2.1 time: 0.159113 Aug 25 14:08:44.428723 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3429/6934] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:44 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:44.453909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.454415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.461497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.462040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.462985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.463687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.464164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.464592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.478337 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf HTTP/1.1 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '68722a99-4ece-48a2-8db4-39b0bca791cf'} Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:44.479900 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 404 to user: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bcdb7464-0eaa-4148-ae32-e854f08b9db4 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 404 len: 111 microversion: 2.1 time: 0.031451 Aug 25 14:08:44.483889 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3506/6935] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:44 2022] DELETE /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:44.490272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.490905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 68722a99-4ece-48a2-8db4-39b0bca791cf] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.497299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.497797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.498250 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.498963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.499439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.499882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.514400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf HTTP/1.1 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '68722a99-4ece-48a2-8db4-39b0bca791cf'} Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:44.515957 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 404 to user: Instance 68722a99-4ece-48a2-8db4-39b0bca791cf could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad8fc51b-f4cb-4678-8ff9-b4a49c2c4d36 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf" status: 404 len: 111 microversion: 2.1 time: 0.031165 Aug 25 14:08:44.520527 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3430/6936] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:44 2022] GET /compute/v2.1/servers/68722a99-4ece-48a2-8db4-39b0bca791cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:08:44.526763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.527272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.533263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.533741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.534177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.534868 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.535319 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.535746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.539803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:44.563363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:08:44.658108 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1be704b-c5be-44ee-abd9-d6d5d8656171 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "DELETE /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 204 len: 0 microversion: 2.1 time: 0.135117 Aug 25 14:08:44.659338 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3507/6937] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:08:44 2022] DELETE /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:08:44.671550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:44.672442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:44.679258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.679760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.680811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.681545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:44.682010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:44.682452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:44.821988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:44.830472 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-16368a4a-ec6a-4e10-b3c4-e059029ae496 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1511 microversion: 2.1 time: 0.165457 Aug 25 14:08:44.831067 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3431/6938] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:44 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:08:45.854054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:45.854761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:45.862336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:45.862836 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:45.863281 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:45.864007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:45.864507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:45.864937 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:46.019854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:46.029351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-97f1a226-8fcf-4d9b-9841-b54c8ae74c42 tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1511 microversion: 2.1 time: 0.180881 Aug 25 14:08:46.030049 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3508/6939] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:45 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:46.956342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616673fa-38ea-48c2-ba2c-5e51f51be234", "name": "network-vif-deleted", "tag": "3d5d812a-a3ca-420c-a6a1-45bef6a886a2"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:08:46.970287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:46.970781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:46.971223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:46.987610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=100 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:08:46.990082 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] Creating event network-vif-deleted:3d5d812a-a3ca-420c-a6a1-45bef6a886a2 for instance 616673fa-38ea-48c2-ba2c-5e51f51be234 on n-h1-850468-18 Aug 25 14:08:46.997679 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d4d6145e-e11b-4aad-b216-12c0c92ff0e0 req-1ddefa2d-091e-4b1e-b168-080062413f9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045122 Aug 25 14:08:46.998469 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3432/6940] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:08:47.051271 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:47.052060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:47.059951 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:47.060910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:47.061357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:47.062300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:47.062774 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:47.063304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:47.134072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cc08ae142242bba709e49bccfb7c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f88f62391146f4988c4ad187f1554b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:08:47.142060 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6e3ab7da-4cb7-430a-bee0-39c038f064fc tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 200 len: 1301 microversion: 2.1 time: 0.094957 Aug 25 14:08:47.142641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3509/6941] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:47 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:08:48.163899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:08:48.165505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] [instance: 616673fa-38ea-48c2-ba2c-5e51f51be234] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:08:48.174005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:48.174512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:48.174962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:48.177020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:08:48.177020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:08:48.177020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:08:48.195155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] HTTP exception thrown: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Request method failure captured: Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 HTTP/1.1 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4JSS-jGDs5ERRi3vY3Qk1uwawaPSE_Mkklreqx04Obbbcbhpo4wIzQe5HTIf71C3D6rEu-Eg5CdP9z5ZCJbShb6zOX8TcnNzjGPUI_5Grc6BOQqxAmYEScmw50zkmeDgwKZ28PW53UEY99bFAyLz4KWJ19iIUjzBaoTKVfODCnwU74 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_15f88f62391146f4988c4ad187f1554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/15f88f62391146f4988c4ad187f1554b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 15f88f62391146f4988c4ad187f1554b Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-ServersNegativeTestJSON-215597260 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 43cc08ae142242bba709e49bccfb7c43 Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-ServersNegativeTestJSON-215597260-project Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '616673fa-38ea-48c2-ba2c-5e51f51be234'} Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:08:48.197590 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] Returning 404 to user: Instance 616673fa-38ea-48c2-ba2c-5e51f51be234 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-45fd25ce-73e3-4252-81c0-c16d3f27efbf tempest-ServersNegativeTestJSON-215597260 tempest-ServersNegativeTestJSON-215597260-project] 10.222.0.60 "GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234" status: 404 len: 111 microversion: 2.1 time: 0.039509 Aug 25 14:08:48.202613 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3433/6942] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:08:48 2022] GET /compute/v2.1/servers/616673fa-38ea-48c2-ba2c-5e51f51be234 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:09:24.990894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:24.993662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:25.296254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d932cec9-7388-4f79-9c23-782dc750c373 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: .version_select at 0x7fc6c201fee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2000377160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0mMPv3ZpqaJ3uAK9amYtrUZjLI8ElgWRtTcsSH/bTTeeFhC5xy6Frt2GYKbeO0bTeHfMTrXLfg0QXtt6Gz9bx4ySD+6vd1mAnePfJl7g7QnTIfTNWjxJsg9APNhY0ZTg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:25.314202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d932cec9-7388-4f79-9c23-782dc750c373 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:09:25.321340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d932cec9-7388-4f79-9c23-782dc750c373 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:09:25.356517 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d932cec9-7388-4f79-9c23-782dc750c373 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.372616 Aug 25 14:09:25.357137 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3510/6943] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:09:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:25.409338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1779855244", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2000377160", "networks": [{"uuid": "aebe3520-2242-41c3-aee1-b6d7445f89e8"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:25.419801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:25.420558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:25.421567 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:09:25.421726 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:09:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 14:09:25.479160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] validate_networks() for [('aebe3520-2242-41c3-aee1-b6d7445f89e8', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:09:25.943427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:09:25.943868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:09:25.944994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:09:25.945915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:09:25.946428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:09:25.956737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:25.957335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:25.957854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:25.958686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:25.959226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:25.959736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:25.981088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:09:25.988084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:09:26.005642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:09:26.009010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:09:26.065409 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91aba4b3-5c3a-433d-b8d1-7d735b4b6f74 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659891 Aug 25 14:09:26.066098 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3434/6944] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:09:26.080532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b36ed9d9-58e3-420c-91db-7e655371925f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:26.081736 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b36ed9d9-58e3-420c-91db-7e655371925f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:26.166520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b36ed9d9-58e3-420c-91db-7e655371925f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:26.177425 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b36ed9d9-58e3-420c-91db-7e655371925f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1263 microversion: 2.1 time: 0.103092 Aug 25 14:09:26.178723 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3511/6945] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:26 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1263 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:27.202901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:27.203562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:27.216946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:27.216946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:27.216946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:27.217608 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:27.218184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:27.218566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:27.342086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:27.352155 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-07a4284a-6e4d-4356-b88f-12219cae85f0 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1323 microversion: 2.1 time: 0.153841 Aug 25 14:09:27.352950 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3435/6946] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:27 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:28.376165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:28.376698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:28.385092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:28.385589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:28.386034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:28.386759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:28.387409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:28.388019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:28.571525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:28.587215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f86960c0-af60-42cb-a356-df11330c1126 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.216015 Aug 25 14:09:28.603393 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3512/6947] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:28 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:29.033841 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfeefb5-6985-4036-81d0-5a327c49d88a", "tag": "40f2d8bc-dc83-48e1-8768-3192f6616d7f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:29.051990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.052784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.054135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.079655 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] Creating event network-changed:40f2d8bc-dc83-48e1-8768-3192f6616d7f for instance 1dfeefb5-6985-4036-81d0-5a327c49d88a on n-h2-850468-18 Aug 25 14:09:29.091510 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-31f3e7f1-38f0-4318-834d-b5aa85477061 req-275df49a-1b9b-41b6-9707-a30ddb0cc16f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064108 Aug 25 14:09:29.093193 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3436/6948] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:29.611186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:29.611806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:29.622178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.623094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.624231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.625646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:29.626445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:29.627246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:29.803101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:29.813054 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-27861596-2aa5-4336-896e-9162678cbf1c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.205880 Aug 25 14:09:29.813940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3513/6949] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:29 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:30.836262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:30.836992 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:30.843450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:30.843942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:30.844413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:30.845123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:30.845597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:30.846024 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:30.996378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:31.004572 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-01c85812-4721-4752-82ae-572af5331391 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.174006 Aug 25 14:09:31.005428 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3437/6950] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:30 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:32.030938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:32.031756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:32.040029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:32.040556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:32.041006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:32.041725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:32.042185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:32.042616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:32.191123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:32.200744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d3222b0-bd72-4c8e-a264-188f1d028dcc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.175048 Aug 25 14:09:32.201348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3514/6951] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:32 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:09:33.221478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:33.222338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:33.230627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.231195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.231597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.232394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:33.232864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:33.233310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:33.401331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:33.416716 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e651ccce-df2d-407c-ba88-bf03a4cb157c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.199063 Aug 25 14:09:33.417370 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3438/6952] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:33 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:34.440013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:34.440613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:34.448544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:34.449044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:34.449488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:34.450206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:34.450662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:34.451125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:34.607516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:34.616656 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-85e51643-82d3-4bc5-9cf3-505a3789e6a3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.180499 Aug 25 14:09:34.617405 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3515/6953] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:34 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:35.153740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfeefb5-6985-4036-81d0-5a327c49d88a", "name": "network-vif-plugged", "status": "completed", "tag": "40f2d8bc-dc83-48e1-8768-3192f6616d7f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:35.164936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:35.165424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:35.165890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:35.184731 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] Creating event network-vif-plugged:40f2d8bc-dc83-48e1-8768-3192f6616d7f for instance 1dfeefb5-6985-4036-81d0-5a327c49d88a on n-h2-850468-18 Aug 25 14:09:35.190760 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0996d65d-396f-48e4-9f77-bebb80583d9d req-2a4342ac-9524-4d26-8848-bca054701710 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131797 Aug 25 14:09:35.191402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3439/6954] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:35.638109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:35.639003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:35.646213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:35.646712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:35.647149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:35.648532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:35.648989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:35.649419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:35.811514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:35.820357 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-809c71d9-06aa-4c7a-89fc-6af6809d1991 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1363 microversion: 2.1 time: 0.185996 Aug 25 14:09:35.820969 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3516/6955] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:35 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:36.843981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:36.844856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:36.849998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:36.851620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:36.859876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:36.860416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:36.860874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:36.861618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:36.862089 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:36.862532 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:37.028334 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:37.036831 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a265a3e2-7d3f-437d-be2b-56069a2e1474 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1555 microversion: 2.1 time: 0.193746 Aug 25 14:09:37.037442 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3440/6956] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:36 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:37.059883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:37.060544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:37.062467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:37.070159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:37.070660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:37.071291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:37.072331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:37.072975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:37.073599 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:37.222492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:37.233094 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ea287062-4807-46cd-88cc-19774e910103 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1555 microversion: 2.1 time: 0.177348 Aug 25 14:09:37.233703 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3517/6957] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:37 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:09:38.932503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd94bc06-05b5-4c8f-b100-e3aa7e39cc07"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:09:38.935174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:38.942339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:38.942835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:38.943292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:38.944038 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:38.944555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:38.945001 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:39.209310 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c53f99cd-5633-4859-ab46-4b85daa1a6e7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280671 Aug 25 14:09:39.210210 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3441/6958] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:09:38 2022] POST /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:09:49.998206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:49.998875 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:50.001644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:50.002349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=36 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:50.010059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:50.010559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:50.010992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:50.011708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:50.012192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:50.012626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:50.099443 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lazy-loading 'services' on Instance uuid 1dfeefb5-6985-4036-81d0-5a327c49d88a {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:09:50.176686 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4a4581f-765e-4b76-8305-a0c11faa4e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments/cd94bc06-05b5-4c8f-b100-e3aa7e39cc07" status: 202 len: 0 microversion: 2.1 time: 0.182282 Aug 25 14:09:50.177607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3518/6959] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:09:49 2022] DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments/cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:09:50.189609 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:50.192664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:50.197491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:50.198207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:09:50.208918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:50.210010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:50.210227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:50.211387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:50.212014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:50.212498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:50.247672 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bba7c5ff-0661-4954-9179-cc8a20884c94 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063679 Aug 25 14:09:50.248284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3442/6960] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:50 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:51.262005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:51.265961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:51.273088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:51.273603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:51.274057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:51.274771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:51.275227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:51.275656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:51.310504 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3a5a6b3d-1de8-4f4d-b04d-71ec7bb1855b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053950 Aug 25 14:09:51.311099 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3519/6961] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:51 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:52.323809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:52.326029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:52.333407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:52.333910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:52.334489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:52.335211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:52.335679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:52.336196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:52.376477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-403d2c3b-575d-4a82-856d-6ef93e9fffbe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057612 Aug 25 14:09:52.377124 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3443/6962] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:52 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:53.393290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:53.395759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:53.403619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:53.404134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:53.404588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:53.405311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:53.405775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:53.406205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:53.442834 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-58b222bc-bdf8-4c0a-8731-22db99ac99e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053525 Aug 25 14:09:53.444328 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3520/6963] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:53 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:09:54.457534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:54.461312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:54.468375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:54.468885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:54.469338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:54.470066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:54.470535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:54.471029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:54.504765 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-056b05bd-2a6b-4243-abf5-4026763befc8 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052229 Aug 25 14:09:54.505350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3444/6964] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:54 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:09:55.519145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:55.521406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:55.529519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:55.530014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:55.530453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:55.531167 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:55.531625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:55.532056 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:55.564804 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7354305-15ee-42ca-ae85-25e4eaca3022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049848 Aug 25 14:09:55.565395 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3521/6965] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:09:55 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:09:55.577660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:55.578292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:55.585845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:55.586351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:55.586810 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:55.587569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:55.588045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:55.588517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:55.679057 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a is not attached to volume cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments/cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 HTTP/1.1 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a is not attached to volume cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': '1dfeefb5-6985-4036-81d0-5a327c49d88a', 'id': 'cd94bc06-05b5-4c8f-b100-e3aa7e39cc07'} Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cd94bc06-05b5-4c8f-b100-e3aa7e39cc07. Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a is not attached to volume cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:09:55.685099 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a is not attached to volume cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a is not attached to volume cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35959913-aca8-42ad-a5c5-b731b6a12441 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments/cd94bc06-05b5-4c8f-b100-e3aa7e39cc07" status: 404 len: 154 microversion: 2.1 time: 0.113634 Aug 25 14:09:55.690033 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3445/6966] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:09:55 2022] DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a/os-volume_attachments/cd94bc06-05b5-4c8f-b100-e3aa7e39cc07 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:09:59.065685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:59.066441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:59.072769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:59.073265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:59.073705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:59.074573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:59.074872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:59.075302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:59.105947 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:09:59.196382 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f463f646-57f8-4b1b-9dd4-7bb548fa290f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 204 len: 0 microversion: 2.1 time: 0.134568 Aug 25 14:09:59.196869 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3522/6967] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:09:59 2022] DELETE /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:09:59.205661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:09:59.206283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:09:59.213463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:59.213962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:59.214407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:59.215123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:09:59.215584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:09:59.216017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:09:59.369138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:09:59.379736 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ecc2ae4b-e69a-4c25-aeef-ca2528d8e0c1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1561 microversion: 2.1 time: 0.178040 Aug 25 14:09:59.380368 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3446/6968] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:09:59 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:10:00.403017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:00.403791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:00.411390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:00.411884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:00.412592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:00.413585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:00.414062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:00.414498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:00.558545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:00.567528 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7395de61-cbc4-459c-a470-782289cc58ca tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1561 microversion: 2.1 time: 0.168586 Aug 25 14:10:00.568158 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3523/6969] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:00 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:01.503446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfeefb5-6985-4036-81d0-5a327c49d88a", "name": "network-vif-deleted", "tag": "40f2d8bc-dc83-48e1-8768-3192f6616d7f"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:01.520765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:01.521441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:01.522870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:01.537627 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] Creating event network-vif-deleted:40f2d8bc-dc83-48e1-8768-3192f6616d7f for instance 1dfeefb5-6985-4036-81d0-5a327c49d88a on n-h2-850468-18 Aug 25 14:10:01.545958 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7537120b-942f-47cd-937c-cfbbd1f2ed31 req-2d8cd728-7768-46e4-bd25-08a8d3e7c758 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Aug 25 14:10:01.546604 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3447/6970] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:10:01.594486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:01.595534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:01.604390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:01.605311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:01.605536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:01.606427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:01.606997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:01.607457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:01.653985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:01.654869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:01.655666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:01.656508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lazy-loading 'fault' on Instance uuid 1dfeefb5-6985-4036-81d0-5a327c49d88a {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:10:01.709981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:01.718902 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7e346b3-9e2f-4f1d-a389-2b7c8f609ab9 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 200 len: 1353 microversion: 2.1 time: 0.128877 Aug 25 14:10:01.719491 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3524/6971] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:01 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 1353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:02.742060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:02.742695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 1dfeefb5-6985-4036-81d0-5a327c49d88a] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:02.750212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:02.750721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:02.751177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:02.751888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:02.752383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:02.752820 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:02.767677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a HTTP/1.1 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '1dfeefb5-6985-4036-81d0-5a327c49d88a'} Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:02.769386 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance 1dfeefb5-6985-4036-81d0-5a327c49d88a could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e31df8f3-6ea3-49f4-9555-54f047980e73 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a" status: 404 len: 111 microversion: 2.1 time: 0.034674 Aug 25 14:10:02.774570 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3448/6972] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:02 2022] GET /compute/v2.1/servers/1dfeefb5-6985-4036-81d0-5a327c49d88a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:10:02.780723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d64b1bd1-2f19-430d-b2e9-b2e4823135b1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '.version_select at 0x7fc6c2596430>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:02.802669 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d64b1bd1-2f19-430d-b2e9-b2e4823135b1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2000377160" status: 202 len: 0 microversion: 2.1 time: 0.025727 Aug 25 14:10:02.803688 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3525/6973] 10.222.0.60 () {58 vars in 1278 bytes} [Thu Aug 25 14:10:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2000377160 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:10:02.822603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b0c67e78-8c0a-457f-98b5-c088e7e74f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: .version_select at 0x7fc6c162f310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-951894016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjXaDK+AtIXpLHXTCCeQVcpwjUjzcIb1eqJyE2w33VBFb7gY8EnyRv3JneFvUCmF5XiLwB+sA3OGifmnmZIshmvC7DACWSZ2cPW8Bs7zFw9L6gPCXpc7aMmgzBdFdagYQ=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:02.838823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b0c67e78-8c0a-457f-98b5-c088e7e74f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:10:02.844324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-b0c67e78-8c0a-457f-98b5-c088e7e74f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:10:02.875486 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b0c67e78-8c0a-457f-98b5-c088e7e74f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057216 Aug 25 14:10:02.876107 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3449/6974] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:10:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:02.931386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-932266106", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-951894016", "networks": [{"uuid": "aebe3520-2242-41c3-aee1-b6d7445f89e8"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:02.990667 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] validate_networks() for [('aebe3520-2242-41c3-aee1-b6d7445f89e8', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:10:03.407710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:10:03.408166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:10:03.408648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:10:03.409059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:10:03.409472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:10:03.419700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:03.420306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:03.420768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:03.421502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:03.421993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:03.422489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:03.445076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:10:03.456106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:10:03.471652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:10:03.474128 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:10:03.532336 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-418de8ee-c5fa-44a7-bb29-158d72a6eec5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605264 Aug 25 14:10:03.533033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3526/6975] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:10:03.545825 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ad1385f-f88a-4a72-b3d0-e01936c53472 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:03.546463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ad1385f-f88a-4a72-b3d0-e01936c53472 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:03.619890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7ad1385f-f88a-4a72-b3d0-e01936c53472 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:03.628325 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ad1385f-f88a-4a72-b3d0-e01936c53472 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1261 microversion: 2.1 time: 0.087257 Aug 25 14:10:03.629101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3450/6976] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:03 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:10:04.666912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:04.667923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:04.674900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:04.675516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:04.675959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:04.676757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:04.677213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:04.678293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:04.770781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:04.780595 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-65ad5ab2-54f2-4edb-8328-144a69dde6bc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1321 microversion: 2.1 time: 0.122640 Aug 25 14:10:04.781414 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3527/6977] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:04 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1321 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:05.815566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:05.816722 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:05.827185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:05.827871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:05.828384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:05.829366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:05.829888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:05.830483 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:06.007983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:06.016611 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7d698934-5b6e-4b8a-8c4d-e20c41472812 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.205108 Aug 25 14:10:06.017373 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3451/6978] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:05 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:06.239311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3f2192-6e37-46a5-a03a-05b235224e9b", "tag": "162fee68-6f30-40f9-96ce-e6b1143923fa"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:06.252656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:06.253145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:06.253587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:06.278078 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] Creating event network-changed:162fee68-6f30-40f9-96ce-e6b1143923fa for instance da3f2192-6e37-46a5-a03a-05b235224e9b on n-h2-850468-18 Aug 25 14:10:06.283617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5d813e04-2b79-403e-857b-c57e0984be73 req-d1bb6556-d4a0-4722-8e32-2327985a9533 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048976 Aug 25 14:10:06.284430 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3528/6979] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:07.040037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:07.040727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:07.047740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:07.048276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:07.048732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:07.049451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:07.049920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:07.050359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:07.191057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:07.199460 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3426d302-1673-4b60-8301-6dd094df58a7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.164268 Aug 25 14:10:07.200055 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3452/6980] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:07 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:08.222741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:08.223486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:08.230761 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:08.231269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:08.231718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:08.232505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:08.232994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:08.233434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:08.403434 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:08.412743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-526a4ad3-fa15-4a4c-83f2-6dfe29be6c23 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.194840 Aug 25 14:10:08.413839 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3529/6981] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:08 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:10:09.440009 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:09.440757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:09.450253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:09.450863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:09.451607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:09.452592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:09.453112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:09.453889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:09.604447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:09.612643 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9181aee6-4d52-499b-bd6d-096114d53e92 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.179206 Aug 25 14:10:09.613240 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3453/6982] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:09 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:10.635140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:10.635794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:10.643127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:10.643609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:10.644051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:10.644787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:10.645243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:10.645664 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:10.790154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:10.798201 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4667ba1f-b5e9-4432-8ba8-0d1adf52b18c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.167715 Aug 25 14:10:10.798784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3530/6983] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:10 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:11.088487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3f2192-6e37-46a5-a03a-05b235224e9b", "name": "network-vif-plugged", "status": "completed", "tag": "162fee68-6f30-40f9-96ce-e6b1143923fa"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:11.099277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:11.100418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:11.101105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:11.115814 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] Creating event network-vif-plugged:162fee68-6f30-40f9-96ce-e6b1143923fa for instance da3f2192-6e37-46a5-a03a-05b235224e9b on n-h2-850468-18 Aug 25 14:10:11.121439 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-aff1eb5d-b7a6-41b7-94dc-17a94d8ca49d req-b6b838ba-35c7-4eef-aff3-f0e207424edf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037239 Aug 25 14:10:11.122161 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3454/6984] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:11.821344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:11.821977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:11.830020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:11.830544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:11.830979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:11.831785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:11.832286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:11.832723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:11.988013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:11.997498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-760618d0-73cc-4872-a73e-e83ffd016f3f tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1361 microversion: 2.1 time: 0.182221 Aug 25 14:10:11.998105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3531/6985] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:11 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:13.020740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:13.022521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:13.029505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:13.030008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:13.030465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:13.031178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:13.031643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:13.032081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:13.175837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:13.185429 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d2fbe19d-2995-4b74-9bf9-734e21612180 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1553 microversion: 2.1 time: 0.170077 Aug 25 14:10:13.186036 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3455/6986] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:13 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:13.206515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:13.207174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:13.215286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:13.215787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:13.216290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:13.217017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:13.217481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:13.217916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:13.373394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:13.383086 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47dffcfc-31d9-4ee1-b74a-15a71a3f28e6 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1553 microversion: 2.1 time: 0.180565 Aug 25 14:10:13.383687 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3532/6987] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:13 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:14.985085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "624b6e1b-5e32-48b3-bf3c-fe2165a1554e"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:14.987714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:14.990118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:14.997225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:14.997736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:14.998193 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:14.998932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:14.999400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:14.999838 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:15.326555 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7263f6e-22fc-4aa4-b501-a91d9977c9d3 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345395 Aug 25 14:10:15.327818 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3456/6988] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:10:14 2022] POST /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:27.311866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:27.312437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:27.314431 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.315156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.316893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.318189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.326131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:27.326665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:27.327121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:27.327840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:27.328332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:27.328765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:27.424256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lazy-loading 'services' on Instance uuid da3f2192-6e37-46a5-a03a-05b235224e9b {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:10:27.508639 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-89a444c8-55e9-4101-8606-0dd74fda5eb4 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments/624b6e1b-5e32-48b3-bf3c-fe2165a1554e" status: 202 len: 0 microversion: 2.1 time: 0.201066 Aug 25 14:10:27.509265 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3533/6989] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:10:27 2022] DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments/624b6e1b-5e32-48b3-bf3c-fe2165a1554e => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:10:27.516046 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.517298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:27.523621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:27.525313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:27.533830 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:27.534681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:27.535477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:27.535607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:27.536357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:27.537340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:27.582139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-613c774b-df35-438b-93f8-3ab3bdf318fe tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065892 Aug 25 14:10:27.582139 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3457/6990] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:27 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:28.595986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:28.600213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:28.607124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:28.607614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:28.608052 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:28.608791 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:28.609246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:28.609671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:28.650916 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7d1083a9-5f64-4ed4-beac-2d1372bd1426 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060266 Aug 25 14:10:28.651527 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3534/6991] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:28 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:10:29.669071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:29.671891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:29.684151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:29.684151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:29.684151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:29.684151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:29.686215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:29.686215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:29.731970 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35646ebb-a4b0-4dc7-84bd-c59c9353acc1 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071889 Aug 25 14:10:29.732729 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3458/6992] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:29 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:30.747084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:30.749449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:30.758103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:30.758549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:30.758997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:30.759726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:30.760220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:30.760659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:30.799646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e77f705a-8db0-4b77-8c1d-190370270f70 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056682 Aug 25 14:10:30.800282 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3535/6993] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:30 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:31.812516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:31.814961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:31.824967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:31.825469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:31.825929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:31.826780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:31.827425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:31.827770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:31.863820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2e786a4b-391f-447d-b66c-75edb2918251 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056189 Aug 25 14:10:31.865799 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3459/6994] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:31 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:32.877921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:32.880188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:32.886897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:32.887437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:32.887923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:32.888719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:32.889219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:32.889718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:32.923648 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b745c7f4-48c7-4a33-be39-3c2e9efd2779 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050604 Aug 25 14:10:32.924281 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3536/6995] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:10:32 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:10:32.936060 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:32.936661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:32.945118 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:32.945773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:32.946807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:32.946959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:32.947455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:32.947876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:33.037675 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance da3f2192-6e37-46a5-a03a-05b235224e9b is not attached to volume 624b6e1b-5e32-48b3-bf3c-fe2165a1554e Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments/624b6e1b-5e32-48b3-bf3c-fe2165a1554e HTTP/1.1 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance da3f2192-6e37-46a5-a03a-05b235224e9b is not attached to volume 624b6e1b-5e32-48b3-bf3c-fe2165a1554e Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': 'da3f2192-6e37-46a5-a03a-05b235224e9b', 'id': '624b6e1b-5e32-48b3-bf3c-fe2165a1554e'} Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 624b6e1b-5e32-48b3-bf3c-fe2165a1554e. Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3f2192-6e37-46a5-a03a-05b235224e9b is not attached to volume 624b6e1b-5e32-48b3-bf3c-fe2165a1554e Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:33.039265 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3f2192-6e37-46a5-a03a-05b235224e9b is not attached to volume 624b6e1b-5e32-48b3-bf3c-fe2165a1554e Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance da3f2192-6e37-46a5-a03a-05b235224e9b is not attached to volume 624b6e1b-5e32-48b3-bf3c-fe2165a1554e {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3a5eea4-5bc3-4d73-8fff-8e053f46ab78 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments/624b6e1b-5e32-48b3-bf3c-fe2165a1554e" status: 404 len: 154 microversion: 2.1 time: 0.109422 Aug 25 14:10:33.046997 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3460/6996] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:10:32 2022] DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b/os-volume_attachments/624b6e1b-5e32-48b3-bf3c-fe2165a1554e => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:10:37.556536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:37.557740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:37.565815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:37.566322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:37.566773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:37.568135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:37.568893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:37.569049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:37.601088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:10:37.699454 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ec04dc62-6508-4ea6-812c-38f5c30e1a4c tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 204 len: 0 microversion: 2.1 time: 0.149981 Aug 25 14:10:37.700329 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3537/6997] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:10:37 2022] DELETE /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:10:37.712634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:37.713337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:37.721265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:37.721808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:37.722299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:37.723023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:37.723494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:37.724890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:37.899801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:37.909722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d16c284-caf8-4b01-ae4d-c665b5a6fe15 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1559 microversion: 2.1 time: 0.204029 Aug 25 14:10:37.910348 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3461/6998] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:37 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:38.934747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:38.935475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:38.942880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:38.943461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:38.943898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:38.944671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:38.945147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:38.945574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:39.104626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:39.113802 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a409ec74-9ff2-4a19-af96-3803d94bbe88 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1559 microversion: 2.1 time: 0.183514 Aug 25 14:10:39.114475 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3538/6999] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:38 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:10:40.137747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:40.138600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:40.148505 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:40.149019 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:40.149515 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:40.150281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:40.150921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:40.151412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:40.233172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:40.247763 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76553026-59f5-431f-becb-78a6b54a52c2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 200 len: 1517 microversion: 2.1 time: 0.111265 Aug 25 14:10:40.258986 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3462/7000] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:40 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 1517 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:40.319033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3f2192-6e37-46a5-a03a-05b235224e9b", "name": "network-vif-deleted", "tag": "162fee68-6f30-40f9-96ce-e6b1143923fa"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:40.335398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:40.336279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:40.337065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:40.356847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] Creating event network-vif-deleted:162fee68-6f30-40f9-96ce-e6b1143923fa for instance da3f2192-6e37-46a5-a03a-05b235224e9b on n-h2-850468-18 Aug 25 14:10:40.363795 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cb006e3d-84f9-40cc-9859-8aa3bd7dee2b req-f6ca5971-2f39-4382-a3fa-e6e69207f08f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052255 Aug 25 14:10:40.365308 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3539/7001] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:41.275570 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:41.276256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: da3f2192-6e37-46a5-a03a-05b235224e9b] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:41.290618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:41.291186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:41.291717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:41.292582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:41.293073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:41.293610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:41.309457 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b HTTP/1.1 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'da3f2192-6e37-46a5-a03a-05b235224e9b'} Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:41.311075 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance da3f2192-6e37-46a5-a03a-05b235224e9b could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9686333d-77a7-4399-b942-b1d1dc4af4ac tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b" status: 404 len: 111 microversion: 2.1 time: 0.041537 Aug 25 14:10:41.316290 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3463/7002] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:41 2022] GET /compute/v2.1/servers/da3f2192-6e37-46a5-a03a-05b235224e9b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:10:41.326377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7c6fc76f-cae3-452d-bf3b-3c09abb61f79 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '.version_select at 0x7fc6c17bb820>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:41.351538 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7c6fc76f-cae3-452d-bf3b-3c09abb61f79 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-951894016" status: 202 len: 0 microversion: 2.1 time: 0.030308 Aug 25 14:10:41.352187 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3540/7003] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:10:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-951894016 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:10:41.371363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-27d0da0e-258a-4e65-ae83-4cf6e48e068b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: .version_select at 0x7fc6c25f6430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-653109146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe+OSC7oWkeSpcDfmh5i4uVSpNf8b2NQlMtEy4KCOGc4snXmddxamj8ilgeVxiIATBgYaqXWeWIBAy/ubOb8P1Em5BGlewy59xYlXSGmLiPntjstvmiDdtA6NXhZ6ucCQ=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:41.388712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-27d0da0e-258a-4e65-ae83-4cf6e48e068b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:10:41.401756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-27d0da0e-258a-4e65-ae83-4cf6e48e068b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:10:41.436839 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-27d0da0e-258a-4e65-ae83-4cf6e48e068b tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.069751 Aug 25 14:10:41.437437 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3464/7004] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:10:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:41.493876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1209488817", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-653109146", "networks": [{"uuid": "aebe3520-2242-41c3-aee1-b6d7445f89e8"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:41.551120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] validate_networks() for [('aebe3520-2242-41c3-aee1-b6d7445f89e8', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:10:41.968364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:10:41.968802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:10:41.969332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:10:41.969750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:10:41.970209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:10:41.981110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:41.981596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:41.982041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:41.982781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:41.983239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:41.983685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:42.002901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:10:42.009096 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Getting quotas for user 8385cf92105e4991acddb8736b2ed767 and project 6b2edff3ff804d909d1460d228beb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:10:42.022751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:10:42.025227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:10:42.076096 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8fa6955b-166c-481a-83c6-5867a4d65d77 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587394 Aug 25 14:10:42.076879 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3541/7005] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:10:42.089797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d6a6200d-eea7-44c8-9cb7-269e12370999 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:42.090536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d6a6200d-eea7-44c8-9cb7-269e12370999 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:42.151785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d6a6200d-eea7-44c8-9cb7-269e12370999 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:42.162436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d6a6200d-eea7-44c8-9cb7-269e12370999 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1262 microversion: 2.1 time: 0.077224 Aug 25 14:10:42.163146 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3465/7006] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:42 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:43.189892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:43.190841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:43.199810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:43.200576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:43.202457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:43.203172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:43.203717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:43.204071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:43.304972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:43.313876 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8cd2cb1-0972-435a-ac79-0b204d649290 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1320 microversion: 2.1 time: 0.128349 Aug 25 14:10:43.314488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3542/7007] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:43 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1320 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:44.337793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:44.338451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:44.345135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:44.345638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:44.346090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:44.346807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:44.347269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:44.347706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:44.486143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:44.496927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d1461102-d94f-4001-aae1-656903db506a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.163048 Aug 25 14:10:44.497444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3466/7008] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:44 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:10:44.514497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743917f2-3d9b-40f2-8e12-8af3a0ff395e", "tag": "5d23aeed-6efa-4f6b-b302-25ccebab8beb"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:44.534378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:44.534889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:44.535315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:44.547000 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] Creating event network-changed:5d23aeed-6efa-4f6b-b302-25ccebab8beb for instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e on n-h2-850468-18 Aug 25 14:10:44.551799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d20865ac-4589-4d17-8870-7b3f080cbc67 req-e44c8689-a54b-4a85-a552-bc891aa4483a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041987 Aug 25 14:10:44.552637 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3543/7009] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:45.519299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:45.519993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:45.528660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:45.529173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:45.529631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:45.530366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:45.530833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:45.531285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:45.682732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:45.693991 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f9aaaf0-b1be-41a7-9328-992cc85c73b5 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.178023 Aug 25 14:10:45.694763 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3467/7010] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:45 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:46.716282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:46.717291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:46.723579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:46.724623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:46.725135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:46.725863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:46.726326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:46.726758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:46.866483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:46.874568 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57a42853-6ced-4d24-94f8-f66945fd3b37 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.163384 Aug 25 14:10:46.875150 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3544/7011] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:46 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:47.895655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:47.896994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:47.904181 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:47.904691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:47.905140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:47.905863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:47.906329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:47.906767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:48.047867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:48.056645 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6d76b02c-aaa1-46e8-91bb-d9595e13919a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.164852 Aug 25 14:10:48.057265 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3468/7012] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:47 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:49.078746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:49.079362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:49.087070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:49.087559 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:49.088007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:49.088744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:49.089198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:49.089626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:49.235887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:49.244316 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1cfd3390-5982-4982-a91f-faff0be2754e tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.169392 Aug 25 14:10:49.244915 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3545/7013] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:49 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:49.300572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743917f2-3d9b-40f2-8e12-8af3a0ff395e", "name": "network-vif-plugged", "status": "completed", "tag": "5d23aeed-6efa-4f6b-b302-25ccebab8beb"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:49.313389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:49.314656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:49.315208 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:49.331631 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] Creating event network-vif-plugged:5d23aeed-6efa-4f6b-b302-25ccebab8beb for instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e on n-h2-850468-18 Aug 25 14:10:49.339430 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-fa7eeaa0-9757-4906-98b2-82d4a15090ef req-2c7b6464-384d-419a-94b1-056206f97e9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042785 Aug 25 14:10:49.340143 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3469/7014] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:10:50.265079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:50.265751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:50.272955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:50.273451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:50.273896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:50.274608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:50.275054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:50.275482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:50.415462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:50.423503 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5aff5a88-62f0-4166-b87d-a715c5a27276 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1362 microversion: 2.1 time: 0.162313 Aug 25 14:10:50.424221 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3546/7015] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:50 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:51.447767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:51.448415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:51.456027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:51.456547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:51.456994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:51.457702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:51.458165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:51.459988 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:51.611619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:51.622704 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-71a8c3f2-724a-41d5-bb27-85754de78d6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1554 microversion: 2.1 time: 0.180454 Aug 25 14:10:51.623368 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3470/7016] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:51 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:51.649351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:10:51.649976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:51.657393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:51.657886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:51.658330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:51.659064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:51.659580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:51.659958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:51.800184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:10:51.809349 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6217cfea-5215-4e16-9b7c-28532bb25f75 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1554 microversion: 2.1 time: 0.164543 Aug 25 14:10:51.809937 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3547/7017] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:10:51 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:10:53.362033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a87f2893-6270-4e89-ad9f-ec454996bff2"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:10:53.365363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:10:53.367336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:10:53.374137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:53.374641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:53.375127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:53.375856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:10:53.376349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:10:53.376788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:10:53.651434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa34c4b7-67fa-40e7-a82f-6a6e587fd079 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "POST /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293332 Aug 25 14:10:53.652250 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3471/7018] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:10:53 2022] POST /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:04.430357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:04.431014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:04.433034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.433711 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.434718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.435330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.441997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.442486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.442927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.444206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.444921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.445342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.536491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lazy-loading 'services' on Instance uuid 743917f2-3d9b-40f2-8e12-8af3a0ff395e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:11:04.618415 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d919d2d2-e256-4379-bad3-d13a11ca6915 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments/a87f2893-6270-4e89-ad9f-ec454996bff2" status: 202 len: 0 microversion: 2.1 time: 0.192439 Aug 25 14:11:04.619417 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3548/7019] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:11:04 2022] DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments/a87f2893-6270-4e89-ad9f-ec454996bff2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:11:04.626043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.627329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:04.632869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:04.635264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:04.644754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.645259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.645719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.646520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:04.647034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:04.647477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:04.682770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-98a45b16-1c16-4b8c-860e-53b2dd1f5e6d tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058671 Aug 25 14:11:04.683282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3472/7020] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:04 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:11:05.698973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:05.704187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:05.715229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:05.715795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:05.716272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:05.717007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:05.717464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:05.717897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:05.757793 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3c524844-1be0-4110-a782-6809066ce3de tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065135 Aug 25 14:11:05.758432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3549/7021] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:05 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:06.770911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:06.773910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:06.782014 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:06.782518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:06.783012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:06.783765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:06.784272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:06.784712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:06.821904 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d48034e-82e1-458c-9a33-0ae7edd16715 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055279 Aug 25 14:11:06.822501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3473/7022] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:06 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:07.835796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:07.838461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:07.847123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:07.847438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:07.847803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:07.848584 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:07.849051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:07.849482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:07.897178 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-965a7823-2500-48e1-bdab-2e35d877e2fc tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066173 Aug 25 14:11:07.898222 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3550/7023] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:07 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:08.913279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:08.915664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:08.922661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:08.923161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:08.923603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:08.924381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:08.924845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:08.925282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:08.958301 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e356f702-b9dd-4b44-ab77-67dd589db71a tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049234 Aug 25 14:11:08.958763 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3474/7024] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:08 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:09.971187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:09.973407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:09.980942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:09.981428 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:09.981869 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:09.982578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:09.983030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:09.983462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:10.013071 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e7251717-53b8-49c8-aecf-d26a2c1b98cd tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045828 Aug 25 14:11:10.013641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3551/7025] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:11:09 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:11:10.025698 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:10.026288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:10.033363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:10.033861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:10.034444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:10.035028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:10.035526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:10.035958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:10.119312 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e is not attached to volume a87f2893-6270-4e89-ad9f-ec454996bff2 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: request: DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments/a87f2893-6270-4e89-ad9f-ec454996bff2 HTTP/1.1 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e is not attached to volume a87f2893-6270-4e89-ad9f-ec454996bff2 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'server_id': '743917f2-3d9b-40f2-8e12-8af3a0ff395e', 'id': 'a87f2893-6270-4e89-ad9f-ec454996bff2'} Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a87f2893-6270-4e89-ad9f-ec454996bff2. Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e is not attached to volume a87f2893-6270-4e89-ad9f-ec454996bff2 Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:10.120967 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e is not attached to volume a87f2893-6270-4e89-ad9f-ec454996bff2 Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e is not attached to volume a87f2893-6270-4e89-ad9f-ec454996bff2 {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79feab08-0769-4905-9e4a-09ff46798606 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments/a87f2893-6270-4e89-ad9f-ec454996bff2" status: 404 len: 154 microversion: 2.1 time: 0.102093 Aug 25 14:11:10.125282 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3475/7026] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:11:10 2022] DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e/os-volume_attachments/a87f2893-6270-4e89-ad9f-ec454996bff2 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:11:13.495231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:13.496344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:13.502374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.502870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.503313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.504031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.504529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.504973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.533789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:11:13.631693 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7867f59a-3b41-4acd-820d-b3bf13523c01 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 204 len: 0 microversion: 2.1 time: 0.142437 Aug 25 14:11:13.632831 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3552/7027] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:11:13 2022] DELETE /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:11:13.644660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:13.645814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:13.657189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.657852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.658312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.659061 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:13.659540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:13.659985 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:13.812091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:13.821935 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34c6d4bd-2182-4586-acf0-ef971f6181d2 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1560 microversion: 2.1 time: 0.181754 Aug 25 14:11:13.822661 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3476/7028] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:13 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:14.845154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:14.845782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:14.853958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:14.854444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:14.854886 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:14.855591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:14.856041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:14.856487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:15.003426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:15.012467 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-623e4744-948c-47d3-9129-bb67c167a361 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1560 microversion: 2.1 time: 0.171571 Aug 25 14:11:15.013075 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3553/7029] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:14 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:15.767102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743917f2-3d9b-40f2-8e12-8af3a0ff395e", "name": "network-vif-deleted", "tag": "5d23aeed-6efa-4f6b-b302-25ccebab8beb"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:15.780380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:15.780888 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:15.781338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:15.794581 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] Creating event network-vif-deleted:5d23aeed-6efa-4f6b-b302-25ccebab8beb for instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e on n-h2-850468-18 Aug 25 14:11:15.799683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-42a9e434-f4a9-4e3b-9cda-c75da33decf5 req-673ac047-c7e8-4bf8-a2e5-cabb71847f50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Aug 25 14:11:15.800335 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3477/7030] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:16.034174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:16.034797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:16.043187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.043680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.044151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.044860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.045309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.045734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.085447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:16.086279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:16.086590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:16.087059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lazy-loading 'fault' on Instance uuid 743917f2-3d9b-40f2-8e12-8af3a0ff395e {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:11:16.132236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8385cf92105e4991acddb8736b2ed767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2edff3ff804d909d1460d228beb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:16.141065 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-831de0c7-a1dc-440c-97c2-16b75257f868 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 200 len: 1352 microversion: 2.1 time: 0.110719 Aug 25 14:11:16.141800 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3554/7031] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:16 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:17.167399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:17.168133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] [instance: 743917f2-3d9b-40f2-8e12-8af3a0ff395e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:17.174452 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:17.175047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:17.175430 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:17.176162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:17.176637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:17.177081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:17.191574 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] HTTP exception thrown: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Request method failure captured: Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e HTTP/1.1 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4KOf2dSNOx7OSk_Nlegy-HqJNK_ZpovVwzW2g6H5Kn95FPLFsdXW8ZABOpMT3Z2O8btl0eUktzlM_VTZBOhx3uXrtDDozWeqLwkEl3ocUifnMUZToWnIRVmTXH1QaQCMtNIey1Z7L9o4RohX4lnYuvt1KLByfa_Fg3ltkUCue-ENvY Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6b2edff3ff804d909d1460d228beb0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 6b2edff3ff804d909d1460d228beb0c9 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673741007 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 8385cf92105e4991acddb8736b2ed767 Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673741007-project Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '743917f2-3d9b-40f2-8e12-8af3a0ff395e'} Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:17.193790 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Returning 404 to user: Instance 743917f2-3d9b-40f2-8e12-8af3a0ff395e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5e7782c0-67e8-4ada-9353-0167587f2be7 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e" status: 404 len: 111 microversion: 2.1 time: 0.033315 Aug 25 14:11:17.198990 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3478/7032] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:17 2022] GET /compute/v2.1/servers/743917f2-3d9b-40f2-8e12-8af3a0ff395e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:11:17.204081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-14ed5211-9fe8-46fb-bedc-0522ba446022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] Calling method '.version_select at 0x7fc6c6c94af0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:17.226004 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-14ed5211-9fe8-46fb-bedc-0522ba446022 tempest-TestEncryptedCinderVolumes-1673741007 tempest-TestEncryptedCinderVolumes-1673741007-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-653109146" status: 202 len: 0 microversion: 2.1 time: 0.025642 Aug 25 14:11:17.226621 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3555/7033] 10.222.0.60 () {58 vars in 1275 bytes} [Thu Aug 25 14:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-653109146 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:11:46.688664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4d657f2b-3941-4168-b28b-c9caf5a8e032 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: .version_select at 0x7fc6c10c7e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-256935679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjdo9LM1c27RtsFrOkrnmfwPiMErqGfPkChfFMcwLXKsCQkjOgeCYMwzZMhlJVT9hugRQy/bCEAuZJ9JSJIH+7k1dUSKDCjDvH6wDT71PrIbot/Kg1eAa3ih9QPw6Atg=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:46.694919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=14 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:46.695604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=34 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:46.708707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4d657f2b-3941-4168-b28b-c9caf5a8e032 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for project fba039076a1f40b8b07052b97675de76. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:11:46.714706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4d657f2b-3941-4168-b28b-c9caf5a8e032 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for user 9437f7eb2e8a42819c3eef13131cc3f2 and project fba039076a1f40b8b07052b97675de76. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:11:46.741324 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4d657f2b-3941-4168-b28b-c9caf5a8e032 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056950 Aug 25 14:11:46.742211 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3479/7034] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:11:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:46.793729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:46.794468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:46.798480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1313649707", "imageRef": "83f0ba07-cea4-4dbb-bfe9-8535be6b5af4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-256935679", "networks": [{"uuid": "84d925cf-560b-4b51-a239-ab3ed0b9d543"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:46.855655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] validate_networks() for [('84d925cf-560b-4b51-a239-ab3ed0b9d543', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:11:47.336762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:11:47.337186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:11:47.337663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:11:47.338074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:11:47.338495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:11:47.347345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:47.347824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:47.348295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:47.349903 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:47.350468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:47.350892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:47.367756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for project fba039076a1f40b8b07052b97675de76. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:11:47.373213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for user 9437f7eb2e8a42819c3eef13131cc3f2 and project fba039076a1f40b8b07052b97675de76. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:11:47.386069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:11:47.388327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='83f0ba07-cea4-4dbb-bfe9-8535be6b5af4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:11:47.439123 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6eb37ac7-f968-4991-9502-ed71f74362bd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647532 Aug 25 14:11:47.439785 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3556/7035] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:11:47.452277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6ec3807d-f7b7-43a8-ae47-82706099f03e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:47.452998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6ec3807d-f7b7-43a8-ae47-82706099f03e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:47.641833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6ec3807d-f7b7-43a8-ae47-82706099f03e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:47.650947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6ec3807d-f7b7-43a8-ae47-82706099f03e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1258 microversion: 2.1 time: 0.202745 Aug 25 14:11:47.652056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3480/7036] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:47 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:48.674059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:48.675745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:48.685856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:48.686369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:48.686862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:48.687623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:48.688196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:48.688905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:48.861245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:48.883833 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e26d15e7-1e88-4bc1-9f2a-10af8d5144ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1316 microversion: 2.1 time: 0.215482 Aug 25 14:11:48.885787 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3557/7037] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:48 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:49.911911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:49.912753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:49.920093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:49.920735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:49.921197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:49.921922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:49.922400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:49.922847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:50.076908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:50.088347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3daae54e-48e8-4f4f-bc7a-05a0d9c4292d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.180791 Aug 25 14:11:50.089993 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3481/7038] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:49 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:51.109843 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:51.110413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:51.119201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:51.119704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:51.120176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:51.120907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:51.121367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:51.121803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:51.268933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:51.279139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bb6efc1b-20a1-466c-a20a-f7b6003a7cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.173067 Aug 25 14:11:51.280031 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3558/7039] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:51 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:52.300656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:52.301314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:52.309393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:52.309900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:52.310349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:52.311070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:52.311549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:52.312267 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:52.467850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:52.478531 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c491e183-b4d2-44ee-8138-3fb0eda64bdf tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.181668 Aug 25 14:11:52.492141 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3482/7040] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:52 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:53.509147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:53.509778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:53.523683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:53.524735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:53.525505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:53.526810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:53.527591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:53.529935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:53.709131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:53.721951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e756a032-ed6e-489d-8cb1-a96cbc39372e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.219472 Aug 25 14:11:53.723105 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3559/7041] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:53 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:54.744845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:54.745513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:54.752949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:54.753627 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:54.754294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:54.755201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:54.755688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:54.756279 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:54.951437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:54.960927 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8a4082f4-f353-4159-90b2-c824639927d1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.219893 Aug 25 14:11:54.961708 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3483/7042] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:54 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:55.982948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:55.983655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:55.992457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:55.992972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:55.993407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:55.994141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:55.994604 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:55.995314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:56.163257 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:56.173741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0119c32c-fb7f-42ea-a100-bddbd917a2fc tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.194603 Aug 25 14:11:56.174349 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3560/7043] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:55 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:57.196054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:57.196732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:57.204015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:57.204575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:57.205035 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:57.205756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:57.206234 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:57.206682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:57.345257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:57.353434 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-76bdfe88-aff6-47ae-bf0a-7db0d0392421 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.161804 Aug 25 14:11:57.354044 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3484/7044] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:57 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:57.579642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:11:57.589337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:57.591259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:57.600413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:57.601101 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:57.601554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:57.615215 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] Creating event network-changed:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:11:57.620887 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d8c840d9-6115-4326-b0ed-f7e7ba2f72c1 req-8fb15ecb-29c9-4bb1-ba2a-52a8658f3563 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045228 Aug 25 14:11:57.621757 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3561/7045] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:11:58.374892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:58.375497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:58.377403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:11:58.384463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:58.384968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:58.385472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:58.386185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:58.386648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:58.387079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:58.528133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:58.536846 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d613a69-c169-4e23-b4fe-4c22d875ffd0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.165010 Aug 25 14:11:58.537441 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3485/7046] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:58 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:11:59.562609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:11:59.563969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:11:59.572856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:59.573528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:59.574352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:59.578133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:11:59.578652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:11:59.579172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:11:59.763648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:11:59.771801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aec7203e-09b9-443d-b85f-414de9d815ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.215486 Aug 25 14:11:59.772481 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3562/7047] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:11:59 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:00.793121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:00.793858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:00.800740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:00.801248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:00.802286 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:00.803013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:00.803477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:00.803908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:00.943455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:00.952436 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6cb3ea25-7c3d-46f9-942d-96713e737d07 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.163009 Aug 25 14:12:00.953124 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3486/7048] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:00 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:01.641141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "name": "network-vif-plugged", "status": "completed", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:12:01.652460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:01.652978 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:01.653489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:01.666141 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] Creating event network-vif-plugged:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:12:01.671405 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-94ce2dce-18f2-412d-907d-71c832635ae9 req-396ff95a-3d79-4348-aa89-69c1df96c79d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034139 Aug 25 14:12:01.672000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3563/7049] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:12:01.975039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:01.975855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:01.983018 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:01.983544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:01.984197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:01.984937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:01.985415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:01.985863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:02.127892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:02.136214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f587655f-9791-4179-a90d-c3a2a9353511 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1358 microversion: 2.1 time: 0.165124 Aug 25 14:12:02.136812 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3487/7050] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:01 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:03.159411 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:03.160102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:03.166860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.167337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.167810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.168491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.168946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.169368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.305380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:03.313610 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34922d5c-6674-4a1f-809d-112b016ad7cd tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1547 microversion: 2.1 time: 0.159308 Aug 25 14:12:03.314181 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3564/7051] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:03 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:03.334617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:03.335254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:03.342302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.342805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.343262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.343983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.344480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.344924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.484661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:03.492625 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed69c96e-2334-4c20-811c-b08d7183da43 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1547 microversion: 2.1 time: 0.162571 Aug 25 14:12:03.493208 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3488/7052] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:03 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:03.512948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:03.517676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:03.518454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Searching by: {'deleted': False, 'project_id': 'fba039076a1f40b8b07052b97675de76'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 14:12:03.525400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.525878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.526322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.527074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.527529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.528065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.557425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 14:12:03.585852 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-26c5b8e1-2f99-4a15-b801-908630c958bb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.076702 Aug 25 14:12:03.586445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3565/7053] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 14:12:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:12:03.597781 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:03.598480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:03.604679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.605188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.605644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.606367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:03.606844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:03.607291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:03.744186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:03.752156 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-067af131-267f-423e-a932-8bdbd0599703 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1547 microversion: 2.1 time: 0.158276 Aug 25 14:12:03.752762 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3489/7054] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:03 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:05.318655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6606a9c-5c9a-4893-8760-14ccb37e5af6"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:12:05.321037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:05.331070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:05.331842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:05.332315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:05.333693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:05.334151 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:05.334580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:05.602047 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-541c11fe-4cad-424f-bcec-90b8ef3de7a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287302 Aug 25 14:12:05.602829 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3566/7055] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:12:05 2022] POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:12:18.681121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:18.681757 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:18.685090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:12:18.685807 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=54 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:12:18.691866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:18.692512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:18.692957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:18.693686 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:18.694149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:18.694589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:18.835725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:18.844432 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7a09ae6f-ac19-4eca-a387-bba354f54b85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1593 microversion: 2.1 time: 0.167084 Aug 25 14:12:18.845017 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3490/7056] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:18 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1593 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:20.889945 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:12:20.890714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:12:20.891367 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:12:20.896207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:12:20.911081 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:20.911571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:20.912010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:20.925191 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] Creating event network-changed:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:12:20.930196 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-68b76b6f-3972-40b1-9057-455277b7b4f9 req-49931a9a-a043-44ba-83d5-39f78bd176de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041956 Aug 25 14:12:20.932344 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3567/7057] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:12:22.131449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-30798695"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:12:22.132043 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:22.138901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:22.139402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:22.139847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:22.140588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:22.141053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:22.141488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:22.282242 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Adding security group 9d938916-e90f-4ebb-a313-8e00d8e6ef2b to port 682d7254-5b28-4242-9a24-93d89cfadef6 Aug 25 14:12:22.634058 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-331627b6-a29b-4def-8d01-95d6cb22f9a0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action" status: 202 len: 0 microversion: 2.1 time: 0.505167 Aug 25 14:12:22.634058 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3491/7058] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:12:22 2022] POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:12:22.651194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:12:22.653614 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:12:22.667959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:22.668696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:22.669702 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:22.670964 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:22.671810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:22.672652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:22.850329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:12:22.858838 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-29b1a5ba-3119-4f08-8510-94b8e05d0a91 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1757 microversion: 2.1 time: 0.220813 Aug 25 14:12:22.859421 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3568/7059] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:12:22 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:12:22.944898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:12:22.954917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:12:22.955501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:12:22.956020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:12:22.967836 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] Creating event network-changed:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:12:22.973569 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b9b2c7b9-7e0e-4e7d-96ee-178b308fed21 req-08284282-1990-4a7a-a608-bedb59a15c8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031843 Aug 25 14:12:22.974178 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3492/7060] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:14:00.903953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:00.905266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:00.906857 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:14:00.907066 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action (ip 10.222.0.60) !!! Aug 25 14:14:00.913758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:14:00.915979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:00.924923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:00.925416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:00.925881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:00.926561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:00.927015 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:00.927441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.026626 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a0c19e6b-d939-41d6-ac26-763acfb914f2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action" status: 202 len: 0 microversion: 2.1 time: 0.125443 Aug 25 14:14:01.030784 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3569/7061] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:14:00 2022] POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:14:01.035356 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 14:14:01.036892 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 14:14:01.037943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:01.039299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:14:01.041913 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:14:01.042096 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:14:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f (ip 10.222.0.60) !!! Aug 25 14:14:01.051521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:01.052855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:01.065372 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:01.065890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:01.066351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.067078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:01.067805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:01.068416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:01.251502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:01.260640 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3e874622-7a9f-48d3-8f18-74a2850dbe69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1759 microversion: 2.1 time: 0.227867 Aug 25 14:14:01.262337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3493/7062] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:01 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1759 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:14:02.285345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:14:02.286065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:14:02.293593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:02.294095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:02.294536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:02.295251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:14:02.295714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:14:02.296177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:14:02.456824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:14:02.467133 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db3b2243-256e-4e4f-abda-4ad07c741e08 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1757 microversion: 2.1 time: 0.187503 Aug 25 14:14:02.467746 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3570/7063] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:14:02 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:15.285643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:15.286368 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:15.291481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-30798695"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:15.292055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:15.305071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:15.305329 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:15.305710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:15.306460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:15.306947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:15.307375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:15.316601 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53908. Aug 25 14:15:15.317456 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53910. Aug 25 14:15:15.457095 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Removing security group 9d938916-e90f-4ebb-a313-8e00d8e6ef2b from port 682d7254-5b28-4242-9a24-93d89cfadef6 Aug 25 14:15:15.821614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4bfc5167-d5db-4480-99ee-3d33b14605b5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action" status: 202 len: 0 microversion: 2.1 time: 0.538647 Aug 25 14:15:15.822811 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3494/7064] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:15:15 2022] POST /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:15:15.834507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:15.835553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:15.986521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:15.999805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:16.000631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:16.001079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:16.015395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] Creating event network-changed:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:15:16.022633 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1cc4fdaf-08c3-4a99-9fc5-bdbb69ad64aa req-a7045084-f803-4ef5-8cc0-26aba2b88a41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193865 Aug 25 14:15:16.023404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3571/7065] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:17.157728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:17.158349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:17.164602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:17.165102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:17.165558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:17.166277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:17.166748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:17.167189 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:17.256307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lazy-loading 'services' on Instance uuid c4fbcd04-62d2-4129-ba87-2e3c438dc22f {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:15:17.333893 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [cff465d7-3510-4e55-b8f0-27d90e026621] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:15:18.043259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:18.053997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:18.054610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:18.055047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:18.068407 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] Creating event network-changed:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:15:18.073129 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-801b171a-a54a-45fc-a1c3-4582865bb052 req-bb5be53d-5237-4fce-a44c-16d13fe5fd96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035452 Aug 25 14:15:18.073725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3572/7066] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:15:18.343250 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [cff465d7-3510-4e55-b8f0-27d90e026621] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53940. Aug 25 14:15:18.347630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0b0cbfa-527f-4507-ae69-b0e0dbfffc88 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments/f6606a9c-5c9a-4893-8760-14ccb37e5af6" status: 202 len: 0 microversion: 2.1 time: 1.195150 Aug 25 14:15:18.348385 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3495/7067] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:15:17 2022] DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments/f6606a9c-5c9a-4893-8760-14ccb37e5af6 => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:15:18.366010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:18.366010 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:18.369217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:18.369973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:18.370610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:18.371935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:18.372812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:18.373203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:18.411072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-98f000eb-9711-4594-9631-5d0f0a32d934 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057462 Aug 25 14:15:18.411652 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3573/7068] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:18 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:15:19.425122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:19.427738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:19.436486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:19.436928 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:19.437378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:19.438097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:19.438562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:19.438999 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:19.470947 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-37cab906-0b3d-4490-a56a-a57b4611daf0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050995 Aug 25 14:15:19.471537 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3496/7069] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:19 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:20.484277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:20.486491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:20.494472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:20.494973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:20.495419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:20.496194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:20.497229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:20.497686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:20.536421 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3024c30c-0572-4db9-a0b1-0c271b9e3d55 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057122 Aug 25 14:15:20.537021 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3574/7070] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:20 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:21.550396 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:21.553150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:21.561884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:21.562395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:21.562846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:21.563741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:21.564243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:21.564685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:21.617754 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7242a325-f1a9-4dc6-9b29-1939d297a981 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071812 Aug 25 14:15:21.618363 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3497/7071] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:21 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:15:22.639242 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:22.642921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:22.656730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:22.657567 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:22.658370 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:22.659658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:22.660287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:22.660833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:22.698355 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-739caef4-520e-423f-a436-9069d6e8a619 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066787 Aug 25 14:15:22.698940 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3575/7072] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:22 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:15:23.712349 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:23.714641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:23.725546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:23.727429 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:23.728304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:23.729667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:23.730587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:23.732052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:23.768989 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-91d00b3d-4ad5-41ac-865d-1b405daeeb49 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060941 Aug 25 14:15:23.769598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3498/7073] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:15:23 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 14:15:23.789138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:23.790060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:23.802377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:23.803362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:23.804212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:23.805478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:23.806462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:23.807248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:23.908652 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] HTTP exception thrown: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f is not attached to volume f6606a9c-5c9a-4893-8760-14ccb37e5af6 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Request method failure captured: Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments/f6606a9c-5c9a-4893-8760-14ccb37e5af6 HTTP/1.1 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4MTdMh6TUQr2Xxm2F0c5ykfMVDp-TgYz9PU9QvIpXh_2qK2-U-xvCPB8tCdX85YzdsqMBEp0GrOAFwqBvzT9aMb-S_URD8x1s4-nSKTlmpDg6GGQaGXSmVp1v2sHGKnSUHYpn4tepqG4xoMxcJZOSH3JuVm7SASkRHTDuE6-4MH6OU Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fba039076a1f40b8b07052b97675de76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fba039076a1f40b8b07052b97675de76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9437f7eb2e8a42819c3eef13131cc3f2 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f is not attached to volume f6606a9c-5c9a-4893-8760-14ccb37e5af6 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': 'c4fbcd04-62d2-4129-ba87-2e3c438dc22f', 'id': 'f6606a9c-5c9a-4893-8760-14ccb37e5af6'} Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6606a9c-5c9a-4893-8760-14ccb37e5af6. Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f is not attached to volume f6606a9c-5c9a-4893-8760-14ccb37e5af6 Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:23.910775 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f is not attached to volume f6606a9c-5c9a-4893-8760-14ccb37e5af6 Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Returning 404 to user: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f is not attached to volume f6606a9c-5c9a-4893-8760-14ccb37e5af6 {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67a4489e-f72b-4274-ae8d-1ec55a18ab0d tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments/f6606a9c-5c9a-4893-8760-14ccb37e5af6" status: 404 len: 154 microversion: 2.1 time: 0.130978 Aug 25 14:15:23.917012 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3576/7074] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:15:23 2022] DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f/os-volume_attachments/f6606a9c-5c9a-4893-8760-14ccb37e5af6 => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:15:27.205581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:27.206259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:27.214099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:27.214597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:27.215580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:27.216721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:27.217249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:27.217701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:27.248049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:15:27.359270 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1803af77-aaeb-43b8-9bdf-95b9e0352460 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 204 len: 0 microversion: 2.1 time: 0.156662 Aug 25 14:15:27.360751 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3499/7075] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:15:27 2022] DELETE /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:15:27.371575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:27.372534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:27.385168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:27.385788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:27.386295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:27.387332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:27.387792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:27.389310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:27.555206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:27.566015 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f73a397c-f4ef-4f4b-8782-6d4bfcd3a9a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1553 microversion: 2.1 time: 0.199103 Aug 25 14:15:27.566624 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3577/7076] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:27 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:28.590849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:28.591576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:28.600965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:28.601484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:28.601966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:28.602791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:28.603270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:28.603742 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:28.752257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:28.760561 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b72d06c7-e103-47f2-97ea-a88e1fc33c69 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1553 microversion: 2.1 time: 0.174835 Aug 25 14:15:28.761149 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3500/7077] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:28 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:29.653074 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fbcd04-62d2-4129-ba87-2e3c438dc22f", "name": "network-vif-deleted", "tag": "682d7254-5b28-4242-9a24-93d89cfadef6"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:29.663316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:29.664077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:29.664725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:29.679965 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] Creating event network-vif-deleted:682d7254-5b28-4242-9a24-93d89cfadef6 for instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f on n-h2-850468-18 Aug 25 14:15:29.689967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-071ff19c-f28c-4b02-9a76-ddd3b8cbca30 req-3e56afa7-4724-47e5-837a-6509c7521e84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111347 Aug 25 14:15:29.689967 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3578/7078] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:15:29.782646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:29.783327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:29.790814 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:29.791325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:29.791778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:29.792554 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:29.793022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:29.793730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:29.830263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:29.830679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:29.831139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:29.831611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lazy-loading 'fault' on Instance uuid c4fbcd04-62d2-4129-ba87-2e3c438dc22f {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:15:29.889345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:29.898820 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e0735643-cf1f-4da6-bcc5-1dceeea33880 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 200 len: 1348 microversion: 2.1 time: 0.120517 Aug 25 14:15:29.899670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3501/7079] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:29 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 1348 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:15:30.936259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:30.936988 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: c4fbcd04-62d2-4129-ba87-2e3c438dc22f] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:30.944378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:30.944874 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:30.945316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:30.946033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:30.946493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:30.946926 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:30.961378 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] HTTP exception thrown: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Request method failure captured: Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f HTTP/1.1 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4MTdMh6TUQr2Xxm2F0c5ykfMVDp-TgYz9PU9QvIpXh_2qK2-U-xvCPB8tCdX85YzdsqMBEp0GrOAFwqBvzT9aMb-S_URD8x1s4-nSKTlmpDg6GGQaGXSmVp1v2sHGKnSUHYpn4tepqG4xoMxcJZOSH3JuVm7SASkRHTDuE6-4MH6OU Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fba039076a1f40b8b07052b97675de76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fba039076a1f40b8b07052b97675de76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9437f7eb2e8a42819c3eef13131cc3f2 Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'c4fbcd04-62d2-4129-ba87-2e3c438dc22f'} Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:15:30.963053 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Returning 404 to user: Instance c4fbcd04-62d2-4129-ba87-2e3c438dc22f could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da486cf3-7948-4d05-b2fc-421feda38381 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f" status: 404 len: 111 microversion: 2.1 time: 0.033186 Aug 25 14:15:30.972632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3579/7080] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:30 2022] GET /compute/v2.1/servers/c4fbcd04-62d2-4129-ba87-2e3c438dc22f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:15:30.978774 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8ff19df9-2a90-4851-abf2-0b113c97a3df tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '.version_select at 0x7fc6c107ee50>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:30.987211 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ff19df9-2a90-4851-abf2-0b113c97a3df tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:15:31.995584 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ff19df9-2a90-4851-abf2-0b113c97a3df tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [16ef0665-0b35-4984-aaa7-ffa84f5c569d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53984. Aug 25 14:15:32.018620 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8ff19df9-2a90-4851-abf2-0b113c97a3df tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-256935679" status: 202 len: 0 microversion: 2.1 time: 1.046000 Aug 25 14:15:32.019444 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3502/7081] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 14:15:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-256935679 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:15:41.409509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4458727b-2f82-49c8-b7b1-087bd1540685 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: .version_select at 0x7fc6c18853a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-631752522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM7Mh5WeHLWMwZ1bIa2YBKTBYp5ZOoVpc3QX96JYBfk8obpBMpXp6DNkuz+sefHiuK0nDZKsME8qlon+LaNIbcgn+gj+yhOokALBke6Yzo4gbT9hVL9rlWAqWkOmg9f0A=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:41.416353 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:15:41.416598 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Aug 25 14:15:41.420358 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:41.421119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=38 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:41.442786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4458727b-2f82-49c8-b7b1-087bd1540685 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for project fba039076a1f40b8b07052b97675de76. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:15:41.448486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-4458727b-2f82-49c8-b7b1-087bd1540685 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for user 9437f7eb2e8a42819c3eef13131cc3f2 and project fba039076a1f40b8b07052b97675de76. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:15:41.484356 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4458727b-2f82-49c8-b7b1-087bd1540685 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.078254 Aug 25 14:15:41.485492 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3580/7082] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:15:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:41.538743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:41.543785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-782450576", "imageRef": "8feff409-ac7b-4660-9d70-4f885b4ec0e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-631752522", "networks": [{"uuid": "84d925cf-560b-4b51-a239-ab3ed0b9d543"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:41.604691 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] validate_networks() for [('84d925cf-560b-4b51-a239-ab3ed0b9d543', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:15:42.200213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:15:42.200687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:15:42.201325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:15:42.201784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:15:42.202227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:15:42.216145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:42.216648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:42.217107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:42.217877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:42.218343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:42.218818 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:42.238466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for project fba039076a1f40b8b07052b97675de76. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:15:42.244638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Getting quotas for user 9437f7eb2e8a42819c3eef13131cc3f2 and project fba039076a1f40b8b07052b97675de76. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:15:42.259591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:15:42.262042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8feff409-ac7b-4660-9d70-4f885b4ec0e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:15:42.315700 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a50d74bd-e49d-4479-9784-5521bba280a2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778695 Aug 25 14:15:42.316414 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3503/7083] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 14:15:42.329194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9de5bc02-df4c-4e49-8f33-59801f2249ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:42.329911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9de5bc02-df4c-4e49-8f33-59801f2249ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:42.398910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9de5bc02-df4c-4e49-8f33-59801f2249ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:42.407854 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9de5bc02-df4c-4e49-8f33-59801f2249ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1257 microversion: 2.1 time: 0.084120 Aug 25 14:15:42.408501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3581/7084] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:42 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:43.440595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4b7117d6-18ac-470d-9498-570abce0b3b7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:43.442248 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4b7117d6-18ac-470d-9498-570abce0b3b7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:43.500198 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4b7117d6-18ac-470d-9498-570abce0b3b7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:43.507613 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4b7117d6-18ac-470d-9498-570abce0b3b7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1257 microversion: 2.1 time: 0.074383 Aug 25 14:15:43.508340 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3504/7085] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:43 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:15:44.529730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:44.530451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:44.538908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:44.539438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:44.539893 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:44.540685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:44.541181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:44.541616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:44.612589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:44.623507 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84e2c6dc-cdee-462c-aece-2af37580039b tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1261 microversion: 2.1 time: 0.096344 Aug 25 14:15:44.623507 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3582/7086] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:44 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:45.646576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:45.648670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:45.657670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:45.660800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:45.661721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:45.662555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:45.664005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:45.664860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:45.665875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:45.807068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:45.817493 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b41fa916-3796-4924-8879-9a57db400ed8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1317 microversion: 2.1 time: 0.175598 Aug 25 14:15:45.818458 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3505/7087] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:45 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:46.843766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:46.848266 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:46.862927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:46.864575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:46.866155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:46.867700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:46.868764 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:46.870113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:47.180799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:47.191874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-682b47e5-95aa-40e9-9217-78ff2ba9f70e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.355578 Aug 25 14:15:47.228637 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3583/7088] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:46 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:48.249167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:48.251605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:48.282876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:48.284420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:48.284908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:48.286103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:48.286651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:48.287530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:48.504067 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:15:48.525535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:48.528860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:48.529605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:48.556962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] Creating event network-changed:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:15:48.557492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:48.568027 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8b989322-da46-40b8-8cfa-ab5ebbb7e501 req-b240d5f5-c808-49e3-9a66-6ac9961646f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067992 Aug 25 14:15:48.574594 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-401c6ca8-3759-4916-8e00-0cf6e77e5538 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.333649 Aug 25 14:15:48.575703 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3506/7089] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:48 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:48.576228 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3584/7090] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:15:49.598010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:49.599819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:49.612548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:49.613675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:49.614667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:49.615736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:49.616948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:49.618138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:49.833840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:49.845172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-11627b87-1e26-449f-80e5-a900f3c16b89 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.251606 Aug 25 14:15:49.846148 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3507/7091] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:49 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:50.870863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:50.873506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:50.883012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:50.883872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:50.884407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:50.885340 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:50.886110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:50.887322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:51.036913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:51.048275 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-92a71c4c-7f3f-4c7e-bdab-6b2bdb3e6545 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.182845 Aug 25 14:15:51.049126 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3585/7092] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:50 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:52.074937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:52.076478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:52.090700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:52.091665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:52.092545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:52.093978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:52.094997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:52.095729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:52.227242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:52.314352 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:52.325477 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-652a2cfa-d8f4-4b72-8663-21da40f14110 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.257449 Aug 25 14:15:52.326196 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3508/7093] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:52 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:15:53.348649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:53.349357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:53.352798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:53.358725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:53.359312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:53.359826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:53.360640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:53.361176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:53.361681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:53.547496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:53.556184 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-34d2035b-3a17-4a12-8b3f-6c7871d0ec57 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.211381 Aug 25 14:15:53.556871 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3586/7094] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:53 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:54.584569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:54.585203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:54.587839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:15:54.593793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:54.594292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:54.594746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:54.595473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:54.595944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:54.596414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:54.759138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:54.767409 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ad0bc5e3-443c-4ccd-91e0-31d05b610c80 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.186834 Aug 25 14:15:54.768028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3509/7095] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:54 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:55.788212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:55.788861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:55.796939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:55.797418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:55.797860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:55.798557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:55.799043 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:55.799468 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:55.943672 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:55.952481 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2bd305e-7849-4929-b9e7-c7f0122d8753 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.168427 Aug 25 14:15:55.953057 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3587/7096] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:55 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:56.974711 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:56.975385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:56.982513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:56.983022 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:56.983531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:56.984398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:56.984871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:56.985354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:57.143546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:57.154526 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2555be36-5cca-4328-a4a2-7784f5882cc5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.183874 Aug 25 14:15:57.155150 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3510/7097] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:56 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:58.175534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:58.176176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:58.182996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:58.183799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:58.184627 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:58.185392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:58.185795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:58.186220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:58.324807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:58.332804 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2f87f75-28b4-4464-a1e6-9fc411b1da2a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.161245 Aug 25 14:15:58.333409 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3588/7098] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:58 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:15:59.355205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:15:59.355834 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:15:59.362962 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:59.363470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:59.363930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:59.364680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:15:59.365158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:15:59.365605 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:15:59.512881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:15:59.521128 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a4313c3-ccc8-4c51-ba75-aa8c9c22bab8 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.170439 Aug 25 14:15:59.521722 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3511/7099] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:15:59 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:00.541916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:00.543207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:00.550451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:00.550943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:00.551381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:00.552095 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:00.552576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:00.553006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:00.696741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:00.705537 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f011a00-f884-43b3-8f7e-a7bcc4ad2d6e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.167588 Aug 25 14:16:00.706125 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3589/7100] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:00 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:01.727139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:01.727821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:01.735284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:01.735780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:01.736256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:01.736971 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:01.737437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:01.737877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:02.202037 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:02.210780 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8cc1c6b6-c7bb-4450-b34f-6dfc385bd98c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.487575 Aug 25 14:16:02.211384 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3512/7101] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:01 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:03.233341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:03.234303 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:03.242355 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:03.242884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:03.243313 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:03.244038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:03.244549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:03.244985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:03.388662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:03.397021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4f6f0bc8-4ffd-41d2-a9aa-cc38418ec5a3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.169167 Aug 25 14:16:03.397642 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3590/7102] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:03 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:04.423981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:04.425182 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:04.433789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:04.435289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:04.435867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:04.436921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:04.437413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:04.437866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:04.624876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:04.635265 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b99509cb-1f3b-4973-8ee5-47e86cea639f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.218289 Aug 25 14:16:04.635874 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3513/7103] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:04 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:04.704394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "name": "network-vif-plugged", "status": "completed", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:04.721952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:04.722811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:04.723593 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:04.740614 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] Creating event network-vif-plugged:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:16:04.747331 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-b39bb798-fa78-44a1-b1b6-28ec3aab8be5 req-b4ee3f80-ff8e-405f-8c34-bc83185fb0de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150191 Aug 25 14:16:04.748804 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3591/7104] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:05.669216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:05.669874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:05.677195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:05.677700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:05.678156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:05.678889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:05.679356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:05.679808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:05.822497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:05.831347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bcf8aef2-3bd0-4bde-9392-1ae40964f4a1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1357 microversion: 2.1 time: 0.166234 Aug 25 14:16:05.831941 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3514/7105] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:05 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:06.855112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:06.856270 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:06.863749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:06.864408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:06.864912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:06.865779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:06.866335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:06.866817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.074328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:07.090050 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-aed98e89-5eab-453d-93e3-78183d928596 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1547 microversion: 2.1 time: 0.239882 Aug 25 14:16:07.092514 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3592/7106] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:06 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:16:07.116462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:07.117160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:07.127889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.128778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.129573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.130756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.131499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.132341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.304065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:07.319646 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78fc8501-05fd-49d2-8695-82fa6e154014 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1547 microversion: 2.1 time: 0.208934 Aug 25 14:16:07.320581 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3515/7107] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:07 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1547 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:07.343232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:07.348490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:07.349453 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Searching by: {'deleted': False, 'project_id': 'fba039076a1f40b8b07052b97675de76'} {{(pid=122701) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 14:16:07.355783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.356345 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.357070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.358011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.358482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.358915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.394113 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.multi_cell_list [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122701) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 14:16:07.430710 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c95b59ae-860b-4375-b5d3-01b4a7aa116c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.092294 Aug 25 14:16:07.431546 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3593/7108] 10.222.0.60 () {58 vars in 1125 bytes} [Thu Aug 25 14:16:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:07.446986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:07.447679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:07.456159 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.456679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.457424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.458604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:07.459218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:07.459944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:07.616268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:07.625348 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0fb3891f-d61b-4d20-b0f0-0174c2bc2dd9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1547 microversion: 2.1 time: 0.184070 Aug 25 14:16:07.626028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3516/7109] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:07 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:09.195143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8131750-351f-4481-a78c-726e746630e1"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:09.197787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:09.206205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:09.206709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:09.207158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:09.207918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:09.208435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:09.208870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:09.524961 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-294a7313-f2ec-494e-b9d5-c32d931ce9eb tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333687 Aug 25 14:16:09.525751 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3594/7110] 10.222.0.60 () {60 vars in 1323 bytes} [Thu Aug 25 14:16:09 2022] POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:21.464911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:21.466870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:21.473844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=23 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:21.475083 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=74 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:21.484176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:21.485053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:21.485856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:21.487090 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:21.487911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:21.488741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:21.691846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:21.701718 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7604b783-8a31-4a62-9cba-bec49c7626ff tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1593 microversion: 2.1 time: 0.244146 Aug 25 14:16:21.702336 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3517/7111] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:21 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1593 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:16:23.710638 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:23.712098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:23.714232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:16:23.723419 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:23.760953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:23.761706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:23.763640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:23.784388 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] Creating event network-changed:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:16:23.794106 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-36985d60-624d-43f8-a8ba-5a1a4c17c2d6 req-0521fe86-0f68-4246-bc24-bea2333a6535 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086412 Aug 25 14:16:23.795570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3595/7112] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:16:25.219961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-228513627"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:25.221002 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:25.234921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.235835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.236713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.238074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.238963 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.239788 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.404621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Adding security group 9d3944f3-b0d4-417e-b29a-d058faba0679 to port 39172a07-52f0-4f42-ace8-15c3b336b0e7 Aug 25 14:16:25.856869 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed1a3e03-b16f-4510-888f-67edc374aa73 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action" status: 202 len: 0 microversion: 2.1 time: 0.644857 Aug 25 14:16:25.857773 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3518/7113] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:16:25 2022] POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:16:25.869596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:16:25.871018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:16:25.873103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:16:25.885357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.886376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.887173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.888451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.889537 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.890254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.897822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:16:25.899306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:16:25.900491 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:16:25.929029 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] Creating event network-changed:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:16:25.939907 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7f024dc0-ff32-426e-a49a-0b2dff164267 req-28fde040-70c3-4a7e-b036-282df6ae1534 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074470 Aug 25 14:16:25.941646 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3519/7114] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:16:26.160030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:16:26.172958 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-943db07c-f0b6-45c2-bff1-7b487b7fff6a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1758 microversion: 2.1 time: 0.309127 Aug 25 14:16:26.173828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3596/7115] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:16:25 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1758 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:23.637007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:23.637778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:23.771557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:17:23.774088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:23.780892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.781610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.782075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:23.782804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.783525 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.783865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:23.868133 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ec87b764-4902-4277-b45b-899bd08b8398 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action" status: 202 len: 0 microversion: 2.1 time: 0.232891 Aug 25 14:17:23.868836 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3520/7116] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:17:23 2022] POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:17:23.876412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:23.877834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:17:23.883772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:23.884574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:23.895802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.896354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.896968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:23.897779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:23.898233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:23.898660 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:24.108202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:24.117634 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6d91d486-acf3-486f-af28-dac34e48a1f7 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1750 microversion: 2.1 time: 0.242474 Aug 25 14:17:24.118223 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3597/7117] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:23 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:25.141424 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:25.142173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:25.148558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:25.149057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:25.149510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:25.150228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:25.150695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:25.151138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:25.361546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:25.370827 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7f0cb943-ba45-4cfc-a258-6b5bd641fe3c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.235139 Aug 25 14:17:25.371682 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3521/7118] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:25 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:26.395026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:26.395649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:26.403619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:26.405315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:26.405773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:26.406490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:26.406960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:26.407379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:26.565014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:26.573765 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a4721d5e-6fa6-44f7-b323-d8fe1f1e9e85 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.183252 Aug 25 14:17:26.574348 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3598/7119] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:26 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:27.594902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:27.595527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:27.602641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:27.603139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:27.603584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:27.604343 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:27.604811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:27.605246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:27.773301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:27.783648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-eb93c13e-f17c-4bab-ad23-2d4f1c90f7ea tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.192493 Aug 25 14:17:27.784400 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3522/7120] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:27 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:28.807170 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:28.807896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:28.815316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:28.815815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:28.816290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:28.817005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:28.817463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:28.817894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:28.979998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:28.989847 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0086ece0-5df0-413c-8f7a-45aadfa4b84c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.186995 Aug 25 14:17:28.990432 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3599/7121] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:28 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:30.010870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:30.011494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:30.018787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:30.019293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:30.019750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:30.020501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:30.020978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:30.021414 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:30.179919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:30.191029 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3442dc93-1809-414d-ab89-cd24ba1e8591 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.183997 Aug 25 14:17:30.191639 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3523/7122] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:30 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:31.213350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:31.213965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:31.222029 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:31.222516 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:31.222954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:31.223662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:31.224135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:31.224565 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:31.390966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:31.399762 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8fe6f27-eef6-4922-aa7e-fd7f1f21bdf4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.190217 Aug 25 14:17:31.400403 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3600/7123] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:31 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:32.422858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:32.423545 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:32.432017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:32.432457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:32.432912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:32.433631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:32.434102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:32.434806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:32.587242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:32.596465 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4e271ee4-20a8-4374-94ff-1eb0f5f837d5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.178200 Aug 25 14:17:32.597059 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3524/7124] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:32 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:33.618542 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:33.619180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:33.626262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:33.626749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:33.627194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:33.627896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:33.628382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:33.628808 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:33.803757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:33.813458 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9b89ad2-9795-4396-b1de-83e437b01b31 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.198699 Aug 25 14:17:33.814091 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3601/7125] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:33 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:17:34.835542 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:34.836212 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:34.844931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.845442 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.845901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:34.846644 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:34.847115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:34.847550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:35.009119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:35.018664 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4144b462-f950-4fc3-81fc-5666045eb35c tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.187007 Aug 25 14:17:35.019610 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3525/7126] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:34 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:36.042454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:36.043114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:36.051157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:36.051649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:36.052086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:36.052828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:36.053280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:36.053704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:36.230792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:36.241399 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ac19074a-bf19-4b6f-8c16-b0a813ad74c0 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.202787 Aug 25 14:17:36.242129 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3602/7127] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:36 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:37.264911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:37.265555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:37.273445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:37.274045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:37.274502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:37.275293 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:37.275806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:37.276322 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:37.441805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:37.452842 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c8dde384-2443-419f-9780-639d9c62a0aa tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.192913 Aug 25 14:17:37.453362 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3526/7128] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:37 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:38.475906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:38.476587 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:38.486263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:38.486787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:38.487394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:38.488586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:38.489063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:38.489500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:38.662597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:38.671731 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3960ca53-a986-4d27-9eeb-aaca83100cd5 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.200083 Aug 25 14:17:38.672359 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3603/7129] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:38 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:39.696919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:39.697632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:39.705410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:39.705926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:39.706465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:39.707094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:39.707568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:39.708074 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:39.879486 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:39.889536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b5917fbb-927f-4ec4-8e05-dbada7fd968f tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1755 microversion: 2.1 time: 0.195872 Aug 25 14:17:39.889823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3527/7130] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:39 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:17:40.913475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:17:40.914394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:17:40.922470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.923119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.923612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:40.924463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:17:40.924995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:17:40.925473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:17:41.125966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:17:41.135434 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-da964a55-5f3d-4f53-aaf5-8ccf1e5f1954 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1758 microversion: 2.1 time: 0.227427 Aug 25 14:17:41.136045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3604/7131] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:17:40 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:44.508048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:44.508808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:44.512845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-228513627"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:44.513399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:44.520596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:44.521099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:44.521556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:44.522284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:44.522737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:44.523180 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:44.659160 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.network.security_group_api [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Removing security group 9d3944f3-b0d4-417e-b29a-d058faba0679 from port 39172a07-52f0-4f42-ace8-15c3b336b0e7 Aug 25 14:18:45.022066 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b4af4098-a4ee-4e68-ad1d-c261bec1d0e4 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action" status: 202 len: 0 microversion: 2.1 time: 0.515965 Aug 25 14:18:45.022712 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3528/7132] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:18:44 2022] POST /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:18:45.031765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:45.032713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=48 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:18:45.040036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:45.054255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:45.054771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:45.056321 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:45.076430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] Creating event network-changed:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:18:45.081809 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] [791a5105-c4be-4e45-bbef-83a3296b04b2] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:18:46.096430 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] [791a5105-c4be-4e45-bbef-83a3296b04b2] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54360. Aug 25 14:18:46.101799 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5431b663-f8c6-4289-831b-37faf17a219a req-18dc3300-0b98-4789-8bc3-f49293309c29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.072353 Aug 25 14:18:46.102659 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3605/7133] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:46.489241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:46.490632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:46.499987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:46.500680 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:46.501324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:46.502100 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:46.503139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:46.503920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:46.505055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:46.513409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:46.514775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:46.515531 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:46.529316 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] Creating event network-changed:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:18:46.535216 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ee8cd3b6-9947-4ba8-87df-95552897a3fa req-906856a5-f3a9-4847-bb4a-2f5be194dc37 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Aug 25 14:18:46.536546 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3606/7134] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:18:46.622923 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lazy-loading 'services' on Instance uuid ce948a34-b5a5-4222-9c53-8edab18a4f30 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:18:46.705919 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b2440691-2f4e-4db1-bb41-f3ac3d4f33b2 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments/d8131750-351f-4481-a78c-726e746630e1" status: 202 len: 0 microversion: 2.1 time: 0.224424 Aug 25 14:18:46.706848 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3529/7135] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:18:46 2022] DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments/d8131750-351f-4481-a78c-726e746630e1 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:18:46.732763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:46.736483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:46.748205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:46.749696 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:46.750881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:46.751972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:46.752653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:46.753233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:46.800705 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-42d297bb-6b3b-419e-be0e-e1e648a73399 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086660 Aug 25 14:18:46.801837 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3607/7136] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:46 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:47.815527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:47.818945 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:47.828703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:47.829812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:47.830531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:47.831569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:47.832371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:47.833069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:47.868684 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3bff0bf3-408b-4cbf-a292-633b0701c401 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058682 Aug 25 14:18:47.869993 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3530/7137] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:47 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:48.882513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:48.884814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:48.892918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:48.893405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:48.893840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:48.894541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:48.894995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:48.895840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:48.930223 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5f07c61c-38ca-4a61-a804-7108a517c429 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051660 Aug 25 14:18:48.930786 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3608/7138] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:48 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:49.946185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:49.948481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:49.956219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:49.956738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:49.957202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:49.957929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:49.958404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:49.958849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:49.993282 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7ead6e10-d2f2-4021-bdf1-0dbb2b90aaa9 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054219 Aug 25 14:18:49.993893 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3531/7139] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:49 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:51.006817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:51.009188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:51.017076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:51.017579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:51.018031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:51.018750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:51.019216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:51.019653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:51.051872 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bfb84a40-f15f-4198-9449-0d1964daf084 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049023 Aug 25 14:18:51.052568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3609/7140] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:51 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:52.065629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:52.068456 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:52.077124 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:52.077557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:52.078016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:52.078866 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:52.079213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:52.079688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:52.114538 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-560bd35c-4605-42c9-b5e1-6703dcef44ae tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053847 Aug 25 14:18:52.115139 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3532/7141] 10.222.0.60 () {58 vars in 1302 bytes} [Thu Aug 25 14:18:52 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 14:18:52.126491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:52.127129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:52.134457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:52.135087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:52.135451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:52.136185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:52.136655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:52.137087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:52.223874 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] HTTP exception thrown: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 is not attached to volume d8131750-351f-4481-a78c-726e746630e1 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Request method failure captured: Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: request: DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments/d8131750-351f-4481-a78c-726e746630e1 HTTP/1.1 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4MTdMh6TUQr2Xxm2F0c5ykfMVDp-TgYz9PU9QvIpXh_2qK2-U-xvCPB8tCdX85YzdsqMBEp0GrOAFwqBvzT9aMb-S_URD8x1s4-nSKTlmpDg6GGQaGXSmVp1v2sHGKnSUHYpn4tepqG4xoMxcJZOSH3JuVm7SASkRHTDuE6-4MH6OU Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fba039076a1f40b8b07052b97675de76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fba039076a1f40b8b07052b97675de76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9437f7eb2e8a42819c3eef13131cc3f2 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 is not attached to volume d8131750-351f-4481-a78c-726e746630e1 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'server_id': 'ce948a34-b5a5-4222-9c53-8edab18a4f30', 'id': 'd8131750-351f-4481-a78c-726e746630e1'} Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d8131750-351f-4481-a78c-726e746630e1. Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 is not attached to volume d8131750-351f-4481-a78c-726e746630e1 Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:18:52.225533 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 is not attached to volume d8131750-351f-4481-a78c-726e746630e1 Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Returning 404 to user: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 is not attached to volume d8131750-351f-4481-a78c-726e746630e1 {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-db36c4fc-e54e-4c12-9068-8454fa53019a tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments/d8131750-351f-4481-a78c-726e746630e1" status: 404 len: 154 microversion: 2.1 time: 0.105472 Aug 25 14:18:52.233241 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3610/7142] 10.222.0.60 () {58 vars in 1416 bytes} [Thu Aug 25 14:18:52 2022] DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30/os-volume_attachments/d8131750-351f-4481-a78c-726e746630e1 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:18:55.522242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:55.522937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:55.531331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:55.531850 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:55.532503 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:55.533097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:55.533566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:55.534016 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:55.565021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:18:55.687703 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d16944bc-34a1-4d81-a5f9-1accff573ed3 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 204 len: 0 microversion: 2.1 time: 0.168870 Aug 25 14:18:55.693582 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3533/7143] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:18:55 2022] DELETE /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:18:55.699544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:55.701136 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:55.710544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:55.711073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:55.711514 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:55.712278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:55.712735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:55.713186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:55.877427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:55.887351 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9d24c5b8-9b69-4ece-a142-05753e88e6b1 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1553 microversion: 2.1 time: 0.191735 Aug 25 14:18:55.888197 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3611/7144] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:55 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:18:56.911395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:56.912229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:56.922075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:56.922540 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:56.923008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:56.923804 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:56.924544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:56.925081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:57.096974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:57.109585 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7cc0a0d6-ab9d-46b0-ba4a-a1c31ce1b580 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1553 microversion: 2.1 time: 0.201327 Aug 25 14:18:57.113127 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3534/7145] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:56 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:58.143960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:58.144994 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:58.157894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.158665 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.159378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.160625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.161290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.161900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.247717 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9437f7eb2e8a42819c3eef13131cc3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba039076a1f40b8b07052b97675de76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:18:58.258087 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e00ec302-4b79-48c6-b2c5-f7915d47a270 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 200 len: 1511 microversion: 2.1 time: 0.122302 Aug 25 14:18:58.258925 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3612/7146] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:58 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 1511 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:18:58.285980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce948a34-b5a5-4222-9c53-8edab18a4f30", "name": "network-vif-deleted", "tag": "39172a07-52f0-4f42-ace8-15c3b336b0e7"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:18:58.306426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:58.307752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:58.308263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:58.336046 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] Creating event network-vif-deleted:39172a07-52f0-4f42-ace8-15c3b336b0e7 for instance ce948a34-b5a5-4222-9c53-8edab18a4f30 on n-h1-850468-18 Aug 25 14:18:58.343076 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-590153a6-d117-4eac-b8ea-5a99e411d343 req-3181e468-7f7b-4f12-9fcd-2ee5d3fc808a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061627 Aug 25 14:18:58.344098 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3535/7147] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:18:59.282685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:59.283403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] [instance: ce948a34-b5a5-4222-9c53-8edab18a4f30] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:18:59.290793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:59.291286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:59.291722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:59.292446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:18:59.292985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:18:59.293462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:18:59.309581 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] HTTP exception thrown: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Request method failure captured: Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 HTTP/1.1 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4MTdMh6TUQr2Xxm2F0c5ykfMVDp-TgYz9PU9QvIpXh_2qK2-U-xvCPB8tCdX85YzdsqMBEp0GrOAFwqBvzT9aMb-S_URD8x1s4-nSKTlmpDg6GGQaGXSmVp1v2sHGKnSUHYpn4tepqG4xoMxcJZOSH3JuVm7SASkRHTDuE6-4MH6OU Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fba039076a1f40b8b07052b97675de76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fba039076a1f40b8b07052b97675de76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fba039076a1f40b8b07052b97675de76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: fba039076a1f40b8b07052b97675de76 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1125973646 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 9437f7eb2e8a42819c3eef13131cc3f2 Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestMinimumBasicScenario-1125973646-project Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'ce948a34-b5a5-4222-9c53-8edab18a4f30'} Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:18:59.311734 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Returning 404 to user: Instance ce948a34-b5a5-4222-9c53-8edab18a4f30 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f086d4c2-c515-4c0a-81c1-adf0bb6c826e tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30" status: 404 len: 111 microversion: 2.1 time: 0.035376 Aug 25 14:18:59.317970 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3613/7148] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:18:59 2022] GET /compute/v2.1/servers/ce948a34-b5a5-4222-9c53-8edab18a4f30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:18:59.326948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0d66903d-0c21-4398-a7c0-4b05d16be164 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] Calling method '.version_select at 0x7fc6c10a9af0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:18:59.354124 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0d66903d-0c21-4398-a7c0-4b05d16be164 tempest-TestMinimumBasicScenario-1125973646 tempest-TestMinimumBasicScenario-1125973646-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-631752522" status: 202 len: 0 microversion: 2.1 time: 0.032887 Aug 25 14:18:59.354871 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3536/7149] 10.222.0.60 () {58 vars in 1269 bytes} [Thu Aug 25 14:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-631752522 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:19:09.216657 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:19:09.217767 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Aug 25 14:19:09.218733 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:19:09.218852 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.60) !!! Aug 25 14:19:09.288482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=18 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:09.299204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=42 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:09.397076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-982c2b74-3d09-49cf-a271-f2994cc1d727 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: .version_select at 0x7fc6c1823a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-595554642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzNiWYk2TiTIuIUCQWDQuUeC5c07UXzg5DvVs79Nf3qTYB8zYzzTWHBfBBe7THqVm+wX3Aibalissl/39UZcATw7sg9uDMyT8VeSJV/uS7BY0m68UQLFVFgoHgV6ggW9w=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:09.414940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-982c2b74-3d09-49cf-a271-f2994cc1d727 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:19:09.421120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-982c2b74-3d09-49cf-a271-f2994cc1d727 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:19:09.451122 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-982c2b74-3d09-49cf-a271-f2994cc1d727 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.239992 Aug 25 14:19:09.452468 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3614/7150] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:19:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:19:15.836683 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:19:15.837165 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:19:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 25 14:19:15.838386 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:15.839261 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:15.846360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1902017966", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "2cf975fa-75ca-470a-ba17-605e4d24cfa1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-595554642", "security_groups": [{"name": "tempest-secgroup-smoke-1397092319"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:16.002300 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] validate_networks() for [('2cf975fa-75ca-470a-ba17-605e4d24cfa1', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:19:16.504926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:19:16.505974 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:19:16.507753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:19:16.509070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:19:16.509535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:19:16.521952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:16.522457 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:16.522908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:16.523693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:16.524187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:16.524643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:16.544463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:19:16.550975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:19:16.566518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:19:16.571073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:19:16.622600 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2309d6d8-f464-4478-a12c-e41bf04c562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787488 Aug 25 14:19:16.623257 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3537/7151] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:19:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:19:16.652004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a24c3676-c898-452f-a21b-3252ee85677d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:16.657003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a24c3676-c898-452f-a21b-3252ee85677d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:16.731979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a24c3676-c898-452f-a21b-3252ee85677d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:16.740053 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a24c3676-c898-452f-a21b-3252ee85677d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1266 microversion: 2.1 time: 0.106338 Aug 25 14:19:16.740707 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3615/7152] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:16 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:17.766371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:17.768700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:17.779833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:17.780468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:17.781227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:17.781679 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:17.782155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:17.782600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:17.861823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:17.870799 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8bea9df-2ce9-4690-82a4-245da4bab8ca tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1318 microversion: 2.1 time: 0.110911 Aug 25 14:19:17.873489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3538/7153] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:17 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:19:18.900759 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:18.901525 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:18.911327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:18.911870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:18.912589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:18.913398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:18.913993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:18.914492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:19.088884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:19.098291 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-007400aa-c51d-4484-a3dd-cb5c98b26be7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.201705 Aug 25 14:19:19.112812 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3616/7154] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:18 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:19.855561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b87353e-13cc-4cdf-ab7d-9c079393ee0e", "tag": "428793f1-72fe-46a0-bc04-b26b02e6f83d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:19.870899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:19.871587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:19.872312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:19.889305 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] Creating event network-changed:428793f1-72fe-46a0-bc04-b26b02e6f83d for instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e on n-h2-850468-18 Aug 25 14:19:19.895547 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-230717fe-fe35-4c30-a84e-e8cb8241e8d7 req-125d22e0-3117-4f26-acc4-95d8e42b5403 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046458 Aug 25 14:19:19.896820 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3539/7155] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:19:20.121815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:20.122541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:20.130188 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:20.131402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:20.131402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:20.132061 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:20.132558 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:20.133004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:20.288953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:20.298127 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-756ddcae-b036-4b4e-9d8e-0cb298552350 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.180212 Aug 25 14:19:20.298738 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3617/7156] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:20 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:21.330502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:21.331223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:21.338130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:21.338632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:21.339087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:21.339813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:21.340315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:21.340758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:21.499833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:21.508182 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf8694e8-1e6e-4f71-ace2-2ad92535fa8a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.182871 Aug 25 14:19:21.510678 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3540/7157] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:21 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:22.531288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:22.531866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:22.539491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:22.540363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:22.540497 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:22.541211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:22.541674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:22.542107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:22.735103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:22.744052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8231b08a-36ff-4bc7-a79f-5dfe016e1b90 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.217460 Aug 25 14:19:22.744782 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3618/7158] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:22 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:23.768059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:23.768980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:23.776629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:23.777139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:23.777595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:23.778330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:23.778797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:23.780351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:23.958076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:23.969470 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b9eddb95-6439-435d-8483-d5ccdd5421b7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.204947 Aug 25 14:19:23.972206 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3541/7159] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:23 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:19:24.995644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:24.996314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:25.003908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:25.004444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:25.004879 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:25.005588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:25.006041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:25.006469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:25.153920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:25.164165 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f6057421-8c25-498f-8c7f-5cdd6f46586f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.172319 Aug 25 14:19:25.164775 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3619/7160] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:24 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:25.796678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b87353e-13cc-4cdf-ab7d-9c079393ee0e", "name": "network-vif-plugged", "status": "completed", "tag": "428793f1-72fe-46a0-bc04-b26b02e6f83d"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:25.807668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:25.808210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:25.808668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:25.824710 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] Creating event network-vif-plugged:428793f1-72fe-46a0-bc04-b26b02e6f83d for instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e on n-h2-850468-18 Aug 25 14:19:25.832668 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-008daed7-e11c-49ce-9840-0df1231a4ba2 req-a5dd1ca6-f873-4906-af02-341079327184 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039744 Aug 25 14:19:25.833306 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3542/7161] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:19:26.186629 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:26.187523 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:26.195055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:26.195500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:26.195781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:26.196583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:26.196985 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:26.197412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:26.335897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:26.344952 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6a1c34a9-c332-4ab1-bfba-0192033c0dcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1392 microversion: 2.1 time: 0.162334 Aug 25 14:19:26.345547 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3620/7162] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:26 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:27.371862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:27.375129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:27.378634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:27.379903 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:27.394931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:27.395813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:27.396639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:27.397935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:27.398765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:27.399544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:27.557582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:27.566395 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cb7606b3-db8b-478d-b2e3-ab02f84f6bb5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1563 microversion: 2.1 time: 0.202812 Aug 25 14:19:27.567018 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3543/7163] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:27 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:27.587663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:27.588325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:27.590264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:27.597134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:27.597635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:27.598079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:27.598803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:27.599260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:27.599693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:27.753336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:27.762039 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5871832b-7c8b-4743-b17a-94acd6e087db tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1563 microversion: 2.1 time: 0.178152 Aug 25 14:19:27.762651 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3621/7164] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:27 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:29.677296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b87353e-13cc-4cdf-ab7d-9c079393ee0e", "tag": "428793f1-72fe-46a0-bc04-b26b02e6f83d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:29.683978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:19:29.684902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:29.696682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:29.699169 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:29.699811 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:29.703187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:29.703860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:29.704568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:29.709331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:29.710032 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:29.710639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:29.729967 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] Creating event network-changed:428793f1-72fe-46a0-bc04-b26b02e6f83d for instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e on n-h2-850468-18 Aug 25 14:19:29.739370 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-45aeda0f-a7bd-4576-8348-5451bdae207e req-8110dc5e-da43-4d4b-9c9b-31f5f47b01e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065285 Aug 25 14:19:29.740886 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3622/7165] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:19:29.923062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:19:29.939365 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-340fecef-719e-44cb-9e9e-d0c8df85ba0c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1563 microversion: 2.1 time: 0.271094 Aug 25 14:19:29.940847 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3544/7166] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:19:29 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:19:51.293538 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:51.294286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=38 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:19:51.298478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:19:51.300787 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:19:51.308086 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:51.308608 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:51.309062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:51.309794 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:19:51.310254 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:19:51.310682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:19:51.368272 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-adc6ade2-a084-489d-bf3e-3ccd2e6345a0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action" status: 200 len: 24561 microversion: 2.1 time: 0.076490 Aug 25 14:19:51.368850 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3623/7167] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:19:51 2022] POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action => generated 24561 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:20:02.071865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:02.072665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:02.074599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:02.075274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:02.083253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:02.083765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:02.084253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:02.084967 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:02.085481 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:02.085937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:02.155342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7b5600d-91e9-4ef6-bc5b-6f1c54af15f9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action" status: 202 len: 0 microversion: 2.1 time: 0.087363 Aug 25 14:20:02.156155 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3545/7168] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:20:02 2022] POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:20:02.166107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:02.166816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:02.169354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:02.170058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:02.177045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:02.177634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:02.178076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:02.178792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:02.179244 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:02.179671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:02.324579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:02.333298 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f061cf5a-1116-4ad7-af6c-741086bb2980 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1687 microversion: 2.1 time: 0.171485 Aug 25 14:20:02.333880 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3624/7169] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:02 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:03.355590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:03.356263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:03.364078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:03.364606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:03.365067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:03.365780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:03.366252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:03.366696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:03.512707 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:03.520711 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e32fcd2f-a8cc-401b-afb3-51266cab97bb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1667 microversion: 2.1 time: 0.169477 Aug 25 14:20:03.521367 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3546/7170] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:03 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:04.619064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:04.621311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:04.630392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.630942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.631666 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.632749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.633146 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.633804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.686844 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6f0c700d-61c0-46f3-bfff-6cfe98649a23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action" status: 200 len: 32636 microversion: 2.1 time: 0.071464 Aug 25 14:20:04.687489 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3625/7171] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:20:04 2022] POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action => generated 32636 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:20:04.700298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:04.700870 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:04.708439 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.708977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.709434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.710147 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.710620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.711068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.780533 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7e4ad54d-6b33-4948-9981-84bf8811a185 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action" status: 202 len: 0 microversion: 2.1 time: 0.084301 Aug 25 14:20:04.781384 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3547/7172] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:20:04 2022] POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:20:04.791290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:04.791999 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:04.799856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.800676 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.801216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.801972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:04.802552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:04.802982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:04.944656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:04.952743 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2416c976-114d-4775-a7b9-8c60f9b8f8c6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1674 microversion: 2.1 time: 0.165671 Aug 25 14:20:04.953433 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3626/7173] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:04 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:20:05.976887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:05.977640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:05.984013 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:05.984536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:05.984997 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:05.985710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:05.986188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:05.986635 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:06.129877 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:06.137912 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b7554fa4-cb22-44ad-bddb-b5d2a9ffaa57 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1682 microversion: 2.1 time: 0.166110 Aug 25 14:20:06.138493 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3548/7174] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:05 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:06.236595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:06.238841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:06.246572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:06.247058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:06.247501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:06.248226 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:06.248686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:06.249115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:06.300732 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-955b14ef-9d45-4d15-b83d-086630307fd6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action" status: 200 len: 38394 microversion: 2.1 time: 0.067868 Aug 25 14:20:06.301409 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3627/7175] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:20:06 2022] POST /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e/action => generated 38394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:20:07.353905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:07.354446 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:07.356892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b87353e-13cc-4cdf-ab7d-9c079393ee0e", "tag": "428793f1-72fe-46a0-bc04-b26b02e6f83d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:07.362316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:07.363794 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:07.364280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:07.365021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:07.365730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:07.366380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:07.370196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:07.370777 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:07.371474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:07.384749 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] Creating event network-changed:428793f1-72fe-46a0-bc04-b26b02e6f83d for instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e on n-h2-850468-18 Aug 25 14:20:07.390077 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-4a362fcf-0543-4d49-a371-013a389f98f4 req-f554e10b-6248-4bdf-93a2-2cd652417ac9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037521 Aug 25 14:20:07.390685 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3628/7176] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:20:07.395184 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:20:07.495371 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-28f043e4-ec8e-40d0-bc3d-783fffb0b9c0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 204 len: 0 microversion: 2.1 time: 0.145223 Aug 25 14:20:07.495985 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3549/7177] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:20:07 2022] DELETE /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:20:07.505971 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:07.506996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:07.514570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:07.515274 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:07.515820 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:07.516673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:07.517200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:07.518162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:07.715393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:07.728801 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-430e0c02-c8b0-4ba1-9d88-9fcf80fab492 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1688 microversion: 2.1 time: 0.227130 Aug 25 14:20:07.730431 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3629/7178] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:07 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:08.755006 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:08.755637 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:08.762478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:08.762981 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:08.763435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:08.764163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:08.764638 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:08.765078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:08.911725 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:08.919614 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d10aed8d-d3f8-489e-b196-ca9cedd8bf23 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1688 microversion: 2.1 time: 0.169001 Aug 25 14:20:08.920455 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3550/7179] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:08 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:09.565677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b87353e-13cc-4cdf-ab7d-9c079393ee0e", "name": "network-vif-deleted", "tag": "428793f1-72fe-46a0-bc04-b26b02e6f83d"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:09.583369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:09.583866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:09.584339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:09.597585 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] Creating event network-vif-deleted:428793f1-72fe-46a0-bc04-b26b02e6f83d for instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e on n-h2-850468-18 Aug 25 14:20:09.602707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9c03a3f5-f354-4e4c-9e1c-3d26505cfe13 req-b1f636dd-ef0a-4a5d-8c67-0c6ff14bfd03 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041156 Aug 25 14:20:09.603657 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3630/7180] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:20:09.945323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:09.946104 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:09.956762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:09.957315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:09.957897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:09.958629 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:09.959101 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:09.959538 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:09.996604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:09.997218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:09.997914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:09.998460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'fault' on Instance uuid 0b87353e-13cc-4cdf-ab7d-9c079393ee0e {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:20:10.045390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:10.053178 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-22480de6-e768-45a3-bd8f-c6d82a67011d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 200 len: 1356 microversion: 2.1 time: 0.113898 Aug 25 14:20:10.053771 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3551/7181] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:09 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:11.077490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:11.078187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0b87353e-13cc-4cdf-ab7d-9c079393ee0e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:11.085406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:11.085889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:11.086330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:11.087024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:11.087479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:11.087904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:11.102275 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] HTTP exception thrown: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Request method failure captured: Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e HTTP/1.1 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4TcWF9hwc8jIfxzJdGYoI88N--vApysXqkPPUGzHK1kXOP-YEgmv3MfV1h_WDONKzgUx8iFXg0D--gs1yMiUSapL_qaVlli1iqo8DXUFYqLisI2ZKXoslhdGPoVWCXmyrHw1Z0FOyKvZGIP5SKrtU807BLqBY0xhSZkV5aIOXw4tvM Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d0da6af7ac444c00855eee2e3eaa1681 Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '0b87353e-13cc-4cdf-ab7d-9c079393ee0e'} Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:20:11.103853 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Returning 404 to user: Instance 0b87353e-13cc-4cdf-ab7d-9c079393ee0e could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-56e7c3f5-4c22-44b9-a329-d362dded22d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e" status: 404 len: 111 microversion: 2.1 time: 0.032850 Aug 25 14:20:11.108725 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3631/7182] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:11 2022] GET /compute/v2.1/servers/0b87353e-13cc-4cdf-ab7d-9c079393ee0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:20:14.573769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bab5da13-9f22-44b3-8acd-f123e8e62ee9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '.version_select at 0x7fc6c0fe3700>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:14.596710 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bab5da13-9f22-44b3-8acd-f123e8e62ee9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-595554642" status: 202 len: 0 microversion: 2.1 time: 0.031088 Aug 25 14:20:14.602073 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3552/7183] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 14:20:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-595554642 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:20:14.624689 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d8901eef-a54f-4c73-9045-e45afbe0f87b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: .version_select at 0x7fc6c6caa9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1675104600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOairBVqrOv8HigOwP3tZVjaIdblO71A4CzpRUVGWjESMNYAUmgrCOzZnp6XBiZwsAHhHboMLkwp97xeavMh12vjkCeFoF2yJcDasp/O2z79XCEpQEz0S+ndFYswE79KDg=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:14.642338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d8901eef-a54f-4c73-9045-e45afbe0f87b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:20:14.649426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-d8901eef-a54f-4c73-9045-e45afbe0f87b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:20:14.676134 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d8901eef-a54f-4c73-9045-e45afbe0f87b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054736 Aug 25 14:20:14.676873 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3632/7184] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:20:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:20:21.067509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:21.073726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-787145811", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "6c4a68f6-66cc-4a13-b6b3-ba7e6f194ec4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1675104600", "security_groups": [{"name": "tempest-secgroup-smoke-1809488057"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:21.218498 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] validate_networks() for [('6c4a68f6-66cc-4a13-b6b3-ba7e6f194ec4', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:20:21.624313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:20:21.624798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:20:21.625754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:20:21.626620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:20:21.627068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:20:21.639380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:21.639975 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:21.640509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:21.641274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:21.641797 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:21.642276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:21.661186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:20:21.667245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:20:21.682799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:20:21.685298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:20:21.733728 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-53be21a7-4cd4-49d8-873f-01d9a2f3405e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668742 Aug 25 14:20:21.734828 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3553/7185] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:20:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:20:21.746739 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b2b4cc8e-98c9-4cc6-9e93-b6743cad6f75 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:21.747437 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b2b4cc8e-98c9-4cc6-9e93-b6743cad6f75 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:21.750332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:21.812713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b2b4cc8e-98c9-4cc6-9e93-b6743cad6f75 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:21.821487 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b2b4cc8e-98c9-4cc6-9e93-b6743cad6f75 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1266 microversion: 2.1 time: 0.078472 Aug 25 14:20:21.827876 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3633/7186] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:21 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:22.843909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f5dc67f-9fe1-4b89-8337-19cc60044f68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:22.844569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f5dc67f-9fe1-4b89-8337-19cc60044f68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:22.909258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0f5dc67f-9fe1-4b89-8337-19cc60044f68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:22.917745 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f5dc67f-9fe1-4b89-8337-19cc60044f68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1266 microversion: 2.1 time: 0.078540 Aug 25 14:20:22.918350 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3554/7187] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:22 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:23.941089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:23.942166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:23.950088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:23.950568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:23.951005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:23.951727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:23.952210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:23.952635 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:24.017185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:24.027744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-983a32b6-9599-4895-ba21-184cf1ffa78b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1270 microversion: 2.1 time: 0.091712 Aug 25 14:20:24.028367 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3634/7188] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:23 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:25.048683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:25.049391 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:25.057045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:25.057556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:25.058015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:25.058739 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:25.059214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:25.059867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:25.167517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:25.176931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1e9c78bf-5c86-4cb0-8adb-6fe49402a0de tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1324 microversion: 2.1 time: 0.131719 Aug 25 14:20:25.177524 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3555/7189] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:25 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1324 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:26.198859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:26.199494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:26.212060 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:26.212606 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:26.213054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:26.213773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:26.214237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:26.214671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:26.415402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:26.423453 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36ad5768-e673-4a0a-85fb-f052de4aea35 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.228513 Aug 25 14:20:26.424063 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3635/7190] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:26 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:26.530268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16612b3-17ba-4a55-8edb-bc26d193d546", "tag": "42ccfd33-f05e-41bf-af16-c44656149e4b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:26.542388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:26.542874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:26.543341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:26.555564 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] Creating event network-changed:42ccfd33-f05e-41bf-af16-c44656149e4b for instance e16612b3-17ba-4a55-8edb-bc26d193d546 on n-h2-850468-18 Aug 25 14:20:26.560715 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-0664e494-9364-49de-ab10-3b8f4e772cb2 req-02f8f16a-2a0d-411f-8d16-7b5d6d9c0e98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120080 Aug 25 14:20:26.561679 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3556/7191] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:20:27.446193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:27.446972 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:27.453574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:27.454065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:27.454505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:27.455202 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:27.455663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:27.456088 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:27.595489 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:27.603523 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ddb724e-28d6-4343-8405-a040e033ce7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.161941 Aug 25 14:20:27.604140 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3636/7192] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:27 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:28.625965 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:28.626680 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:28.636041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:28.636041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:28.636041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:28.636588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:28.636802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:28.637214 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:28.782954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:28.797166 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9616d8d-0cc8-4798-a9bb-20d5fd658ff1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.176453 Aug 25 14:20:28.798067 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3557/7193] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:28 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:29.819381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:29.820011 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:29.826550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:29.827030 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:29.827462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:29.828181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:29.828636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:29.829065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:29.979297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:29.987186 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3147ba17-4703-4625-b3b0-63c9da7cb61c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.171820 Aug 25 14:20:29.987791 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3637/7194] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:29 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:31.008295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:31.008921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:31.015905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:31.016427 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:31.016878 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:31.017582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:31.018048 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:31.018484 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:31.156095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:31.164475 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-becd9696-caa8-4285-a3bc-4d985ee0e562 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.161306 Aug 25 14:20:31.165056 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3558/7195] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:31 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:32.046858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16612b3-17ba-4a55-8edb-bc26d193d546", "name": "network-vif-plugged", "status": "completed", "tag": "42ccfd33-f05e-41bf-af16-c44656149e4b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:32.054699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:32.059035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:32.059569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:32.060012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:32.072231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] Creating event network-vif-plugged:42ccfd33-f05e-41bf-af16-c44656149e4b for instance e16612b3-17ba-4a55-8edb-bc26d193d546 on n-h2-850468-18 Aug 25 14:20:32.077189 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6bb3a9ae-0cfa-45c4-b251-3fa2b07c6983 req-3aa826e3-c781-41ed-b669-c66d6ed8b04b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033995 Aug 25 14:20:32.078550 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3638/7196] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:20:32.185893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:32.186528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:32.189000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:32.190968 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:32.198747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:32.199305 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:32.199756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:32.200499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:32.200966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:32.201402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:32.339744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:32.348148 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-79eb282b-2633-4c26-af5a-72b7c31bf86f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1392 microversion: 2.1 time: 0.165700 Aug 25 14:20:32.348738 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3559/7197] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:32 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:33.369348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:33.370134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:33.372158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:33.378210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:33.379250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:33.379740 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:33.380479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:33.380944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:33.381373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:33.526650 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:33.534817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6914974b-893c-4e39-8952-e92d17f0e24f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1564 microversion: 2.1 time: 0.170674 Aug 25 14:20:33.535915 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3639/7198] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:33 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:33.556260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:33.556924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:33.559213 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:33.565887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:33.566530 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:33.567105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:33.567659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:33.568146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:33.568589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:33.719268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:33.728328 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-49c0ff2c-1f4c-4ae7-9622-e7a80fc7bdde tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1564 microversion: 2.1 time: 0.175923 Aug 25 14:20:33.728934 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3560/7199] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:33 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:35.423694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:20:35.424405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:35.431408 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:35.432206 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:35.432658 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:35.433376 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:35.435865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:35.435865 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:35.509541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16612b3-17ba-4a55-8edb-bc26d193d546", "tag": "42ccfd33-f05e-41bf-af16-c44656149e4b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:35.520441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:35.521316 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:35.522010 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:35.534976 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] Creating event network-changed:42ccfd33-f05e-41bf-af16-c44656149e4b for instance e16612b3-17ba-4a55-8edb-bc26d193d546 on n-h2-850468-18 Aug 25 14:20:35.541568 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5517eba8-3b90-4593-8ea8-f96b3ccd6262 req-9cfc8594-c7d7-4530-a503-b5812f0453a8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120401 Aug 25 14:20:35.543189 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3561/7200] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:20:35.629379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:20:35.639623 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b41f04a4-5685-49d4-b75f-ca6fda5a063c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1564 microversion: 2.1 time: 0.220716 Aug 25 14:20:35.640758 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3640/7201] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:20:35 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1564 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:20:58.904592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:20:58.906955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:20:58.909536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=5 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:58.910205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:20:58.916885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:58.917393 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:58.917858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:58.918572 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:20:58.919047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:20:58.919488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:20:58.978944 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5f879fb8-1a08-4be0-ac05-0f68aea8d8fb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action" status: 200 len: 24579 microversion: 2.1 time: 0.078539 Aug 25 14:20:58.979625 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3562/7202] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:20:58 2022] POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action => generated 24579 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:21:09.988228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:21:09.990532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:09.992783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:09.993592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=38 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.000264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.000754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.001203 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.001911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.002373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.002802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.078401 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c377176-cf37-45b7-906b-3e3c278a79e0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action" status: 202 len: 0 microversion: 2.1 time: 0.094079 Aug 25 14:21:10.079043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3641/7203] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:21:09 2022] POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:21:10.090167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:10.090976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:10.094417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.095165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:10.103517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.104087 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.104533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.105240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:10.105703 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:10.106142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:10.333244 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:10.343845 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9d3e42ee-c272-43c4-835f-30d78e836891 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1675 microversion: 2.1 time: 0.257735 Aug 25 14:21:10.344498 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3563/7204] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:10 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:11.380870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:11.381625 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:11.388149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:11.388668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:11.389107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:11.389816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:11.390300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:11.390697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:11.534677 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:11.543672 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-463bfce2-b96f-4bf6-b70d-114d49533008 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.168145 Aug 25 14:21:11.544310 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3642/7205] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:11 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:12.570173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:12.570743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:12.578956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:12.579466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:12.579944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:12.580721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:12.581197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:12.581641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:12.749114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:12.758810 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-48a02d3a-2259-401b-a77e-6f42cd79695a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.195305 Aug 25 14:21:12.759407 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3564/7206] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:12 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:13.780463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:13.781082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:13.789306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:13.789834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:13.790283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:13.791013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:13.791467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:13.792207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:13.936745 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:13.945389 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7faaafbe-1db6-4922-95c4-a03227fd98f6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.168821 Aug 25 14:21:13.946059 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3643/7207] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:13 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:14.973302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:14.973938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:14.981743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:14.982243 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:14.982696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:14.983423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:14.983898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:14.984395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:15.127576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:15.136045 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e05f5285-d730-4a1c-9b98-7462e1bb9c3c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.171463 Aug 25 14:21:15.136670 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3565/7208] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:14 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:21:16.157336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:16.157953 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:16.166219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:16.166714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:16.167227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:16.167856 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:16.168365 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:16.168773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:16.318077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:16.326894 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-33f262e0-97ea-4f3a-b70c-7210c40b1d67 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.173399 Aug 25 14:21:16.327501 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3644/7209] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:16 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:17.352798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:17.353512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:17.360652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:17.361157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:17.361613 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:17.362341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:17.362846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:17.363241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:17.518602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:17.527306 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cab623b0-60fb-4e80-88ac-587a2769ee54 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.181388 Aug 25 14:21:17.527919 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3566/7210] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:17 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:21:18.549980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:18.550748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:18.559161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:18.559730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:18.560256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:18.561130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:18.561734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:18.562212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:18.747983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:18.758908 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c6812e4a-7f57-4183-b698-71a844d1383b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.213161 Aug 25 14:21:18.759518 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3645/7211] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:18 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:19.781271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:19.781882 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:19.789856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:19.790164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:19.790592 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:19.791310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:19.791780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:19.792263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:19.941112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:19.951474 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1cf2d50f-680f-4733-a92d-fcaa0dda9a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.174323 Aug 25 14:21:19.952102 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3567/7212] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:19 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:20.974420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:20.975089 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:20.982360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:20.982851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:20.983299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:20.984004 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:20.984493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:20.984930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:21.136775 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:21.145186 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8409f35f-e94f-4acf-9b7c-d0ed4507990a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.174712 Aug 25 14:21:21.145789 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3646/7213] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:20 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:22.166853 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:22.167443 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:22.174779 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:22.175288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:22.175746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:22.176527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:22.177017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:22.177463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:22.331766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:22.342772 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd11deb7-cd7a-4946-b3f6-3d48a0fa7123 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.180538 Aug 25 14:21:22.343369 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3568/7214] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:22 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:23.369534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:23.370581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:23.383920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:23.384889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:23.385727 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:23.387104 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:23.387970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:23.388812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:23.549698 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:23.558430 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b15398de-8df8-4e78-bcb1-e07ec794baae tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.193577 Aug 25 14:21:23.559035 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3647/7215] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:23 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:24.581186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:24.581750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:24.590662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:24.591573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:24.592039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:24.592798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:24.593268 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:24.593702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:24.746783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:24.755248 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78553508-cfac-481a-bab9-eb86b7f69132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.178091 Aug 25 14:21:24.755851 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3569/7216] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:24 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:25.777855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:25.778483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:25.786054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:25.786540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:25.786984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:25.787684 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:25.788157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:25.788586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:25.937591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:25.946765 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f780a5a4-0bbe-48e8-9fe9-17c815bac630 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1680 microversion: 2.1 time: 0.173268 Aug 25 14:21:25.947361 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3648/7217] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:25 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:26.967927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:26.968584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:26.976034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:26.976717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:26.977170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:26.977885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:26.978348 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:26.978783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:27.141288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:27.156176 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-663ec48b-b844-4f35-ae7c-72eb61cb9aa0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1683 microversion: 2.1 time: 0.191659 Aug 25 14:21:27.157223 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3570/7218] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:26 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:21:51.374991 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:21:51.377221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:51.379420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:51.380073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:51.386520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:51.387007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:51.387477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:51.388230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:51.388709 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:51.389110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:51.446758 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6620569-9c05-4014-bdba-cabbb81e55b9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action" status: 200 len: 68883 microversion: 2.1 time: 0.075726 Aug 25 14:21:51.447948 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3649/7219] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:21:51 2022] POST /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546/action => generated 68883 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:21:59.114209 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:59.114857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:59.116091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16612b3-17ba-4a55-8edb-bc26d193d546", "tag": "42ccfd33-f05e-41bf-af16-c44656149e4b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:21:59.117533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:59.118526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=48 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:21:59.125071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:59.125721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:59.126269 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:59.127270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:59.127952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:59.128142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:59.128412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:59.129082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:59.129699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:59.142356 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] Creating event network-changed:42ccfd33-f05e-41bf-af16-c44656149e4b for instance e16612b3-17ba-4a55-8edb-bc26d193d546 on n-h2-850468-18 Aug 25 14:21:59.147960 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-6ac0db3b-a667-49ee-aab2-120ed8e44eac req-2670d665-a141-4af1-8230-faee9d9b1aaa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036132 Aug 25 14:21:59.149526 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3650/7220] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:21:59.158246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:21:59.255188 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-852e61f5-56d4-4d81-9076-b3b053d7bce7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 204 len: 0 microversion: 2.1 time: 0.144979 Aug 25 14:21:59.259463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3571/7221] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:21:59 2022] DELETE /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:21:59.270294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:21:59.272929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:21:59.280950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:59.281554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:59.282071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:59.282861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:21:59.283402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:21:59.283956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:21:59.455704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:21:59.464737 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63e21ed8-3739-48df-935b-98230151c6f1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1689 microversion: 2.1 time: 0.203100 Aug 25 14:21:59.465316 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3651/7222] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:21:59 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:00.486734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:00.487450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:00.495207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:00.495708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:00.496225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:00.496939 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:00.497470 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:00.497871 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:00.717905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:00.730199 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-99e7d9ad-0113-49ee-bfcd-e566f46ddecd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1689 microversion: 2.1 time: 0.247560 Aug 25 14:22:00.730963 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3572/7223] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:00 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:01.442610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16612b3-17ba-4a55-8edb-bc26d193d546", "name": "network-vif-deleted", "tag": "42ccfd33-f05e-41bf-af16-c44656149e4b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:01.467317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:01.467931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:01.468507 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:01.483148 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] Creating event network-vif-deleted:42ccfd33-f05e-41bf-af16-c44656149e4b for instance e16612b3-17ba-4a55-8edb-bc26d193d546 on n-h2-850468-18 Aug 25 14:22:01.488292 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-a501eb73-6db4-4564-a8b0-e9b87d0533ef req-a132ae27-45e1-4ac4-a6bb-2cd74a8be0cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052678 Aug 25 14:22:01.489142 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3652/7224] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:22:01.752845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:01.753477 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:01.763916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:01.764819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:01.765648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:01.766874 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:01.767666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:01.768469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:01.820330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:01.820728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:01.821191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:01.821821 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'fault' on Instance uuid e16612b3-17ba-4a55-8edb-bc26d193d546 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:22:01.878255 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:01.896979 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c77d2e69-a892-4e96-9e5b-c367197379c3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 200 len: 1356 microversion: 2.1 time: 0.148373 Aug 25 14:22:01.899015 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3573/7225] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:01 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:02.922646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:02.923352 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: e16612b3-17ba-4a55-8edb-bc26d193d546] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:02.929780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:02.930267 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:02.930712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:02.931413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:02.931866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:02.932917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:02.946869 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] HTTP exception thrown: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Request method failure captured: Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 HTTP/1.1 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4TcWF9hwc8jIfxzJdGYoI88N--vApysXqkPPUGzHK1kXOP-YEgmv3MfV1h_WDONKzgUx8iFXg0D--gs1yMiUSapL_qaVlli1iqo8DXUFYqLisI2ZKXoslhdGPoVWCXmyrHw1Z0FOyKvZGIP5SKrtU807BLqBY0xhSZkV5aIOXw4tvM Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d0da6af7ac444c00855eee2e3eaa1681 Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'e16612b3-17ba-4a55-8edb-bc26d193d546'} Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:22:02.949491 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Returning 404 to user: Instance e16612b3-17ba-4a55-8edb-bc26d193d546 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-573975f2-0345-4cfe-a8f4-ae46d8db7391 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546" status: 404 len: 111 microversion: 2.1 time: 0.033363 Aug 25 14:22:02.954221 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3653/7226] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:02 2022] GET /compute/v2.1/servers/e16612b3-17ba-4a55-8edb-bc26d193d546 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:22:06.094233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-750ddc1f-0580-43a9-bf48-33b79d388c9e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '.version_select at 0x7fc6c10610d0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:06.117314 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-750ddc1f-0580-43a9-bf48-33b79d388c9e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1675104600" status: 202 len: 0 microversion: 2.1 time: 0.026860 Aug 25 14:22:06.118553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3574/7227] 10.222.0.60 () {58 vars in 1284 bytes} [Thu Aug 25 14:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1675104600 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:22:06.143616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-41b5da15-9956-4b6c-b558-9d71107a2af9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: .version_select at 0x7fc6c16e23a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-587815061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNQnnPOiVLoiUdbFe6czFlOSgUzNLnATdFtDIYhplyFSV/5GjHOpSCr3cVP5kFGI0QnMJVWsscvdBprmIah31nQx7E72L52H6VKq/Xq0v9AA0n0Gp047YBpIKnSyuM+0Q=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:06.160841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-41b5da15-9956-4b6c-b558-9d71107a2af9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:22:06.168364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-41b5da15-9956-4b6c-b558-9d71107a2af9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:22:06.193395 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-41b5da15-9956-4b6c-b558-9d71107a2af9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053658 Aug 25 14:22:06.193999 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3654/7228] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:22:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:12.333924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:12.338058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-113524232", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "02246f00-3d2c-4719-8fc2-6e429e637e35"}], "key_name": "tempest-TestNetworkAdvancedServerOps-587815061", "security_groups": [{"name": "tempest-secgroup-smoke-1127084000"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:12.458773 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] validate_networks() for [('02246f00-3d2c-4719-8fc2-6e429e637e35', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:22:12.957201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:22:12.957653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:22:12.958158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:22:12.958593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:22:12.959027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:22:12.970844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:12.971582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:12.972039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:12.972861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:12.973417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:12.973805 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:12.994152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:22:13.000809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:22:13.019511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:22:13.022517 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:22:13.086342 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f642f0d-683e-43b5-8c07-e3bcd03adb84 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753636 Aug 25 14:22:13.087187 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3575/7229] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:22:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:22:13.097442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:13.102913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-47cd5f74-0e2c-4aaf-a632-91f4538c7313 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:13.103540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-47cd5f74-0e2c-4aaf-a632-91f4538c7313 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:13.192555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-47cd5f74-0e2c-4aaf-a632-91f4538c7313 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:13.202535 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-47cd5f74-0e2c-4aaf-a632-91f4538c7313 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1265 microversion: 2.1 time: 0.107294 Aug 25 14:22:13.204097 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3655/7230] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:13 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:14.227673 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:14.228363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:14.239958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:14.240527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:14.241055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:14.241780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:14.242500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:14.242953 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:14.316792 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:14.327214 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9b7cebb9-5387-49db-8b5e-e0e7c8a9b92a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1335 microversion: 2.1 time: 0.103750 Aug 25 14:22:14.327809 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3576/7231] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:14 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:22:15.349583 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:15.350838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:15.359858 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:15.360382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:15.361018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:15.361925 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:15.362568 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:15.363424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:15.560518 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:15.570477 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dec11543-a33b-41e7-b3a2-dff7f9bf16b4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.225476 Aug 25 14:22:15.571639 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3656/7232] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:15 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:15.811467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:15.826071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:15.826669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:15.827172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:15.840909 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] Creating event network-changed:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h2-850468-18 Aug 25 14:22:15.846126 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-4eb250a9-9db5-4616-9dce-22d0bfcb3905 req-2a79f7bd-7784-4fa7-8d7e-cae87f49a656 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040374 Aug 25 14:22:15.846744 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3577/7233] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:16.591813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:16.592605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:16.599907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:16.600430 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:16.600882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:16.601591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:16.602055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:16.602493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:16.745179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:16.753174 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a11a5062-4505-4446-bbed-9e9715e7c8f5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.166140 Aug 25 14:22:16.753746 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3657/7234] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:16 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:17.777713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:17.778455 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:17.785055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:17.785558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:17.786015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:17.786734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:17.787201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:17.787636 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:17.935915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:17.944374 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1ec992f6-878f-4c73-9186-d9ef340b6745 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.173041 Aug 25 14:22:17.944977 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3578/7235] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:17 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:18.966326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:18.966955 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:18.974070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:18.974554 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:18.975045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:18.975766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:18.976260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:18.976694 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:19.136379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:19.145240 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-8d76a1c4-d846-4389-bb2a-23738d836ac0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.183650 Aug 25 14:22:19.145828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3658/7236] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:18 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:22:20.168693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:20.169359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:20.175534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:20.176044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:20.176539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:20.177257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:20.177730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:20.178177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:20.319026 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:20.328178 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b69776ab-e5ff-47bb-86fc-d51ab014fe50 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.164526 Aug 25 14:22:20.328764 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3579/7237] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:20 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:20.641212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "name": "network-vif-plugged", "status": "completed", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:20.651728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:20.652243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:20.652685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:20.664088 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] Creating event network-vif-plugged:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h2-850468-18 Aug 25 14:22:20.669758 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f7e55977-e8c4-4f3f-b9ca-0adb8e96851d req-7205a6bf-71ed-4da9-9dab-9b0f0ec07838 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103745 Aug 25 14:22:20.670366 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3659/7238] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:22:21.349367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:21.349917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:21.357566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:21.358080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:21.358543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:21.359274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:21.359746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:21.360218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:21.505696 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:21.514098 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-39adb245-d179-4119-bd00-fd963c32857d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1391 microversion: 2.1 time: 0.168688 Aug 25 14:22:21.514693 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3580/7239] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:21 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:22.536961 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:22.537844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:22.539785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:22.546788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:22.547277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:22.547720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:22.548456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:22.548908 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:22.549362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:22.694924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:22.703472 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-16bae45a-adda-4c20-89c2-e8e007dbf38f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1563 microversion: 2.1 time: 0.171664 Aug 25 14:22:22.704068 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3660/7240] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:22 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:22.725103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:22.725737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:22.734777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:22.735315 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:22.735741 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:22.736518 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:22.736966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:22.737413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:22.887331 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:22.901141 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c36fb6d-e3be-4908-8fe5-04abb1cda822 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1563 microversion: 2.1 time: 0.179780 Aug 25 14:22:22.901827 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3581/7241] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:22 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:24.626025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:24.626686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:24.633156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:24.639108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:24.644882 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:24.646112 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:24.647477 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:24.648612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:24.649646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:24.650496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:24.651277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:24.651803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:24.658889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:24.659714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:24.660290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:24.674293 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] Creating event network-changed:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h2-850468-18 Aug 25 14:22:24.680751 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-9f69a294-2ae6-47eb-ac44-f2d7536e780c req-9ec891f7-f77a-4f26-873e-570c4029fd2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050391 Aug 25 14:22:24.683336 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3582/7242] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:22:24.906877 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:24.916462 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-de9ce6b3-fd9f-4bf0-93be-59af5f302c82 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1563 microversion: 2.1 time: 0.294371 Aug 25 14:22:24.921809 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3661/7243] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:24 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1563 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:22:48.172404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:48.173844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=36 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:48.178982 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:48.181585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:48.192025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:48.192577 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:48.193033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:48.194115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:48.194479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:48.194919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:48.251597 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6baf8144-8f04-4029-97b9-e76a2bd40709 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action" status: 200 len: 24556 microversion: 2.1 time: 0.080930 Aug 25 14:22:48.252310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3583/7244] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:22:48 2022] POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action => generated 24556 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:22:59.321093 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:22:59.323713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:59.328933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:59.330236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=32 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:59.332832 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:22:59.333120 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:22:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action (ip 10.222.0.60) !!! Aug 25 14:22:59.344102 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.344647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.345232 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.345992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.346481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.346923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.442520 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:59.449394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122701) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 25 14:22:59.457656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:22:59.458105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:22:59.458588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:22:59.459006 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:22:59.459427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:22:59.538534 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5802df0-84e9-48cd-ad16-92591b13f93f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.220686 Aug 25 14:22:59.538534 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3662/7245] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:22:59 2022] POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 14:22:59.551377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:22:59.553110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:22:59.558438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:59.559894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:22:59.565585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.566097 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.566593 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.567601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:22:59.568186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:22:59.568756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:22:59.843863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:22:59.852847 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a47d9e2f-6141-43c6-a7f3-71c61c7961d0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1690 microversion: 2.1 time: 0.307087 Aug 25 14:22:59.853442 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3584/7246] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:22:59 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:00.878861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:00.879725 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:00.886911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:00.888311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:00.889645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:00.889792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:00.890248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:00.890682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:01.076663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:01.092883 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6b23de72-3e38-4c51-a12c-fe7f3427308f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1690 microversion: 2.1 time: 0.220613 Aug 25 14:23:01.094250 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3663/7247] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:00 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:02.118140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:02.119008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:02.127755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.128306 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.128777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:02.129521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:02.129993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:02.130437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:02.317617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:02.333017 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-086d1b6e-d47e-40e3-ac47-33f6d5bac395 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.219541 Aug 25 14:23:02.333714 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3585/7248] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:02 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:03.357496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:03.358383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:03.366464 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:03.366949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:03.367395 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:03.368145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:03.368628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:03.369063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:03.540779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:03.555043 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c129603d-f196-4a6a-b1c7-c6b2668e7b7c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.201652 Aug 25 14:23:03.556043 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3664/7249] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:03 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:04.579340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:04.580065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:04.587506 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:04.588042 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:04.588602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:04.589327 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:04.589790 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:04.590910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:04.754706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:04.767596 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e854fbc4-e0fd-486d-ba2c-0bd40e1b81e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.192614 Aug 25 14:23:04.768223 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3586/7250] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:04 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:05.790822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:05.791722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:05.799570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.800062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.800534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.801251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:05.801704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:05.802131 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:05.965000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:05.973934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-af385ac3-8e96-40f3-a1a0-f64cff2136e7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.186925 Aug 25 14:23:05.974568 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3665/7251] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:05 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:06.999884 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:07.000875 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:07.009750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:07.010265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:07.010727 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:07.011465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:07.012489 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:07.012949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:07.173837 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:07.185226 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c4bc76a9-1f41-42d8-8d07-82cd935300a9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.190027 Aug 25 14:23:07.185945 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3587/7252] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:06 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:08.211486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:08.212707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:08.226174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:08.226941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:08.227517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:08.228405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:08.229106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:08.229619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:08.443221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:08.454485 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-75682eaa-a8dd-42eb-816b-947916e6d595 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.249077 Aug 25 14:23:08.455632 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3666/7253] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:08 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:09.483069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:09.483672 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:09.492173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:09.492859 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:09.493431 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:09.494287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:09.494868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:09.495421 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:09.687650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:09.702323 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4bd26342-0915-4674-bcf3-a0039b5756e6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.223361 Aug 25 14:23:09.702937 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3588/7254] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:09 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:10.727949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:10.729057 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:10.741569 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:10.742351 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:10.743051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:10.744260 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:10.745115 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:10.745833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:11.001663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:11.017834 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5ffab94c-1cd1-4038-ad48-ada6365f4d68 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.296248 Aug 25 14:23:11.019000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3667/7255] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:10 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:12.059454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:12.060521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:12.073175 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:12.074119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:12.075550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:12.076747 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:12.077601 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:12.078404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:12.290115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:12.306819 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f8c2ebc0-ecd3-485c-be1c-23c91e271942 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.254040 Aug 25 14:23:12.307942 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3589/7256] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:12 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:13.345628 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:13.346966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:13.354326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:13.354842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:13.355293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:13.356647 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:13.357121 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:13.357557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:13.532297 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:13.544294 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-90bcc65b-57e4-4fbc-a73a-d4fb6fb9c4d1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.205977 Aug 25 14:23:13.544920 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3668/7257] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:13 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:14.570383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:14.571523 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:14.582583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:14.583168 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:14.583642 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:14.584428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:14.584990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:14.585432 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:14.807122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:14.822809 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-03758c08-c544-4b42-bdb3-34e45f2a89dc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.258105 Aug 25 14:23:14.823850 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3590/7258] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:14 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:15.861956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:15.862686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:15.875393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:15.876335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:15.877382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:15.878781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:15.879610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:15.880426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:16.071435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:16.084167 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-186f0cc6-3b85-4527-9a24-f26d52c59329 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.226312 Aug 25 14:23:16.085098 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3669/7259] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:15 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:17.115195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:17.115832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:17.123152 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:17.123657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:17.124134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:17.124861 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:17.125328 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:17.125778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:17.281948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:17.290252 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e7fa924c-5fdf-48bc-bc00-5316ed09dd01 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.179067 Aug 25 14:23:17.290853 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3591/7260] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:17 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:18.312915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:18.313547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:18.320870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:18.321354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:18.321798 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:18.322496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:18.322952 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:18.323378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:18.463020 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:18.471912 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-63bf5eae-6649-4536-8060-397d1758d2b5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1695 microversion: 2.1 time: 0.163152 Aug 25 14:23:18.472508 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3670/7261] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:18 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:19.487989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:19.494718 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:19.495588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:19.500205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:19.500952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:19.501539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:19.505498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:19.507678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:19.507678 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:19.508296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:19.508754 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:19.509555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:19.517575 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Creating event network-vif-unplugged:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h1-850468-18 Aug 25 14:23:19.523912 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122700) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:23:19.539990 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-425c5ebb-3954-4656-9874-221151460f47 req-6c147cb4-4e3c-4930-8be0-1653946f3f1c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055644 Aug 25 14:23:19.540663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3592/7262] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:19.665895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:19.674555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-30299a43-09c1-465b-8e29-8324923a326d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1694 microversion: 2.1 time: 0.184913 Aug 25 14:23:19.675454 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3671/7263] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:19 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:20.698324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:20.699040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:20.706909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:20.707408 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:20.707857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:20.709129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:20.709604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:20.710039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:20.854292 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:20.862537 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47604676-d919-44a8-9f35-12eee3c6acff tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1692 microversion: 2.1 time: 0.168423 Aug 25 14:23:20.863139 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3593/7264] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:20 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:21.584545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:21.595632 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:21.596107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:21.596570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:21.611816 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Creating event network-changed:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h1-850468-18 Aug 25 14:23:21.621799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-18', 'n-h2-850468-18'} {{(pid=122701) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 25 14:23:21.632814 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8e33b1a1-88f4-4ff7-bbb3-258c9a792cd3 req-3034226c-c624-4fe1-ba52-779c60ab6337 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051933 Aug 25 14:23:21.633433 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3672/7265] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:23:21.886412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:21.888765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:21.896604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:21.897110 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:21.897561 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:21.898278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:21.898738 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:21.899171 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:22.052053 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:22.061420 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-34548942-fd93-4771-8dc9-4cd7f73b97f3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1692 microversion: 2.1 time: 0.179760 Aug 25 14:23:22.062269 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3594/7266] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:21 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:23.085923 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:23.086783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:23.094325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:23.094825 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:23.095361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:23.096290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:23.096864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:23.097403 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:23.565668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:23.581211 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-02122043-b302-480c-be1a-ae37f8b7348b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1692 microversion: 2.1 time: 0.500158 Aug 25 14:23:23.582254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3673/7267] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:23 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1692 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:24.609361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:24.610721 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:24.624731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.625428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.626274 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.627651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.628566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.629366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.818251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:24.827961 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1b69ef24-337b-4587-96c0-485b71d27336 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1689 microversion: 2.1 time: 0.226278 Aug 25 14:23:24.828628 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3595/7268] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:24 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:23:24.853784 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:24.854402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:24.864910 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.866024 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.866486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.867379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.868143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.868579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.941284 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ecbe22f-39fa-498c-b8e8-eec7eed64f9b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action" status: 204 len: 0 microversion: 2.1 time: 0.091982 Aug 25 14:23:24.942040 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3674/7269] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:23:24 2022] POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:23:24.955938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:24.957188 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:24.969249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.970280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.971375 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:24.972583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:24.973435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:24.974183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:25.154415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:25.164537 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6c214f44-dc4f-4fda-8958-09914e167ec0 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1689 microversion: 2.1 time: 0.216959 Aug 25 14:23:25.165321 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3596/7270] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:24 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:25.188374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:25.189205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:25.197401 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:25.198173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:25.199084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:25.200160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:25.200612 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:25.201127 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:25.410743 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:25.426688 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-72834e6b-dd1b-420c-bea3-869ff7f2dc2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1689 microversion: 2.1 time: 0.243896 Aug 25 14:23:25.427799 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3675/7271] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:25 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:26.400413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "name": "network-vif-plugged", "status": "completed", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:26.413467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:26.413947 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:26.414502 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:26.432049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] Creating event network-vif-plugged:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h1-850468-18 Aug 25 14:23:26.439522 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-5635507a-d2f8-4e67-a11c-34e306f1f3cb req-230a2d63-20a2-4376-84f1-28f88af4b1ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042676 Aug 25 14:23:26.440259 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3597/7272] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:23:26.463564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:23:26.464466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:26.478263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:26.479737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:26.480467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:26.482662 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:26.483778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:26.484641 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:26.518350 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:26.705294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:23:26.717072 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2b4956bb-0010-4df7-b713-68d1e8c8dbcd tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1681 microversion: 2.1 time: 0.258638 Aug 25 14:23:26.717852 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3676/7273] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:23:26 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:23:56.956996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=28 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:56.958135 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=78 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:23:56.963122 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:23:56.965454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:23:56.973685 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:56.974197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:56.974647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:56.975370 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:23:56.975833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:23:56.976392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:23:57.052579 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8d456d1-8365-4dfc-abad-a92cd20c38d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action" status: 200 len: 24573 microversion: 2.1 time: 0.097714 Aug 25 14:23:57.053247 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3598/7274] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:23:56 2022] POST /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2/action => generated 24573 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:24:14.875656 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:14.876765 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:14.878380 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:14.882942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:14.884315 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:14.891623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:14.892353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:14.892929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:14.893902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:14.894476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:14.895070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:14.896099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:14.897411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=4 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:14.902869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:14.904387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:14.905599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:14.932280 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] Creating event network-changed:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h1-850468-18 Aug 25 14:24:14.939839 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:24:14.942056 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-fa2a92c3-a62b-4f9e-b8e8-0f9e6e7cfdd2 req-1385b881-60ff-4546-bfd1-03795d9699d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071821 Aug 25 14:24:14.943101 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3599/7275] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:24:15.080752 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-98e98b7c-2af2-41ec-8803-32a0ba45c5d7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 204 len: 0 microversion: 2.1 time: 0.211449 Aug 25 14:24:15.082303 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3677/7276] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:24:14 2022] DELETE /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:24:15.092695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:15.093560 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:15.100669 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:15.101287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:15.101752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:15.102688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:15.103177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:15.103632 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:15.287655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:15.306481 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-24f0bbe3-361b-4bb6-ab8e-08eb1c29914f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1687 microversion: 2.1 time: 0.219090 Aug 25 14:24:15.307319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3600/7277] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:15 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:16.337982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:16.338870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:16.349314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:16.349866 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:16.350645 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:16.351462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:16.352033 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:16.352621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:16.561051 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:16.576045 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d4bfd0d6-2aca-45ba-a332-7e3e32b70d7e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1687 microversion: 2.1 time: 0.244094 Aug 25 14:24:16.576839 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3678/7278] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:16 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:17.255612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2e656e-5f2b-4098-b19d-cdbc7be49ee2", "name": "network-vif-deleted", "tag": "1be35727-8671-4a38-9d40-2ca07dcced9b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:17.267295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:17.268640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:17.269782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:17.289067 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] Creating event network-vif-deleted:1be35727-8671-4a38-9d40-2ca07dcced9b for instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 on n-h1-850468-18 Aug 25 14:24:17.295831 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d545b4f7-14dc-4650-b2d3-f105f36cf1e1 req-6c54fe40-7ec2-4e64-a531-0e3119d7a335 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043849 Aug 25 14:24:17.296643 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3601/7279] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:24:17.602369 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:17.603009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:17.612387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:17.612888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:17.613328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:17.614462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:17.615168 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:17.615619 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:17.654905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:17.655456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:17.656077 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:17.656407 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'fault' on Instance uuid 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:24:17.710296 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:17.741365 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-00cfb676-c08c-418c-9adf-ca94232b4171 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 200 len: 1355 microversion: 2.1 time: 0.142912 Aug 25 14:24:17.741959 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3679/7280] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:17 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 1355 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:18.767596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:18.768359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:18.775290 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:18.775785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:18.776277 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:18.777000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:18.777467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:18.777900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:18.793951 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] HTTP exception thrown: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Request method failure captured: Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 HTTP/1.1 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4TcWF9hwc8jIfxzJdGYoI88N--vApysXqkPPUGzHK1kXOP-YEgmv3MfV1h_WDONKzgUx8iFXg0D--gs1yMiUSapL_qaVlli1iqo8DXUFYqLisI2ZKXoslhdGPoVWCXmyrHw1Z0FOyKvZGIP5SKrtU807BLqBY0xhSZkV5aIOXw4tvM Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d0da6af7ac444c00855eee2e3eaa1681 Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '0d2e656e-5f2b-4098-b19d-cdbc7be49ee2'} Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:24:18.796474 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Returning 404 to user: Instance 0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b8b94db7-516d-4e3c-8589-f532581aecb6 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2" status: 404 len: 111 microversion: 2.1 time: 0.038584 Aug 25 14:24:18.804410 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3602/7281] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:18 2022] GET /compute/v2.1/servers/0d2e656e-5f2b-4098-b19d-cdbc7be49ee2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:24:22.840816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-60dc9a3b-0170-4dcd-892f-27766bb452e9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '.version_select at 0x7fc6c2c23160>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:22.848776 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60dc9a3b-0170-4dcd-892f-27766bb452e9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [240fb10b-69ec-4ee0-811e-acdb72400662] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:24:23.861031 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-60dc9a3b-0170-4dcd-892f-27766bb452e9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [240fb10b-69ec-4ee0-811e-acdb72400662] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55192. Aug 25 14:24:23.886751 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-60dc9a3b-0170-4dcd-892f-27766bb452e9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587815061" status: 202 len: 0 microversion: 2.1 time: 1.051132 Aug 25 14:24:23.887369 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3680/7282] 10.222.0.60 () {58 vars in 1281 bytes} [Thu Aug 25 14:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587815061 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:24:23.920444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2a80556e-1392-4f96-97b3-fb3952297038 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: .version_select at 0x7fc6c162f280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1890767873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCciiwsUweHcPHFJtYq4T9kvWHC3vTlFtlDRpIjCFf3yxolReR1Ub9oyBTog/WzIJqv7t+rQuwRIdER8K6FCpLbgmM9/QhrZiQXqWCmx3aBH1SLgufQPaS3FNxJJB1ox1g=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:23.943012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2a80556e-1392-4f96-97b3-fb3952297038 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:24:23.949775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-2a80556e-1392-4f96-97b3-fb3952297038 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:24:23.980362 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2a80556e-1392-4f96-97b3-fb3952297038 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.065814 Aug 25 14:24:23.980992 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3603/7283] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:24:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:24:30.662117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-248078193", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "ae644fcb-ce8d-4f48-bf2d-9e4bc116616f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1890767873", "security_groups": [{"name": "tempest-secgroup-smoke-17954054"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:30.672995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:30.819598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] validate_networks() for [('ae644fcb-ce8d-4f48-bf2d-9e4bc116616f', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:24:31.259803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:24:31.260983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:24:31.262044 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:24:31.263813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:24:31.265003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:24:31.281906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:31.282930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:31.283640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:31.285070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:31.286064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:31.286846 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:31.317482 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:24:31.325241 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:24:31.342112 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:24:31.345571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:24:31.417954 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68068560-10fa-4260-b1be-003b7661df7b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.761357 Aug 25 14:24:31.419061 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3681/7284] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:24:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:24:31.435549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6595b85d-aabe-4eb0-9ca5-50dfc5c0f013 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:31.436610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6595b85d-aabe-4eb0-9ca5-50dfc5c0f013 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:31.440513 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:24:31.440513 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 (ip 10.222.0.60) !!! Aug 25 14:24:31.442674 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=12 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:31.518195 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6595b85d-aabe-4eb0-9ca5-50dfc5c0f013 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:31.529721 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6595b85d-aabe-4eb0-9ca5-50dfc5c0f013 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1266 microversion: 2.1 time: 0.101857 Aug 25 14:24:31.530760 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3604/7285] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:31 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:32.552631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:32.554027 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:32.573735 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:32.574413 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:32.574944 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:32.575902 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:32.576466 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:32.577028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:32.677495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:32.687594 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fa689765-8dec-402b-bcba-9ebba682f948 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1326 microversion: 2.1 time: 0.139458 Aug 25 14:24:32.706046 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3682/7286] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:32 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:33.715133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:33.717341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:33.725299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:33.726264 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:33.727381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:33.728458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:33.729205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:33.730034 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:33.905755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:33.914630 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4c84813-7cd3-47e0-a3c7-f264075914ba tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.203348 Aug 25 14:24:33.915569 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3605/7287] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:33 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:24:34.257890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60c69ae-cc0c-4830-b20e-8a1f39c65808", "tag": "4da70a81-89f2-4ffb-a411-f89dd6cf5105"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:34.277814 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:34.278318 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:34.280299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:34.295903 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] Creating event network-changed:4da70a81-89f2-4ffb-a411-f89dd6cf5105 for instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 on n-h2-850468-18 Aug 25 14:24:34.302452 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-e2ffdeeb-bb6c-4915-8346-69a6ab36d27e req-82139e12-d066-41dd-9c2c-94ad0b354943 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048550 Aug 25 14:24:34.303071 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3683/7288] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:24:34.937440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:34.938066 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:34.946114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:34.946630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:34.947093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:34.947846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:34.948358 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:34.948813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:35.114558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:35.123137 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-97ed1472-7660-4244-8e3e-ccdccc39c5ce tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.190351 Aug 25 14:24:35.123618 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3606/7289] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:34 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:36.149410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:36.151301 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:36.163091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:36.164013 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:36.165073 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:36.166462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:36.167339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:36.168148 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:36.347414 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:36.363964 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-361161f9-783f-41e9-8e23-d6d97119488e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.221068 Aug 25 14:24:36.365079 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3684/7290] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:36 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:37.385563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:37.387000 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:37.394942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:37.395449 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:37.395904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:37.396736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:37.397163 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:37.397612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:37.539706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:37.548287 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-52d70f9a-e0bb-4bd3-9029-15b40785ca95 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.166989 Aug 25 14:24:37.548880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3607/7291] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:37 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:38.570757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:38.571328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:38.578344 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:38.578826 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:38.579264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:38.579977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:38.580455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:38.580883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:38.726473 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:38.734894 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c446454-b687-47d6-9a8f-f1078173dbb2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.168379 Aug 25 14:24:38.735476 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3685/7292] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:38 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:39.092653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60c69ae-cc0c-4830-b20e-8a1f39c65808", "name": "network-vif-plugged", "status": "completed", "tag": "4da70a81-89f2-4ffb-a411-f89dd6cf5105"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:39.104690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:39.105270 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:39.105802 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:39.118894 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] Creating event network-vif-plugged:4da70a81-89f2-4ffb-a411-f89dd6cf5105 for instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 on n-h2-850468-18 Aug 25 14:24:39.124536 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7b1ed8c1-1418-465d-96f0-ad6523f69533 req-5289effd-c8ad-4dc8-b23f-698407a769e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Aug 25 14:24:39.125583 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3608/7293] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:24:39.755609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:39.756264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:39.764362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:39.764861 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:39.765305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:39.766016 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:39.766478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:39.766912 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:39.907933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:39.916017 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e961b81a-bce2-4d44-b501-f939dfccab8e tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1390 microversion: 2.1 time: 0.164317 Aug 25 14:24:39.916714 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3686/7294] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:39 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:40.938869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:40.939580 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:40.946990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:40.947488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:40.947935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:40.948956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:40.949425 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:40.949862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:41.092692 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:41.102273 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ed6c85c3-0183-4477-88c5-6c372b9ace8f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1562 microversion: 2.1 time: 0.167957 Aug 25 14:24:41.102875 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3609/7295] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:40 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:41.123811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:41.124528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:41.131668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:41.132200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:41.132657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:41.133383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:41.133896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:41.134280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:41.275380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:41.284555 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b8e56a71-4add-407f-aa8a-9192436a9d1c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1562 microversion: 2.1 time: 0.164527 Aug 25 14:24:41.285145 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3687/7296] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:41 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:24:43.264746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60c69ae-cc0c-4830-b20e-8a1f39c65808", "tag": "4da70a81-89f2-4ffb-a411-f89dd6cf5105"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:24:43.269211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:24:43.269954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:24:43.271462 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:43.272424 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:43.276726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:24:43.282102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:43.282357 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:43.282732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:43.282911 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:43.283248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:43.283772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:43.284717 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:24:43.285708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:24:43.287365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:24:43.297026 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] Creating event network-changed:4da70a81-89f2-4ffb-a411-f89dd6cf5105 for instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 on n-h2-850468-18 Aug 25 14:24:43.303038 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-3198f058-93a2-4a1b-8710-58f4c21cb401 req-4d7fb2a3-e12c-49ab-8ffb-88357782a973 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041991 Aug 25 14:24:43.303656 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3688/7297] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:24:43.440777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:24:43.450126 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a42d67cf-14cc-469c-b502-f8f1f0b59679 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1562 microversion: 2.1 time: 0.191578 Aug 25 14:24:43.450983 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3610/7298] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:24:43 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:06.724816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:06.725673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=36 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:06.730212 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:06.732557 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:06.740035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:06.740548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:06.740992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:06.741700 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:06.742154 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:06.742574 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:06.799951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1e9f93f4-74a9-40c8-afc5-8f4da72905c4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action" status: 200 len: 24569 microversion: 2.1 time: 0.076760 Aug 25 14:25:06.800670 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3689/7299] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:25:06 2022] POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action => generated 24569 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:25:13.217105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:13.220573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:13.221413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=32 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:13.228863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:13.229496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:13.229949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:13.257240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Going to try to stop instance {{(pid=122700) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 14:25:13.305560 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30fbadd4-d184-4bab-ba40-3b1267e1e048 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action" status: 202 len: 0 microversion: 2.1 time: 0.092447 Aug 25 14:25:13.306297 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3611/7300] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:25:13 2022] POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:25:13.315515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:13.316325 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:13.324585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:13.325090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:13.325541 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:13.326263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:13.326723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:13.327155 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:13.471646 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:13.479547 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f8d4df65-1af2-401d-89e9-f61a5daf2aa3 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.168402 Aug 25 14:25:13.480141 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3690/7301] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:13 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:14.505109 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:14.505749 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:14.512551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:14.513161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:14.513653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:14.514494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:14.515012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:14.515768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:14.659734 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:14.667798 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-09ddeb5f-7941-4131-9087-396e171998a1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.168734 Aug 25 14:25:14.668406 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3612/7302] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:14 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:15.689756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:15.690643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:15.698467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:15.698960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:15.699412 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:15.700143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:15.700659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:15.701090 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:15.845529 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:15.853686 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b354b037-9f89-4cb1-a1cd-91810720584b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.168507 Aug 25 14:25:15.854264 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3691/7303] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:15 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:16.877303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:16.878564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:16.884990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:16.885496 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:16.885949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:16.886665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:16.887149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:16.887568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:17.023547 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:17.031476 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-66317c8e-0fa9-42a5-99fb-da2a5dda8b31 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.158720 Aug 25 14:25:17.032048 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3613/7304] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:16 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:18.054140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:18.054690 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:18.061705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:18.062187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:18.062623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:18.063328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:18.063810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:18.064287 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:18.209478 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:18.217301 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b24f5546-41ae-4a9b-8421-0bd9d1e1c6d8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.167163 Aug 25 14:25:18.217894 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3692/7305] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:18 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:25:19.239387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:19.239993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:19.247253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:19.247618 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:19.248076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:19.248815 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:19.249284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:19.249716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:19.388230 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:19.398319 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-58a4f35e-17bb-4c7f-9d92-2dc99d609f83 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.162140 Aug 25 14:25:19.398319 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3614/7306] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:19 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:20.420152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:20.420766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:20.428439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:20.428927 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:20.429747 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:20.430461 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:20.430918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:20.431346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:20.573185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:20.581711 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f5c5ea06-0c33-4d18-aed7-f7e918527428 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.165483 Aug 25 14:25:20.582303 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3693/7307] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:20 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:21.603138 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:21.603731 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:21.611236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:21.611787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:21.612278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:21.613039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:21.613512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:21.613950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:21.753096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:21.760870 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-492652cb-c418-45e4-94c7-2897f441dc1f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.161782 Aug 25 14:25:21.761448 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3615/7308] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:21 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:22.782036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:22.783172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:22.790426 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:22.790962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:22.791372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:22.792107 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:22.792570 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:22.792995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:22.933615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:22.942691 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-944d2cd5-40e5-4242-b587-70e1074ae2c5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1690 microversion: 2.1 time: 0.164153 Aug 25 14:25:22.943015 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3694/7309] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:22 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:23.964925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:23.965549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:23.973787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:23.974282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:23.974733 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:23.975462 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:23.975927 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:23.976395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:24.129325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:24.137241 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1a3809cf-1aca-4b43-9871-fbaa8ef6562c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1667 microversion: 2.1 time: 0.176231 Aug 25 14:25:24.137823 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3616/7310] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:23 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1667 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:25.235268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:25.237685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:25.244648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:25.245138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:25.245579 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:25.246277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:25.246737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:25.247159 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:25.299225 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eb685200-39d1-43ac-a117-4aa68b107159 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action" status: 200 len: 35490 microversion: 2.1 time: 0.067700 Aug 25 14:25:25.299927 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3695/7311] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:25:25 2022] POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action => generated 35490 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:25:25.311944 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:25.319801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:25.320323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:25.320769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:25.343946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Going to try to start instance {{(pid=122700) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 14:25:25.390485 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-10f47966-b876-4c90-8e4c-08d18050c1ea tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action" status: 202 len: 0 microversion: 2.1 time: 0.082195 Aug 25 14:25:25.391096 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3617/7312] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:25:25 2022] POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:25:25.400449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:25.401880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:25.409059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:25.409731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:25.410382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:25.411190 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:25.411755 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:25.412259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:25.559771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:25.569696 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-01cf1e67-0d1e-4c68-a41a-1d1ba68a3d30 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1676 microversion: 2.1 time: 0.173388 Aug 25 14:25:25.570286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3696/7313] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:25 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:26.594413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:26.595966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:26.602571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:26.603072 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:26.603765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:26.604556 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:26.605023 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:26.605458 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:26.764487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:26.772550 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-61a7c62c-f3e8-47e8-a286-a2be2c279d2d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1680 microversion: 2.1 time: 0.183307 Aug 25 14:25:26.773122 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3618/7314] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:26 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:50.973598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:50.975770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:50.978552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:50.979214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=44 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:50.985993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:50.986476 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:50.986917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:50.988337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:50.988806 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:50.989229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:51.061462 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dbc69c9f-5482-4e37-9e20-5555024382b1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action" status: 200 len: 60053 microversion: 2.1 time: 0.092125 Aug 25 14:25:51.062139 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3697/7315] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:25:50 2022] POST /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808/action => generated 60053 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:25:58.154027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:58.156335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:58.165363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:58.166150 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:25:58.168004 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:58.169202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:58.170055 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:58.171321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:58.172378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:58.172851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:58.209978 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:25:58.221025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b60c69ae-cc0c-4830-b20e-8a1f39c65808", "tag": "4da70a81-89f2-4ffb-a411-f89dd6cf5105"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:25:58.234038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:58.234530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:58.234976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:58.247554 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] Creating event network-changed:4da70a81-89f2-4ffb-a411-f89dd6cf5105 for instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 on n-h2-850468-18 Aug 25 14:25:58.253708 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-c5372446-9801-4a7d-b2b3-0134ffb7072c req-9ce3db6b-ecdc-4af8-a6a4-a6c079967b6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103297 Aug 25 14:25:58.254465 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3698/7316] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:25:58.305758 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f455d918-1c9d-4821-bc6b-d8fc1a16b091 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 204 len: 0 microversion: 2.1 time: 0.156523 Aug 25 14:25:58.308495 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3619/7317] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:25:58 2022] DELETE /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:25:58.318668 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:58.319390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:58.326389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:58.326891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:58.327581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:58.328317 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:58.328779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:58.329219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:58.480973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:58.490483 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68ebeb03-bcbc-4c96-9a07-8e1dd17093f7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1568 microversion: 2.1 time: 0.177146 Aug 25 14:25:58.491369 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3699/7318] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:58 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:25:59.514602 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:25:59.515310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:25:59.523957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:59.524663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:59.525132 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:59.525904 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:25:59.526392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:25:59.526833 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:25:59.679735 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:25:59.687916 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c3467f3-bdbf-40a6-981d-fa9878026533 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1568 microversion: 2.1 time: 0.177536 Aug 25 14:25:59.688521 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3620/7319] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:25:59 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:26:00.315031 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60c69ae-cc0c-4830-b20e-8a1f39c65808", "name": "network-vif-deleted", "tag": "4da70a81-89f2-4ffb-a411-f89dd6cf5105"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:00.325896 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:00.326379 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:00.326815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:00.339796 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] Creating event network-vif-deleted:4da70a81-89f2-4ffb-a411-f89dd6cf5105 for instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 on n-h2-850468-18 Aug 25 14:26:00.346102 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1ee767e1-459c-4213-b129-f53dbd15ed8e req-7ad34d7c-2d17-4ac3-9d89-d9f7ca72af09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 Aug 25 14:26:00.347512 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3700/7320] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:00.713589 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:00.714946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:00.724353 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:00.725256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:00.725952 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:00.726936 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:00.727660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:00.728445 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:00.770215 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:00.771204 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:00.772142 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:00.774063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'fault' on Instance uuid b60c69ae-cc0c-4830-b20e-8a1f39c65808 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:26:00.826325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:00.834534 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e92a0703-2304-4a7e-a20f-cbf182d7d10d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 200 len: 1356 microversion: 2.1 time: 0.127323 Aug 25 14:26:00.835137 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3621/7321] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:00 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 1356 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:01.856849 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:01.857556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: b60c69ae-cc0c-4830-b20e-8a1f39c65808] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:01.864018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:01.864535 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:01.864973 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:01.865669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:01.866126 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:01.866550 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:01.880701 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] HTTP exception thrown: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Request method failure captured: Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 HTTP/1.1 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4TcWF9hwc8jIfxzJdGYoI88N--vApysXqkPPUGzHK1kXOP-YEgmv3MfV1h_WDONKzgUx8iFXg0D--gs1yMiUSapL_qaVlli1iqo8DXUFYqLisI2ZKXoslhdGPoVWCXmyrHw1Z0FOyKvZGIP5SKrtU807BLqBY0xhSZkV5aIOXw4tvM Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: d0da6af7ac444c00855eee2e3eaa1681 Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'b60c69ae-cc0c-4830-b20e-8a1f39c65808'} Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:26:01.882389 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Returning 404 to user: Instance b60c69ae-cc0c-4830-b20e-8a1f39c65808 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-dc1295e8-47c1-43d5-98d7-647baa884e98 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808" status: 404 len: 111 microversion: 2.1 time: 0.032218 Aug 25 14:26:01.887498 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3701/7322] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:01 2022] GET /compute/v2.1/servers/b60c69ae-cc0c-4830-b20e-8a1f39c65808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:26:05.461149 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-083ba7aa-930c-438c-8116-f11540796259 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '.version_select at 0x7fc6c10a9dc0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:05.493118 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-083ba7aa-930c-438c-8116-f11540796259 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1890767873" status: 202 len: 0 microversion: 2.1 time: 0.041711 Aug 25 14:26:05.494221 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3622/7323] 10.222.0.60 () {58 vars in 1284 bytes} [Thu Aug 25 14:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1890767873 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:26:05.528560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f742c47-2040-4667-9a69-b0722ee133a5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: .version_select at 0x7fc6c2a9faf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1339954079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZi59c+tz4M4Pch49CsK8L+8YmYhinDVNKauiji8QGEzzPjogJdz7SYxaNGxy4denp8RZ4GmS5i2gCF7Aw8Z3ewJRav+r3Q0FCwskW+FZiaUH9uSMWXeBGGHubGr9uZiA=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:05.545092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3f742c47-2040-4667-9a69-b0722ee133a5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:26:05.551785 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-3f742c47-2040-4667-9a69-b0722ee133a5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:26:05.578432 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f742c47-2040-4667-9a69-b0722ee133a5 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054109 Aug 25 14:26:05.579053 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3702/7324] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:26:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:11.390366 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:11.397239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1174270607", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "networks": [{"uuid": "fa861396-2f1d-40bb-bde6-8c9de2a38e97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1339954079", "security_groups": [{"name": "tempest-secgroup-smoke-1361411215"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:11.570447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] validate_networks() for [('fa861396-2f1d-40bb-bde6-8c9de2a38e97', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:26:12.100265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:26:12.100920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:26:12.101585 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:26:12.102276 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:26:12.102955 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:26:12.116756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:12.117476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:12.118105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:12.119229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:12.120080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:12.120758 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:12.142822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:26:12.149832 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Getting quotas for user d0da6af7ac444c00855eee2e3eaa1681 and project 4a09b33776f44e85b837db34d861cf6c. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:26:12.165354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:26:12.168025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:26:12.222132 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f4074319-826d-4c17-bc99-5e24061f6b6b tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833372 Aug 25 14:26:12.224289 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3623/7325] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:26:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 14:26:12.233934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-433cccc6-ab37-4f01-b545-b868ff05c384 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:12.235695 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-433cccc6-ab37-4f01-b545-b868ff05c384 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:12.243053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=16 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:12.313215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-433cccc6-ab37-4f01-b545-b868ff05c384 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:12.322176 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-433cccc6-ab37-4f01-b545-b868ff05c384 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1267 microversion: 2.1 time: 0.092030 Aug 25 14:26:12.336515 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3703/7326] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:12 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:13.365576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:13.368094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:13.382706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:13.383235 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:13.383714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:13.384918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:13.385586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:13.386241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:13.508766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:13.521480 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-35979d85-ff7d-4a30-b5ea-e53a4794b78a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1327 microversion: 2.1 time: 0.179958 Aug 25 14:26:13.522554 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3624/7327] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:13 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:14.551948 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:14.552613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:14.561087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:14.561788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:14.562409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:14.563547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:14.564269 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:14.564928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:14.869066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:14.879330 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f7d0d5ee-4c68-4d60-8728-a6b71810cca7 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.331864 Aug 25 14:26:14.880304 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3704/7328] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:14 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:15.269105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc395346-b601-4733-93b4-a5affdc6f011", "tag": "11947ecc-14c0-469a-ba23-0d97989f2fd0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:15.281950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:15.282594 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:15.283069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:15.297770 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] Creating event network-changed:11947ecc-14c0-469a-ba23-0d97989f2fd0 for instance dc395346-b601-4733-93b4-a5affdc6f011 on n-h2-850468-18 Aug 25 14:26:15.304393 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-de98c3ba-b2f3-4441-a09c-2595b27613a0 req-a9165d24-732b-41ce-a8cf-339bf2fa32a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038937 Aug 25 14:26:15.305061 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3625/7329] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:26:15.914521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:15.915091 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:15.922337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:15.922870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:15.923322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:15.924048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:15.924623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:15.925063 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:16.080143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:16.089042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-67bd3cf3-7c68-4ea8-b195-ac2bfdfa10cb tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.178757 Aug 25 14:26:16.089639 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3705/7330] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:15 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:26:17.112920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:17.113664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:17.121643 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:17.122156 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:17.122641 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:17.123373 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:17.123854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:17.124338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:17.382472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:17.395738 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1bde8d2a-4e2d-41e4-9ed0-cc1cc293973c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.288236 Aug 25 14:26:17.396422 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3626/7331] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:17 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:18.417757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:18.418420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:18.426184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:18.426683 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:18.427130 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:18.427845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:18.428343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:18.428779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:18.576326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:18.584817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-390808a6-0818-4773-a8b0-8e4df237bce9 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.170887 Aug 25 14:26:18.585416 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3706/7332] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:18 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:19.606917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:19.607659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:19.616487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:19.617025 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:19.617531 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:19.618335 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:19.618693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:19.619134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:19.659938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc395346-b601-4733-93b4-a5affdc6f011", "name": "network-vif-plugged", "status": "completed", "tag": "11947ecc-14c0-469a-ba23-0d97989f2fd0"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:19.673810 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:19.674521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:19.675019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:19.693866 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] Creating event network-vif-plugged:11947ecc-14c0-469a-ba23-0d97989f2fd0 for instance dc395346-b601-4733-93b4-a5affdc6f011 on n-h2-850468-18 Aug 25 14:26:19.699744 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-5ce8bb30-584e-495e-b369-e0537c9f9fd4 req-aa7bdcf5-3324-4e0b-bfd9-c3e6662f6426 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044781 Aug 25 14:26:19.700579 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3707/7333] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:26:19.800958 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:19.809381 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0c339f36-2dfa-4c6b-b8e1-b9d8119d10d4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.206675 Aug 25 14:26:19.809978 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3627/7334] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:19 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:20.835491 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:20.836346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:20.848501 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.849124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.849448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:20.850176 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:20.850639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:20.851109 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:21.022850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:21.032273 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf1de64f-2b94-440e-886a-beba288e16e2 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1393 microversion: 2.1 time: 0.204753 Aug 25 14:26:21.033263 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3708/7335] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:20 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1393 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:22.058107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:22.058796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:22.066946 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:22.067433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:22.067889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:22.068652 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:22.069114 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:22.069548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:22.130460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:22.162303 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:22.215659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:22.224746 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a0296523-d415-44be-b4bf-66c7df06b132 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1566 microversion: 2.1 time: 0.170539 Aug 25 14:26:22.225394 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3628/7336] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:22 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:22.246255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:22.246899 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:22.249847 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:22.255566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:22.256072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:22.256546 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:22.257268 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:22.257731 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:22.258195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:22.321532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:22.399181 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:22.407185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a63caed8-6368-4974-9cbb-da813674330c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1566 microversion: 2.1 time: 0.164869 Aug 25 14:26:22.407916 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3709/7337] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:22 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:24.229422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:24.230207 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:24.239630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:24.240565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:24.241465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:24.242280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:24.242767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:24.243217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:24.293730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc395346-b601-4733-93b4-a5affdc6f011", "tag": "11947ecc-14c0-469a-ba23-0d97989f2fd0"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:24.306931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:24.308509 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:24.309513 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:24.326769 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] Creating event network-changed:11947ecc-14c0-469a-ba23-0d97989f2fd0 for instance dc395346-b601-4733-93b4-a5affdc6f011 on n-h2-850468-18 Aug 25 14:26:24.332394 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-23d48668-ffd8-4d88-84b2-9104f0b85adc req-8c8f1632-4966-4f8a-8be5-84f045da28b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106128 Aug 25 14:26:24.333581 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3710/7338] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:26:24.438436 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:24.451683 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e8c90d06-05c1-4d8e-be86-b67a566b3a9a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1566 microversion: 2.1 time: 0.225984 Aug 25 14:26:24.456688 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3629/7339] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:24 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:45.741178 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:45.742970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:45.752974 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:45.757286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:45.773715 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:45.774553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:45.775224 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:45.776444 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:45.777200 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:45.777959 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:45.864509 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-36dad75e-7e3f-4047-9c4f-a3998cca2619 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action" status: 200 len: 24570 microversion: 2.1 time: 0.126568 Aug 25 14:26:45.865236 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3711/7340] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:26:45 2022] POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action => generated 24570 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:26:56.929578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:56.930346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:56.932298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:56.932961 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=34 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:56.938809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:56.939966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:56.940793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:56.941571 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:56.941994 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:56.942438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:56.969233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'flavor' on Instance uuid dc395346-b601-4733-93b4-a5affdc6f011 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:26:57.045676 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bf7e1204-da87-4179-937e-621fb0415b66 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action" status: 202 len: 0 microversion: 2.1 time: 0.120525 Aug 25 14:26:57.046329 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3630/7341] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:26:56 2022] POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:26:57.058080 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:57.058970 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:57.062204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:57.063277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:26:57.071243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:57.071757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:57.072246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:57.073000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:57.073471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:57.074123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:57.382573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:57.391529 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e71a5db6-693a-40a3-82f3-0331b0d87d21 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1693 microversion: 2.1 time: 0.338977 Aug 25 14:26:57.392128 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3712/7342] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:57 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1693 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:58.419482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:26:58.420226 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:58.428047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.428587 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.429054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:58.429782 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:58.430262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:58.430743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:58.714464 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:26:58.724654 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-11d55a85-0771-434a-8d75-1ed6732a1f1a tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1676 microversion: 2.1 time: 0.310132 Aug 25 14:26:58.725167 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3631/7343] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:26:58 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1676 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:26:59.824258 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:59.826611 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:59.835576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:59.836076 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:59.836576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:59.837299 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:59.837762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:59.838192 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:59.900016 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ded0bb7e-6789-4574-a606-4b23c67a0d7d tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action" status: 200 len: 38437 microversion: 2.1 time: 0.079897 Aug 25 14:26:59.901000 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3713/7344] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:26:59 2022] POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action => generated 38437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:26:59.914787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:26:59.915384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:26:59.922566 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:59.923155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:59.923625 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:26:59.924910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:26:59.924910 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:26:59.925399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:00.038719 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-da70381a-743d-42e0-9bc1-ddba532d5fec tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action" status: 202 len: 0 microversion: 2.1 time: 0.127761 Aug 25 14:27:00.041088 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3632/7345] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:26:59 2022] POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:27:00.052305 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:00.053383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:00.062103 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:00.062813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:00.063337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:00.064282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:00.066221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:00.066767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:00.358186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:00.371646 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d7f96461-73a9-4798-a392-b3c31b2d405c tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1682 microversion: 2.1 time: 0.325627 Aug 25 14:27:00.380966 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3714/7346] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:00 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:27:01.405339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:01.406385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:01.420769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:01.421351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:01.421844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:01.422675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:01.423158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:01.423599 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:01.600359 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:01.613755 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-220bb00a-d2fb-4dbb-ab5d-274aafc3ee7f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1682 microversion: 2.1 time: 0.213307 Aug 25 14:27:01.614734 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3633/7347] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:01 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:02.638277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:02.639007 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:02.653962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:02.654832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:02.655605 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:02.656931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:02.657770 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:02.658870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:02.818404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:02.827075 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7a7284eb-a233-4ef0-9784-7dad16aca063 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1685 microversion: 2.1 time: 0.193508 Aug 25 14:27:02.827683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3715/7348] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:02 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:02.941513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:02.943887 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:02.951847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:02.953324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:02.953324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:02.953704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:02.954123 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:02.954603 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:03.005740 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4c348a18-3aa0-4a8a-96cb-1688938f0afc tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action" status: 200 len: 38437 microversion: 2.1 time: 0.068150 Aug 25 14:27:03.006446 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3634/7349] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:27:02 2022] POST /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011/action => generated 38437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 14:27:04.146390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc395346-b601-4733-93b4-a5affdc6f011", "tag": "11947ecc-14c0-469a-ba23-0d97989f2fd0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:04.155758 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:04.156439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:04.165553 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:04.166065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:04.166515 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:04.167253 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:04.167622 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:04.167782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:04.168157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:04.168297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:04.168612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:04.182117 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] Creating event network-changed:11947ecc-14c0-469a-ba23-0d97989f2fd0 for instance dc395346-b601-4733-93b4-a5affdc6f011 on n-h2-850468-18 Aug 25 14:27:04.187903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-a5728f61-e0d0-4032-96e3-df86077d4f76 req-58a13b01-f23e-41f9-b23b-0d6a15ecfeae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047154 Aug 25 14:27:04.189111 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3635/7350] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:27:04.208049 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:27:04.333951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-79825128-ce59-45ea-a291-36e7e32f5fb4 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 204 len: 0 microversion: 2.1 time: 0.195065 Aug 25 14:27:04.335505 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3716/7351] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:27:04 2022] DELETE /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:27:04.345411 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:04.346724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:04.354134 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:04.355033 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:04.355501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:04.356307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:04.356798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:04.357245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:04.530513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:04.539685 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-feeae3fc-85c1-4978-a1de-7e0e737447a8 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1691 microversion: 2.1 time: 0.198798 Aug 25 14:27:04.540326 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3636/7352] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:04 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:05.563427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:05.564065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:05.571756 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:05.572323 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:05.572797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:05.573522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:05.573982 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:05.574417 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:05.849193 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:05.857658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b968879e-0a77-44c3-bbce-c37f2b08fb2f tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1691 microversion: 2.1 time: 0.298594 Aug 25 14:27:05.858254 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3717/7353] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:05 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1691 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:06.464444 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc395346-b601-4733-93b4-a5affdc6f011", "name": "network-vif-deleted", "tag": "11947ecc-14c0-469a-ba23-0d97989f2fd0"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:06.478249 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:06.478744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:06.479197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:06.497168 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] Creating event network-vif-deleted:11947ecc-14c0-469a-ba23-0d97989f2fd0 for instance dc395346-b601-4733-93b4-a5affdc6f011 on n-h2-850468-18 Aug 25 14:27:06.504981 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-19850a4f-328d-4c75-873b-7ee74cef5282 req-ef784ecd-1848-44f8-9ddb-f1ff056edb4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043619 Aug 25 14:27:06.506160 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3637/7354] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:27:06.886749 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:06.887913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:06.902548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:06.903058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:06.903510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:06.904285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:06.904924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:06.905384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:06.943768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:06.944580 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:06.945196 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:06.945916 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lazy-loading 'fault' on Instance uuid dc395346-b601-4733-93b4-a5affdc6f011 {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:27:07.005465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0da6af7ac444c00855eee2e3eaa1681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09b33776f44e85b837db34d861cf6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:07.013894 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eae1fc4b-a05d-4630-a66b-080951c29846 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 200 len: 1357 microversion: 2.1 time: 0.134144 Aug 25 14:27:07.014801 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3718/7355] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:06 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 1357 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:08.047176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:08.048258 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] [instance: dc395346-b601-4733-93b4-a5affdc6f011] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:08.057980 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:08.058492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:08.058956 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:08.059699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:08.060202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:08.060646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:08.083016 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] HTTP exception thrown: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Request method failure captured: Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 HTTP/1.1 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4TcWF9hwc8jIfxzJdGYoI88N--vApysXqkPPUGzHK1kXOP-YEgmv3MfV1h_WDONKzgUx8iFXg0D--gs1yMiUSapL_qaVlli1iqo8DXUFYqLisI2ZKXoslhdGPoVWCXmyrHw1Z0FOyKvZGIP5SKrtU807BLqBY0xhSZkV5aIOXw4tvM Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4a09b33776f44e85b837db34d861cf6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 4a09b33776f44e85b837db34d861cf6c Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-292689671 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: d0da6af7ac444c00855eee2e3eaa1681 Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestNetworkAdvancedServerOps-292689671-project Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': 'dc395346-b601-4733-93b4-a5affdc6f011'} Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:27:08.086115 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Returning 404 to user: Instance dc395346-b601-4733-93b4-a5affdc6f011 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-30a0f817-31b8-4e6f-819e-b90509c0d0c1 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011" status: 404 len: 111 microversion: 2.1 time: 0.055759 Aug 25 14:27:08.092880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3638/7356] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:08 2022] GET /compute/v2.1/servers/dc395346-b601-4733-93b4-a5affdc6f011 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:27:11.746675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1774141a-086c-40f1-bfe8-f98c53cd6117 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] Calling method '.version_select at 0x7fc6c2c238b0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:11.799402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1774141a-086c-40f1-bfe8-f98c53cd6117 tempest-TestNetworkAdvancedServerOps-292689671 tempest-TestNetworkAdvancedServerOps-292689671-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1339954079" status: 202 len: 0 microversion: 2.1 time: 0.058593 Aug 25 14:27:11.804272 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3719/7357] 10.222.0.60 () {58 vars in 1284 bytes} [Thu Aug 25 14:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1339954079 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:27:24.449533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=18 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:24.450854 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:24.730831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1f14810a-0636-42d2-bcd3-db1bbced22b0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'create', calling method: .version_select at 0x7fc6c064a160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1428835580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHirwX2ZMZt1NlBaoPh6l+Zn3lVtPikAGFaaQ/K41drR2NO0MiE3jfqwSUxBxvJal+voa9pmeEn+E/B3KDVx6MTTR7l6c1sm2fSDYD6q9gHZBcLOKZ3NQxT7G6aVhVc3YA=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:24.747860 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f14810a-0636-42d2-bcd3-db1bbced22b0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for project b3c3358e63964645b8eea1556d488d92. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:27:24.754826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-1f14810a-0636-42d2-bcd3-db1bbced22b0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for user e8771618bf9e47659aa49faec597a783 and project b3c3358e63964645b8eea1556d488d92. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:27:24.781284 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1f14810a-0636-42d2-bcd3-db1bbced22b0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.336500 Aug 25 14:27:24.781284 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3639/7358] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:27:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:27:26.038950 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:26.039816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:26.045776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-959956479", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1428835580", "security_groups": [{"name": "tempest-secgroup-smoke-1828262625"}], "networks": [{"uuid": "b3ee8bee-2675-4f6e-8e19-795bab2a38af"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:26.192087 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] validate_networks() for [('b3ee8bee-2675-4f6e-8e19-795bab2a38af', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:27:26.612134 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:27:26.612624 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:27:26.613120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:27:26.613573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:27:26.614037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:27:26.623575 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:26.624070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:26.624556 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:26.625306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:26.625766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:26.626209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:26.645834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for project b3c3358e63964645b8eea1556d488d92. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:27:26.651906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for user e8771618bf9e47659aa49faec597a783 and project b3c3358e63964645b8eea1556d488d92. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:27:26.666578 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:27:26.668993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:27:26.726962 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b10a9a27-0b82-43e4-a4be-f32052bab1c1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689653 Aug 25 14:27:26.727629 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3720/7359] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:27:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:27:26.742987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e878a269-95b9-4db2-bf9b-55fc64267a03 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:26.745541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e878a269-95b9-4db2-bf9b-55fc64267a03 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:26.807030 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e878a269-95b9-4db2-bf9b-55fc64267a03 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:26.814924 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e878a269-95b9-4db2-bf9b-55fc64267a03 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1246 microversion: 2.1 time: 0.077013 Aug 25 14:27:26.815534 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3640/7360] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:26 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:27.838471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-761be86f-8865-4b88-bc5c-cb8b58ab0520 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:27.839230 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-761be86f-8865-4b88-bc5c-cb8b58ab0520 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:27.913309 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-761be86f-8865-4b88-bc5c-cb8b58ab0520 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:27.920583 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-761be86f-8865-4b88-bc5c-cb8b58ab0520 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1246 microversion: 2.1 time: 0.087130 Aug 25 14:27:27.921445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3721/7361] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:27 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:28.942690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1d457e42-4e98-4e69-9082-2e66ef61fde1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:28.943337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1d457e42-4e98-4e69-9082-2e66ef61fde1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:29.005044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1d457e42-4e98-4e69-9082-2e66ef61fde1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:29.012897 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1d457e42-4e98-4e69-9082-2e66ef61fde1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1246 microversion: 2.1 time: 0.074634 Aug 25 14:27:29.013479 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3641/7362] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:28 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:30.041199 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:30.042897 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:30.051863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:30.053280 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:30.054256 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:30.055215 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:30.055921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:30.056639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:30.132803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:30.142137 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-9ee436d1-ff7e-45b7-86f7-00c9e25d5fce tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1304 microversion: 2.1 time: 0.106554 Aug 25 14:27:30.143054 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3722/7363] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:30 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:31.163746 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:31.164583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:31.172526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:31.173027 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:31.174039 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:31.174755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:31.175218 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:31.175826 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:31.319301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:31.322324 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:31.328172 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9675fe0-a1ea-4d11-8873-75daf5dc641c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.168309 Aug 25 14:27:31.329406 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3642/7364] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:31 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:31.340652 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:31.341503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:31.342143 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:31.355940 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] Creating event network-changed:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:27:31.361520 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-cd86c894-849a-4062-ac04-729197dec311 req-e66f5763-f898-4735-bc86-36eadf77c71c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044456 Aug 25 14:27:31.362233 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3723/7365] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:27:32.351242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:32.351803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:32.358799 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:32.359296 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:32.359750 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:32.360499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:32.360973 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:32.361409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:32.499723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:32.507739 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-38bd9d5e-42d3-406b-99be-15ca23e2e9b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.160520 Aug 25 14:27:32.508375 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3643/7366] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:32 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:33.530035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:33.530812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:33.539018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:33.539510 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:33.539954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:33.540693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:33.541156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:33.541589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:33.682545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:33.691995 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-774572fe-8c6a-40a5-a7bb-4b3c9c3f6f3b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.166772 Aug 25 14:27:33.692607 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3724/7367] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:33 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:34.712760 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:34.713378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:34.721238 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:34.721892 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:34.722143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:34.722856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:34.723323 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:34.723762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:34.862337 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:34.870499 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bb8d6dbe-7938-4cf5-971b-a824630068ec tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.161619 Aug 25 14:27:34.871080 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3644/7368] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:34 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:35.892811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:35.893585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:35.900935 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:35.901432 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:35.902390 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:35.902591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:35.903053 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:35.903484 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:36.050110 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:36.063504 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3cf4b2aa-1447-4a34-bf79-621a158d6e84 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.175070 Aug 25 14:27:36.064102 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3725/7369] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:35 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:27:36.088012 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "name": "network-vif-plugged", "status": "completed", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:36.099801 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:36.100346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:36.100845 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:36.113038 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] Creating event network-vif-plugged:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:27:36.118115 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-312ce6eb-503c-495a-8319-3309278c4e70 req-7a721df5-b7de-4875-a22b-ed1eb5203c43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090772 Aug 25 14:27:36.118880 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3645/7370] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:27:37.085248 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:37.085900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:37.087898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:37.094219 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:37.094712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:37.095158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:37.096548 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:37.097017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:37.097449 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:37.237855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:37.247465 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0888354c-fe4e-48c6-b8bc-1c2dd1ac4b1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1372 microversion: 2.1 time: 0.165924 Aug 25 14:27:37.249050 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3726/7371] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:37 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:38.272450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:38.273165 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:38.279340 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:38.279829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:38.280311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:38.281005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:38.281466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:38.281902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:38.416748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:38.425915 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d05e6de2-1b61-4c1a-a8b4-45082cffd6a1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1555 microversion: 2.1 time: 0.159172 Aug 25 14:27:38.426588 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3646/7372] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:38 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:38.451164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:27:38.451781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:27:38.453686 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=8 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:38.460631 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:38.461120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:38.461562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:38.462457 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:38.462724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:38.463183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:38.607905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:27:38.616860 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-fe143c7a-1e44-4d9a-8347-4a058d05271f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1555 microversion: 2.1 time: 0.169981 Aug 25 14:27:38.617433 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3727/7373] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:27:38 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:27:40.812898 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:27:40.867590 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:27:40.879102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:27:40.879706 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:27:40.880263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:27:40.892371 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] Creating event network-changed:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:27:40.897990 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-7a1683a6-5cb1-4cde-8ab4-3cb7a331d844 req-c5225ed5-9bc6-4e03-859d-09d0c21e921e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089593 Aug 25 14:27:40.898862 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3647/7374] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:29:34.927345 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:29:34.928271 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:29:34.929040 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:34.929827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=34 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:34.930950 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:29:34.931144 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd/action (ip 10.222.0.60) !!! Aug 25 14:29:34.936673 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:29:34.937213 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:34.947692 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:34.948197 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:34.948898 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:34.949596 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:34.950050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:34.950475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:34.974552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.objects.instance [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lazy-loading 'flavor' on Instance uuid b6723bf4-94ef-458e-9df9-96ee24723bcd {{(pid=122701) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:29:35.165551 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-48b38ddd-c815-4ec6-9e6c-cd410a3e3b60 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.239605 Aug 25 14:29:35.166033 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3728/7375] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:29:34 2022] POST /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:29:35.173793 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:29:35.174863 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:29:35.175689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:35.176272 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=28 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:29:35.177844 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:29:35.178026 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd (ip 10.222.0.60) !!! Aug 25 14:29:35.180771 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:29:35.180771 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd (ip 10.222.0.60) !!! Aug 25 14:29:35.187438 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:35.188367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:35.212052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:35.212581 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:35.213040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:35.213767 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:35.214256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:35.214681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:35.362385 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:35.370516 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c7cfaf50-a7b2-47b9-bfb9-178290ec38e9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.199717 Aug 25 14:29:35.371111 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3648/7376] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:35 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:36.397990 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:36.398707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:36.412496 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55796. Aug 25 14:29:36.414655 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:36.415142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:36.415920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:36.416329 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:36.416789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:36.417216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:36.417865 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55798. Aug 25 14:29:36.555429 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:36.563887 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d6bc4a10-6731-4e09-a671-bb1982bd6810 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.175437 Aug 25 14:29:36.565445 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3729/7377] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:36 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:37.586332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:37.586938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:37.601070 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:37.601567 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:37.602021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:37.602736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:37.603199 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:37.603640 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:37.612284 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55802. Aug 25 14:29:37.615335 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 55804. Aug 25 14:29:37.751231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:37.759909 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-210a0f67-3d49-4035-a21a-bc09d178c77b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.177969 Aug 25 14:29:37.760530 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3649/7378] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:37 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:38.781854 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:38.782487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:38.790348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:38.790838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:38.791283 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:38.791989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:38.792485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:38.792917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:38.943147 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:38.951571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6c367896-f764-41b9-a2dc-5c14ad3e9052 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.173624 Aug 25 14:29:38.952181 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3730/7379] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:38 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:39.974285 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:39.974916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:39.982321 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:39.982822 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:39.983263 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:39.983976 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:39.984472 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:39.984909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:40.146102 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:40.155051 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2be3cff7-87ec-4042-b644-75e2a0dbac29 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.184826 Aug 25 14:29:40.155642 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3650/7380] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:39 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:41.178028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:41.178712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:41.188544 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:41.189038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:41.189479 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:41.190306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:41.190769 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:41.191234 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:41.333005 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:41.341080 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4a9166ca-7b4d-4c73-b6d8-212ef15691cd tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.167932 Aug 25 14:29:41.341665 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3731/7381] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:41 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:42.363294 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:42.364313 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:42.370977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:42.371513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:42.371970 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:42.372724 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:42.373191 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:42.373628 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:42.513557 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:42.522710 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0886311d-c58d-44b9-9059-2fe90989089d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.163366 Aug 25 14:29:42.523333 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3651/7382] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:42 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:43.550123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:43.551969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:43.559100 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:43.559585 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:43.560019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:43.560741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:43.561223 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:43.561649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:43.705981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:43.716087 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c7226d15-5fc7-455f-a54d-c6c54d8d6f26 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.169795 Aug 25 14:29:43.716912 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3732/7383] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:43 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:44.740823 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:44.741513 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:44.750737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:44.751236 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:44.751687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:44.752434 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:44.752902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:44.753336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:44.890754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:44.899645 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0633d465-6d6d-4fe4-845e-f7c9eee2dda4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.163588 Aug 25 14:29:44.900260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3652/7384] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:44 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:45.921644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:45.922249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:45.929396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:45.929884 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:45.930328 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:45.931041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:45.931503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:45.931932 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:46.071930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:46.079987 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cc20978e-5492-4825-b4b9-13a91aada828 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1701 microversion: 2.1 time: 0.162279 Aug 25 14:29:46.080618 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3733/7385] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:45 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:47.102367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:47.102929 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:47.109905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:47.110398 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:47.110846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:47.111544 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:47.112137 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:47.112478 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:47.248762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:47.256722 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8d55393-6434-42ac-9f69-71ecc45c2e89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1701 microversion: 2.1 time: 0.158406 Aug 25 14:29:47.257310 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3653/7386] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:47 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:48.279983 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:48.281465 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:48.290336 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:48.291338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:48.291817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:48.292633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:48.293041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:48.293493 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:48.471050 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:48.491474 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-066778fd-9f51-4641-862c-e5fcb72f3de7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.215296 Aug 25 14:29:48.492575 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3734/7387] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:48 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:48.678650 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "name": "network-vif-plugged", "status": "completed", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:29:48.693699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:48.694630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:48.695453 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:48.718400 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] Creating event network-vif-plugged:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:29:48.729291 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-d5203ab7-bf13-4a63-8d8c-ae30fe80674b req-db12da26-8cb2-4657-81c7-ede4457ce69a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055714 Aug 25 14:29:48.730475 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3654/7388] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:29:49.516697 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:49.517310 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:49.525034 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:49.525823 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:49.526272 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:49.526989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:49.527454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:49.527956 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:49.711189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:49.725564 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e6260757-1a53-489e-bb71-7fdd1bf86938 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.213581 Aug 25 14:29:49.726918 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3735/7389] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:49 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:50.754377 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:50.755765 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:50.766578 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:50.767512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:50.768231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:50.769231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:50.769941 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:50.770708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:50.930668 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:50.941677 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ca965769-983e-4cf8-bd58-2e53fbbc79f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.193505 Aug 25 14:29:50.942756 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3655/7390] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:50 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:51.971255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:51.972615 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:51.979028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:51.979526 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:51.979966 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:51.980701 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:51.981158 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:51.981590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:52.151600 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:52.161571 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e4a5dadd-c0c1-45c2-b088-d518343e4e32 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.195544 Aug 25 14:29:52.162578 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3736/7391] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:51 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:53.190011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:53.190744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:53.199990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:53.200535 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:53.200998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:53.201740 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:53.202392 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:53.202843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:53.372964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:53.383506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-85cc3e59-2e08-41c5-a9b7-a483aabc2b34 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.198070 Aug 25 14:29:53.388623 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3656/7392] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:53 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:54.405797 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:54.407205 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:54.415815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:54.416788 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:54.417500 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:54.418314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:54.418859 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:54.419536 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:54.614209 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:54.623445 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ce9715ba-1c0e-4d90-98b6-dd4c9ef2701d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.221832 Aug 25 14:29:54.624337 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3737/7393] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:54 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:55.648917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:55.649852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:55.658081 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:55.658736 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:55.659253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:55.661086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:55.662017 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:55.662451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:55.845205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:55.855944 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7bc3ba1f-0fb3-4cde-9f2b-638633930d47 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.211939 Aug 25 14:29:55.856607 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3657/7394] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:55 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:56.879626 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:56.880534 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:56.887748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:56.888286 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:56.888763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:56.889469 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:56.889922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:56.890348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:57.024563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:57.032402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-04a11a2a-043d-4c7f-934f-2517ea1b9fcc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1696 microversion: 2.1 time: 0.157615 Aug 25 14:29:57.032987 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3738/7395] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:56 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:58.054288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:58.055020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:58.061960 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.062465 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.063129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.063737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:58.064324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:58.064688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:58.205817 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:58.213833 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-ddd027d5-1d23-463e-bb89-d0774d7f5a6d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1678 microversion: 2.1 time: 0.164248 Aug 25 14:29:58.214344 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3658/7396] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:58 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:29:59.235306 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:29:59.235922 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:29:59.244017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:59.244551 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:59.244992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:59.245832 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:29:59.246312 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:29:59.246744 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:29:59.391026 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:29:59.400168 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0adbcca5-5162-4a07-baad-b19de4fbe4b5 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1678 microversion: 2.1 time: 0.168749 Aug 25 14:29:59.400747 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3739/7397] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:29:59 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:00.421775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:00.422399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:00.433245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.433998 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.434543 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.435527 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.436346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.436926 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.585287 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:00.586693 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:30:00.594784 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-47b95cc4-f44b-4466-9648-f1c50fd0082a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1621 microversion: 2.1 time: 0.176758 Aug 25 14:30:00.595463 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3659/7398] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:00 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1621 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:00.604333 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.605211 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.605900 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.622415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:30:00.622670 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.compute.server_external_events [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] Unable to find a host for instance b6723bf4-94ef-458e-9df9-96ee24723bcd. Dropping event network-vif-unplugged {{(pid=122701) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 14:30:00.623067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:00.623402 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-47d10787-7c42-4a72-8815-89f94447312f req-97f0a134-aa73-4441-bb03-3e072b5c605b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043679 Aug 25 14:30:00.624573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3740/7399] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 14:30:00.631051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.631401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.631863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.632611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.633155 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.633509 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.795265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122700) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 14:30:00.881833 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e56a71ad-f174-4d4d-8064-e47bd1965298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.263260 Aug 25 14:30:00.882402 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3660/7400] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:30:00 2022] POST /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:30:00.890603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:00.891334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:00.900722 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.901293 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.902459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:00.903844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:00.904427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:00.904890 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:01.078459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:01.095878 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-19dc18dd-70d3-406f-81ee-4e57b27cc706 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1629 microversion: 2.1 time: 0.208756 Aug 25 14:30:01.097809 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3741/7401] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:00 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1629 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:02.125595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:02.126241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:02.133108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:02.133615 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:02.134068 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:02.134784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:02.135254 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:02.135695 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:02.277082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:02.285910 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e47d4cf-cf8a-40ba-bc01-185ffa722ad2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.167698 Aug 25 14:30:02.286492 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3661/7402] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:02 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:03.307393 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:03.308713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:03.316532 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:03.317302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:03.317917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:03.318872 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:03.319494 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:03.320082 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:03.555421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:03.564934 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-58da7a86-898c-4779-9a73-bdfe1885fb74 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.261361 Aug 25 14:30:03.565537 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3742/7403] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:03 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:04.596435 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:04.597657 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:04.604311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:04.604851 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:04.605308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:04.606036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:04.606777 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:04.607288 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:04.777085 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:04.786058 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78be33e8-8995-4ef8-98eb-435559b31208 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.202511 Aug 25 14:30:04.786669 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3662/7404] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:04 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:05.807786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:05.808517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:05.811288 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=31 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:05.817834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:05.818366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:05.818812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:05.819539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:05.820001 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:05.820463 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:05.823418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:06.342327 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:06.352450 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a146e4f5-fa4e-4284-8940-2e95b74be157 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.548895 Aug 25 14:30:06.357584 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3743/7405] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:05 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:07.374919 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:07.375658 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:07.382890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:07.384487 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:07.385082 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:07.385568 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:07.386356 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:07.386942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:07.387410 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:07.391041 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:30:07.555827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:07.564570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-178f495d-12ee-47c5-81a9-8889c39c5605 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.193772 Aug 25 14:30:07.565266 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3663/7406] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:07 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:08.590380 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:08.591980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:08.601679 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:08.602687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:08.603239 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:08.604066 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:08.604648 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:08.605194 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:08.771834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:08.783185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-91cddd3f-6b1a-4cb9-81d8-d93ed3297e6a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.198443 Aug 25 14:30:08.804775 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3744/7407] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:08 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:30:09.817029 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:09.819145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:09.844065 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:09.844984 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:09.845808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:09.847186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:09.848084 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:09.848977 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:10.033308 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:10.042874 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bba506c6-531f-4615-8c79-53a2df7effa7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.232883 Aug 25 14:30:10.056987 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3664/7408] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:09 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:11.065609 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:11.066782 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:11.074353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:11.075003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:11.076079 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:11.076669 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:11.077140 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:11.077730 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:11.226083 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:11.234085 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9f61a8c-3741-437f-86a1-d8ddec072246 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.172573 Aug 25 14:30:11.234667 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3745/7409] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:11 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:12.255769 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:12.256389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:12.263354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:12.263852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:12.264324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:12.265036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:12.265497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:12.265930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:12.404573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:12.413085 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4fbb6ed1-ce8d-40a2-8fc9-37ba2528b8e8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.161924 Aug 25 14:30:12.413663 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3665/7410] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:12 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:13.435098 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:13.435643 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:13.442618 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:13.443105 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:13.443552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:13.444291 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:13.444753 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:13.445187 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:13.584933 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:13.592774 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83da42f0-7ad5-42ad-875c-b9443c41b8cc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.161752 Aug 25 14:30:13.593370 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3746/7411] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:13 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:14.615441 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:14.616062 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:14.623040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:14.623541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:14.623993 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:14.624729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:14.625187 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:14.625621 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:14.773645 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:14.782050 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-427eb107-1572-4001-8ff5-6c4a185aaef3 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.171143 Aug 25 14:30:14.782696 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3666/7412] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:14 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:15.803914 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:15.804706 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:15.811748 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:15.812298 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:15.812746 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:15.813472 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:15.813930 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:15.814402 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:15.961152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:15.969035 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d111df86-9402-4570-aeb7-cebd53bd8d6e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.169724 Aug 25 14:30:15.969618 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3747/7413] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:15 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:16.747793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "name": "network-vif-plugged", "status": "completed", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:30:16.758360 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:16.758857 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:16.759298 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:16.771582 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] Creating event network-vif-plugged:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:30:16.781364 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-6fe75d8e-8980-4799-a5d4-a57b601471fd req-0bf2e270-e8fc-42f9-aced-59f8760c44ee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036965 Aug 25 14:30:16.782615 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3667/7414] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:30:16.991117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:16.991835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:16.998817 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:16.999386 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:16.999838 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:17.000573 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:17.001028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:17.001451 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:17.143610 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:17.152382 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-457bbb1e-c31a-4450-a601-5f56df3af690 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.165965 Aug 25 14:30:17.152967 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3748/7415] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:16 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:18.175057 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:18.181197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:18.187729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:18.188063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:18.188555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:18.189273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:18.189744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:18.190186 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:18.350252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:18.358441 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-64f1eb3f-25fb-4f4b-a8f1-04792cfc714a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1687 microversion: 2.1 time: 0.188516 Aug 25 14:30:18.359393 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3668/7416] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:18 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:30:19.381237 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:30:19.381862 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:30:19.388997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:19.389375 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:19.389840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:19.390530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:30:19.390993 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:30:19.391427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:30:19.527674 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:30:19.536689 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e2c57cbe-b187-4083-b6b8-d3b8c092c97a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1674 microversion: 2.1 time: 0.159548 Aug 25 14:30:19.537277 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3749/7417] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:30:19 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:29.958636 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=13 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:29.962534 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:29.963291 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:29.963634 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=41 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:29.965359 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:31:29.965573 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 14:31:29.967160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=11 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:29.968467 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=31 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:29.973022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:29.979639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:29.980793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:29.981428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:29.982160 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:29.982785 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:29.984302 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:29.991707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:29.992399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:29.992855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:30.006185 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] Creating event network-changed:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:31:30.012245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-760731a1-2350-4a08-b354-d6c37f9f0fe3 req-f6abb2b3-e8a8-49a1-a682-d90f744aeb9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054822 Aug 25 14:31:30.014623 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:31:30.016344 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3750/7418] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:31:30.121627 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b3e5282-9018-4ff3-9ee2-d70c4934ac22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 204 len: 0 microversion: 2.1 time: 0.167957 Aug 25 14:31:30.122577 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3669/7419] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:31:29 2022] DELETE /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 14:31:30.134420 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:30.135543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:30.143177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:30.143811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:30.144339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:30.145289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:30.146009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:30.146616 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:30.307162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:30.315872 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a6e8c0b2-c3f0-4757-ab1e-9c39e5623cbb tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.185940 Aug 25 14:31:30.316573 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3751/7420] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:30 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:31.338729 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:31.339450 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:31.347771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:31.348311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:31.348768 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:31.349516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:31.349949 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:31.350388 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:31.488786 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:31.496793 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5d78fdc9-dd67-4fcb-a03f-aff3da9679ed tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1680 microversion: 2.1 time: 0.162345 Aug 25 14:31:31.497425 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3670/7421] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:31 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:32.177037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6723bf4-94ef-458e-9df9-96ee24723bcd", "name": "network-vif-deleted", "tag": "e024c35e-72a3-4119-8339-9d1ee88b027b"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:32.187796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.188354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.188780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.200951 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] Creating event network-vif-deleted:e024c35e-72a3-4119-8339-9d1ee88b027b for instance b6723bf4-94ef-458e-9df9-96ee24723bcd on n-h2-850468-18 Aug 25 14:31:32.207333 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-ad6d9d89-574e-498a-8d4c-66d444ceea56 req-3752b74d-1917-4eee-ab2c-a1776f66faf3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096207 Aug 25 14:31:32.207946 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3752/7422] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:32.520916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:32.522242 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:32.531598 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.532597 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.533433 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.534756 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.535653 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.536511 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.582153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:32.582550 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:32.582996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:32.583466 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lazy-loading 'fault' on Instance uuid b6723bf4-94ef-458e-9df9-96ee24723bcd {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:31:32.629482 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:32.637014 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-aa3eb6a9-5b94-4569-b65c-cd19b1cbc6bf tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 200 len: 1336 microversion: 2.1 time: 0.120432 Aug 25 14:31:32.637657 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3671/7423] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:32 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:33.660979 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:33.661737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: b6723bf4-94ef-458e-9df9-96ee24723bcd] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:33.668225 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:33.668728 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:33.669174 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:33.669962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:33.670442 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:33.671388 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:33.685784 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] HTTP exception thrown: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Request method failure captured: Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd HTTP/1.1 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4bGBcnEtNJnnGe7QlQq-0Gp_wsKy8hR1PQR7_RokXzgx-d4MOXVdjHaA86LB6FKtktLQbByCFLPJvgZIJ1dNO03_GidZpIeAeSHe5rv8ZWB45bry48jkafdCYlCpk6RH_hFS2-ZpdinjYEkxU--3RsM313mFgVnhxTHAeCloFsjv9A Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: b3c3358e63964645b8eea1556d488d92 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestShelveInstance-914822136 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b3c3358e63964645b8eea1556d488d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestShelveInstance-914822136 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: b3c3358e63964645b8eea1556d488d92 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestShelveInstance-914822136 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestShelveInstance-914822136-project Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: e8771618bf9e47659aa49faec597a783 Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestShelveInstance-914822136-project Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': 'b6723bf4-94ef-458e-9df9-96ee24723bcd'} Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:31:33.687714 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Returning 404 to user: Instance b6723bf4-94ef-458e-9df9-96ee24723bcd could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ae66092a-78c3-44a6-8ff4-b4c15a7dc877 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd" status: 404 len: 111 microversion: 2.1 time: 0.033556 Aug 25 14:31:33.693404 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3753/7424] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:33 2022] GET /compute/v2.1/servers/b6723bf4-94ef-458e-9df9-96ee24723bcd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 14:31:33.893986 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c19f42c1-4ee8-4986-b4d1-883aaa90ba7f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '.version_select at 0x7fc6c060a1f0>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:33.926140 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c19f42c1-4ee8-4986-b4d1-883aaa90ba7f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1428835580" status: 202 len: 0 microversion: 2.1 time: 0.037235 Aug 25 14:31:33.927003 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3672/7425] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 14:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1428835580 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:31:33.946915 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-669d5599-4a6c-4e28-b474-037eff1f9fa1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'create', calling method: .version_select at 0x7fc6c1d5caf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1519564787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBIKSxpuD3EBo+sU5RTX+7yOOtK1BRMUYwTfzkZNzfDElV73cY9gDP+ihaX0JsX1Oh/O2ZQCkAq3FrLmt3SAasWTJ6CTDQei5IYUBW2NykSxF30aXvPEjm2cAGZ29IDlw=="}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:33.968025 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-669d5599-4a6c-4e28-b474-037eff1f9fa1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for project b3c3358e63964645b8eea1556d488d92. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:31:33.975163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-669d5599-4a6c-4e28-b474-037eff1f9fa1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for user e8771618bf9e47659aa49faec597a783 and project b3c3358e63964645b8eea1556d488d92. Resources: {'key_pairs'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:31:34.006052 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-669d5599-4a6c-4e28-b474-037eff1f9fa1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.063126 Aug 25 14:31:34.006677 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3754/7426] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:31:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:51.532384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:51.533190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:51.538228 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-725128193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1519564787", "security_groups": [{"name": "tempest-secgroup-smoke-1284748860"}], "networks": [{"uuid": "b3ee8bee-2675-4f6e-8e19-795bab2a38af"}], "block_device_mapping_v2": [{"uuid": "14da6483-b176-48cd-bdf7-da0468df7cd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:51.658666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] validate_networks() for [('b3ee8bee-2675-4f6e-8e19-795bab2a38af', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:31:52.072162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:31:52.072633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:31:52.073126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:31:52.073563 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:31:52.074021 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:31:52.086809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:52.087307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:52.087793 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:52.088574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:52.089052 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:52.089490 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:52.110376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for project b3c3358e63964645b8eea1556d488d92. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:31:52.115751 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Getting quotas for user e8771618bf9e47659aa49faec597a783 and project b3c3358e63964645b8eea1556d488d92. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:31:52.177008 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:31:52.179174 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14da6483-b176-48cd-bdf7-da0468df7cd9',volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:31:52.317903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7241f541-4883-4169-aea4-4e03374e28d0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788304 Aug 25 14:31:52.318793 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3673/7427] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:31:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 14:31:52.328590 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=12 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:52.329704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=4 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:52.330326 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:31:52.336387 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-35d320c4-47e4-44f1-b459-ba533b3ec3f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:52.337017 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-35d320c4-47e4-44f1-b459-ba533b3ec3f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:52.396249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-35d320c4-47e4-44f1-b459-ba533b3ec3f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:52.403959 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-35d320c4-47e4-44f1-b459-ba533b3ec3f1 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1088 microversion: 2.1 time: 0.077972 Aug 25 14:31:52.404569 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3755/7428] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:52 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:53.427420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6a9cd546-42b1-4cb7-9d4e-8bada753884d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:53.428201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6a9cd546-42b1-4cb7-9d4e-8bada753884d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:53.487849 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6a9cd546-42b1-4cb7-9d4e-8bada753884d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:53.495447 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6a9cd546-42b1-4cb7-9d4e-8bada753884d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1088 microversion: 2.1 time: 0.073563 Aug 25 14:31:53.496049 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3674/7429] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:53 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:31:54.517891 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:54.518540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:54.526238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:54.526729 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:54.527227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:54.527975 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:54.528454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:54.528880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:54.607905 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:54.616945 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0ffccc37-7331-41a4-9bae-6745f68190d4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1138 microversion: 2.1 time: 0.103899 Aug 25 14:31:54.617564 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3756/7430] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:54 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1138 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:55.638775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:55.639459 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:55.648394 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:55.648906 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:55.649364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:55.650355 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:55.650831 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:55.651271 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:55.735500 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:55.745849 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-92c136f7-12e7-4fa8-b3e4-276f13f75aa4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1204 microversion: 2.1 time: 0.110898 Aug 25 14:31:55.746352 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3675/7431] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:55 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:56.767236 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:56.767946 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:56.776012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:56.776620 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:56.777133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:56.778092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:56.778734 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:56.779331 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:57.024259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:57.034222 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-216f0cbc-0c8a-427b-ad80-4389ff77a998 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1272 microversion: 2.1 time: 0.271014 Aug 25 14:31:57.047807 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3757/7432] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:56 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:57.118564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:31:57.131157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:57.131664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:57.132146 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:57.145323 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] Creating event network-changed:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:31:57.151049 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-82365849-0910-4982-986f-5b1e4a7297fc req-e2d75ff4-b2db-41f5-9420-12d7629bba29 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036239 Aug 25 14:31:57.151848 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3676/7433] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:31:58.055189 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:58.055976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:58.063385 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:58.063880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:58.064349 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:58.065064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:58.065561 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:58.065996 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:58.274778 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:58.283538 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-71bca558-3e78-49c0-8684-792932370b89 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1272 microversion: 2.1 time: 0.232328 Aug 25 14:31:58.284218 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3758/7434] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:58 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:31:59.306080 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:31:59.306839 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:31:59.314565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:59.315164 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:59.315677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:59.316548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:31:59.317098 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:31:59.317649 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:31:59.517553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:31:59.526360 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2db951b7-682e-4196-9596-50ae5450de16 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1272 microversion: 2.1 time: 0.225800 Aug 25 14:31:59.527098 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3677/7435] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:31:59 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:00.555396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:00.556779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:00.567259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:00.567796 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:00.568563 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:00.569498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:00.570157 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:00.570889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:00.731486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:00.739948 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-462307c5-2b8e-4f13-991b-06a687770673 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1272 microversion: 2.1 time: 0.194169 Aug 25 14:32:00.740585 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3759/7436] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:00 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:01.761991 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:01.762617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:01.770451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:01.770890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:01.771339 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:01.772058 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:01.772555 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:01.772996 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:01.915714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:01.924955 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-075b5010-5393-4fa4-a751-88904719c7b7 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.167127 Aug 25 14:32:01.925539 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3678/7437] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:01 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:02.946490 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:02.947119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:02.949957 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:02.956949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:02.957400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:02.957850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:02.958566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:02.959019 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:02.959456 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:03.102913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:03.111245 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0c0c8aca-b9c0-4fe9-b1b7-aceb560e66a0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.168817 Aug 25 14:32:03.111828 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3760/7438] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:02 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:04.132332 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:04.133108 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:04.135399 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:04.137310 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=8 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:32:04.145403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:04.146073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:04.146631 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:04.147499 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:04.148007 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:04.148610 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:04.293879 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:04.302275 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f27773d2-3533-4e8b-8488-59f0e1b7cae6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.174119 Aug 25 14:32:04.302858 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3679/7439] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:04 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:05.322259 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:05.322815 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:05.331160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:05.331644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:05.332084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:05.332813 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:05.333265 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:05.333688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:05.467517 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:05.476741 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-895e1669-4681-414c-92d3-ea60a648d11f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.158468 Aug 25 14:32:05.477320 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3761/7440] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:05 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:06.498501 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:06.499221 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:06.506713 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:06.507216 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:06.507671 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:06.508422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:06.508889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:06.509918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:06.648574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:06.656745 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-118699ad-e6d8-4fb0-8f3c-f320c8f62d56 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.162101 Aug 25 14:32:06.657337 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3680/7441] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:06 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:07.677783 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:07.678398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:07.685322 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:07.685803 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:07.686240 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:07.686942 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:07.687962 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:07.688724 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:07.828156 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:07.836907 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a931c03e-e36f-4da5-aa8c-d82ceb296c38 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.163179 Aug 25 14:32:07.837488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3762/7442] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:07 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:08.857748 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:08.858364 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:08.866225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:08.866723 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:08.867162 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:08.867869 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:08.868378 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:08.868812 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:09.010911 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:09.020428 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8cf0778b-76b1-4eac-8096-5a5e95458e22 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.166728 Aug 25 14:32:09.021019 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3681/7443] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:08 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:10.042229 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:10.042773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:10.051022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:10.051805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:10.052427 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:10.053210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:10.053726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:10.054227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:10.200934 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:10.210243 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57031133-703a-4134-a2d7-531dfe7a3398 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.172030 Aug 25 14:32:10.210835 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3763/7444] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:10 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:11.208095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "name": "network-vif-plugged", "status": "completed", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:32:11.219718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:11.220546 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:11.220682 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:11.231152 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:11.231710 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:11.240152 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] Creating event network-vif-plugged:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:32:11.240400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:11.240400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:11.240400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:11.240895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:11.241545 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:11.242184 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:11.245978 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-8e86de8a-cb60-4db8-92f2-0ce4de0b70bd req-40977b94-2182-4f18-9c6e-79123b9511d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Aug 25 14:32:11.247429 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3682/7445] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:32:11.449377 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:11.458257 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-094132ec-63bf-4f3c-8c1d-e09a567d837e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.231054 Aug 25 14:32:11.458971 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3764/7446] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:11 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:12.480990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:12.481662 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:12.489049 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:12.489549 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:12.490003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:12.490714 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:12.491190 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:12.491666 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:12.658893 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:12.668096 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e3ef23b0-5b39-4776-bf05-fcc8455df0f0 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1260 microversion: 2.1 time: 0.191332 Aug 25 14:32:12.668758 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3683/7447] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:12 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:13.697179 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:13.697881 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:13.705398 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:13.705909 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:13.707149 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:13.707960 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:13.708455 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:13.708892 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:13.849308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:13.857440 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-83d9e2ee-d242-44fb-9abf-75e6d102e915 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1443 microversion: 2.1 time: 0.164355 Aug 25 14:32:13.858045 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3765/7448] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:13 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:13.877920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:32:13.879210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:32:13.886709 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:13.887246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:13.887701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:13.888474 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:13.888935 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:13.889367 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:14.026950 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:32:14.034945 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-9a6cbf78-02dd-4961-82d6-6c040163d84a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1443 microversion: 2.1 time: 0.160927 Aug 25 14:32:14.035499 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3684/7449] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:32:13 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:32:16.066290 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:32:16.077124 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:32:16.077613 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:32:16.078055 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:32:16.090459 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] Creating event network-changed:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:32:16.095576 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7227cf0f-9d2f-4cc2-8d57-374caad96e4a req-4f4b3e32-ac12-4513-a26c-04aa2db55be4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033569 Aug 25 14:32:16.096411 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3766/7450] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:34:11.704936 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:34:11.705858 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:34:11.706539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:11.707347 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=54 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:11.708906 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:34:11.709075 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661/action (ip 10.222.0.60) !!! Aug 25 14:34:11.793336 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:11.793900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:11.800776 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:11.801275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:11.801754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:11.802475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:11.802957 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:11.803390 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:11.831299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lazy-loading 'flavor' on Instance uuid 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:34:11.924603 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-56ea869e-5e97-4c34-a7c1-5aa743a82ce9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661/action" status: 202 len: 0 microversion: 2.1 time: 0.222637 Aug 25 14:34:11.925217 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3685/7451] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:34:11 2022] POST /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:34:11.932646 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:34:11.933490 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:34:11.934072 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=26 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:11.936941 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=62 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:11.939236 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:34:11.940249 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 (ip 10.222.0.60) !!! Aug 25 14:34:11.946161 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:11.947495 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:11.959853 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:11.960552 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:11.961097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:11.961924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:11.962475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:11.962981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:12.129675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:12.139326 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2f492dcf-3df3-4b52-af16-ea5373baeab8 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.208483 Aug 25 14:34:12.142570 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3767/7452] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:11 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:34:13.165916 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:13.166897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:13.180420 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:13.181196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:13.181876 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:13.182954 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:13.183600 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:13.184143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:13.190948 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56416. Aug 25 14:34:13.194496 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56414. Aug 25 14:34:13.357245 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:13.366941 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-51e52e56-0912-4fd9-ab4b-52966bcc32bc tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.208501 Aug 25 14:34:13.367539 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3686/7453] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:13 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:14.391540 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:14.392185 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:14.402907 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:14.403409 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:14.403855 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:14.405374 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:14.406144 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:14.406576 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:14.413661 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56422. Aug 25 14:34:14.417063 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56420. Aug 25 14:34:14.564802 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:14.573137 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7265a3cb-4850-42b3-afe1-57fac1b04817 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.186436 Aug 25 14:34:14.573734 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3768/7454] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:14 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:15.595868 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:15.596771 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:15.603937 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:15.604473 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:15.604931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:15.605661 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:15.606127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:15.606569 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:15.761728 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:15.773375 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b385c16a-cc51-49c6-97ce-2e40a6bf4205 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.181881 Aug 25 14:34:15.773980 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3687/7455] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:15 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:16.797295 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:16.797913 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:16.805840 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:16.806339 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:16.806781 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:16.807503 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:16.807958 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:16.808416 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:17.002480 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:17.012458 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e1c3ac6d-9770-4f90-9935-96d2a7de5f62 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.220055 Aug 25 14:34:17.013108 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3769/7456] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:16 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:34:18.037813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:18.038732 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:18.050172 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:18.051088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:18.051943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:18.053381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:18.054251 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:18.054789 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:18.231463 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:18.240322 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5cb14730-2acb-4726-ba24-38dbe69831a4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.207964 Aug 25 14:34:18.240933 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3688/7457] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:18 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:19.265821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:19.266435 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:19.274572 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:19.275042 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:19.275486 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:19.276302 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:19.276804 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:19.277227 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:19.428218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:19.443848 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-182bc69c-9a92-42a4-b57d-d40e80bea0a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.182496 Aug 25 14:34:19.444854 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3770/7458] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:19 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:20.474040 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:20.474987 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:20.482843 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:20.483409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:20.483915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:20.484858 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:20.485395 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:20.485886 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:20.651897 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:20.666397 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cce5c240-0bd8-4ecb-8fd2-c7197d6b55a6 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.196130 Aug 25 14:34:20.667460 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3689/7459] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:20 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:21.691394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:21.692064 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:21.699421 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:21.699921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:21.700404 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:21.701348 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:21.702210 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:21.702591 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:21.852289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:21.861139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-b5a72d9f-cab3-4b30-a2fa-3c74f3c69363 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.173854 Aug 25 14:34:21.861752 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3771/7460] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:21 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:22.883539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:22.883539 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:22.891574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:22.892088 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:22.892574 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:22.893304 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:22.893778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:22.894227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:23.035584 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:23.043625 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f3c04146-0503-4ad3-8642-f8a073388154 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.164186 Aug 25 14:34:23.044257 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3690/7461] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:22 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:24.065675 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:24.066285 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:24.073289 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:24.073776 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:24.074216 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:24.074954 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:24.075405 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:24.076384 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:24.225726 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:24.235658 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7dd919cd-95b5-4a4b-bc0d-183ba9d4c298 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.173912 Aug 25 14:34:24.236295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3772/7462] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:24 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:25.258401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:25.259095 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:25.266809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:25.267307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:25.267763 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:25.268512 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:25.268983 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:25.269426 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:25.408726 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:25.418346 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-83d3c26c-01d8-465d-8a03-b5528cc3f0de tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.163873 Aug 25 14:34:25.418943 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3691/7463] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:25 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:26.440394 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:26.441035 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:26.448400 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.448767 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.449180 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.449931 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.450378 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.450901 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.595586 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:26.603928 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-2ae21fa5-8043-4dbf-89f3-5723871f8779 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1508 microversion: 2.1 time: 0.168468 Aug 25 14:34:26.604560 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3773/7464] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:26 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:26.625894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:26.626604 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:26.633942 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.634451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.634933 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.635687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.636205 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.636630 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.675418 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122700) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 14:34:26.752681 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a248d8f9-7179-4a3f-b3e1-6c6ef7b8c7ca tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "POST /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661/action" status: 202 len: 0 microversion: 2.1 time: 0.131368 Aug 25 14:34:26.756890 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3692/7465] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:34:26 2022] POST /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:34:26.764142 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:26.765277 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:26.772639 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.773141 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.773607 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.774332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:26.774834 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:26.775273 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:26.937471 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:26.945889 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1333f3bd-d5dc-464a-b543-68aabfb1628e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1516 microversion: 2.1 time: 0.186635 Aug 25 14:34:26.946478 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3774/7466] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:26 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:27.969054 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:27.969920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:27.983279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:27.983805 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:27.984264 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:27.984997 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:27.985459 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:27.985904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:28.036865 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "name": "network-vif-unplugged", "status": "completed", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:28.054280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:28.054772 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:28.055219 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:28.076351 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.compute.server_external_events [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] Unable to find a host for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661. Dropping event network-vif-unplugged {{(pid=122700) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 14:34:28.078187 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-b1a08026-4353-4392-b287-fc5081408fbe req-fbd4d687-3c82-4d95-adab-ef12d1080f3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.151294 Aug 25 14:34:28.079699 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3693/7467] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 154 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 14:34:28.156094 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:28.164611 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-84a2fae0-6b5d-403f-8173-c736fbb22196 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1518 microversion: 2.1 time: 0.199696 Aug 25 14:34:28.165217 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3775/7468] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:27 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:29.187921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:29.188712 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:29.195835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:29.196241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:29.196770 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:29.197437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:29.197908 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:29.198383 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:29.348710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:29.357997 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-438130dc-9631-4d1e-8f0a-9406e01c8bfa tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1518 microversion: 2.1 time: 0.174810 Aug 25 14:34:29.358598 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3694/7469] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:29 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:30.379363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:30.380183 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:30.387438 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:30.388058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:30.389048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:30.389857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:30.390475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:30.390918 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:30.579597 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:30.588187 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a585b78e-e492-4225-a60c-4a4ba79a115e tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1518 microversion: 2.1 time: 0.212794 Aug 25 14:34:30.589251 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3776/7470] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:30 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:31.610778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:31.611416 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:31.619176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.619687 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.620167 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:31.620902 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:31.621376 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:31.621819 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:32.068796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:32.078345 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-8e6f5894-fb5e-4b0c-bcf2-50b4519b1ed9 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1518 microversion: 2.1 time: 0.471469 Aug 25 14:34:32.078946 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3695/7471] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:31 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1518 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:33.100467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:33.101221 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:33.110022 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:33.110425 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:33.110873 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:33.111594 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:33.112059 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:33.112519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:33.314829 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:33.324142 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-885bf408-c25b-4ac8-bd07-823a4110e986 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.227647 Aug 25 14:34:33.325067 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3777/7472] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:33 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:34.346564 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:34.347178 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:34.354573 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:34.355185 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:34.355526 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:34.356284 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:34.356755 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:34.358217 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:34.518901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:34.528145 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5111027b-8c6d-4d42-ad4e-f45771188689 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.186129 Aug 25 14:34:34.528918 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3696/7473] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:34 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:35.550920 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:35.551488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:35.558382 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:35.558864 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:35.559337 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:35.560045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:35.561120 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:35.561549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:35.703533 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:35.711437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-7eddb7af-e818-4b5b-ba0f-4e52e12f8898 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.164880 Aug 25 14:34:35.712027 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3778/7474] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:35 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:36.733575 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:36.734206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:36.741247 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:36.741744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:36.742196 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:36.742990 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:36.743460 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:36.743901 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:36.890475 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:36.898725 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b3861662-5ff5-4a0f-be48-488b769e7394 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.169416 Aug 25 14:34:36.899222 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3697/7475] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:36 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:37.921245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:37.921878 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:37.929045 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:37.929549 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:37.930000 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:37.930719 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:37.931214 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:37.931649 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:38.066685 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:38.074669 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-a3aa223f-6a40-4754-8453-c7ca4166954f tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.157974 Aug 25 14:34:38.075250 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3779/7476] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:37 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:39.099379 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:39.100047 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:39.107754 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:39.108229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:39.108689 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:39.109404 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:39.109880 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:39.110320 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:39.254054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:39.265747 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c20b85b0-ebb2-44ce-a65c-f093b540bd87 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.171978 Aug 25 14:34:39.266953 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3698/7477] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:39 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:40.287135 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:40.287738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:40.295681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:40.296195 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:40.296640 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:40.297341 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:40.297790 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:40.298218 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:40.434058 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:40.442867 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-c8f2e21b-5096-430f-a962-f08044a19391 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.159511 Aug 25 14:34:40.443393 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3780/7478] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:40 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:41.464528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:41.465183 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:41.473253 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:41.473762 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:41.474229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:41.474966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:41.475440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:41.475883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:41.480289 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:41.617784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:41.625938 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-cd817bc4-e2fe-4670-99d2-374aacfc5b49 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.165465 Aug 25 14:34:41.626502 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3699/7479] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:41 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:42.646757 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:42.647364 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:42.650145 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=29 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:42.655980 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:42.656539 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:42.657334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:42.657705 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:42.658162 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:42.658588 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:42.663204 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=85 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:42.805372 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:42.813751 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f97f849a-332e-4c26-93c5-5decc27c493c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.170791 Aug 25 14:34:42.814350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3781/7480] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:42 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:43.838451 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:43.839094 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:43.841151 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:34:43.847280 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:43.848675 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:43.849139 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:43.849867 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:43.850344 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:43.850846 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:43.995020 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:44.003903 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-d8e1d9b9-92a5-40b5-8a13-d3261555f22a tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.170833 Aug 25 14:34:44.004655 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3700/7481] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:43 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:44.119949 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "name": "network-vif-plugged", "status": "completed", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:34:44.132311 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:44.133191 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:44.133883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:44.149231 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] Creating event network-vif-plugged:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:34:44.156845 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-1f00955a-ca4e-41f9-8b32-829f3dd47ab6 req-cbb0444e-98d5-456f-9b53-13b5583bf6af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039178 Aug 25 14:34:44.157487 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3782/7482] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:34:45.024667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:45.025282 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:45.032905 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:45.033516 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:45.033855 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:45.034596 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:45.035063 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:45.035494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:45.178330 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:45.187822 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c60794eb-7ed5-46d1-9dfa-1e6b8aa20e52 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1574 microversion: 2.1 time: 0.166369 Aug 25 14:34:45.188451 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3701/7483] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:45 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:34:46.211977 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:34:46.212713 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:34:46.220346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:46.220841 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:46.221279 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:46.221989 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:34:46.222447 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:34:46.222924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:34:46.368939 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:34:46.377080 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-649b43c1-9c26-482b-a613-1c97d7c3c52b tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1561 microversion: 2.1 time: 0.169350 Aug 25 14:34:46.377661 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3783/7484] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:34:46 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:02.866275 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:02.867401 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=16 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:02.869522 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=5 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:02.871410 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=13 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:02.873384 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:02.873904 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:36:02.873904 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:36:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 14:36:02.874111 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:02.883158 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:02.884201 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:02.884752 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:02.885787 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:02.887402 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:02.888656 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:02.919647 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:36:02.946186 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:02.957481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:02.958251 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:02.958883 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:02.973021 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] Creating event network-changed:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:36:02.980670 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d4a4726b-b9ca-4884-a94c-cbd84348ab55 req-1ae3af9d-99d4-47e8-9002-8e5558f654b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113200 Aug 25 14:36:02.981616 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3784/7485] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:03.008405 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-5c1ee9d8-d2f6-464b-bb33-0cc4b38c6192 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 204 len: 0 microversion: 2.1 time: 0.144045 Aug 25 14:36:03.012187 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3702/7486] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:36:02 2022] DELETE /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:36:03.019524 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:03.020371 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:03.028691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:03.030984 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:03.031704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:03.033235 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:03.034047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:03.034353 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:03.173119 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:03.182522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-71f24324-4d6d-470d-a221-1620dd4363d2 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.167050 Aug 25 14:36:03.182666 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3785/7487] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:03 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:36:04.204533 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:04.205281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:04.214301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:04.214798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:04.215252 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:04.215964 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:04.216468 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:04.216900 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:04.434461 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:04.442931 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-74d8a5d5-09ca-4b18-826b-e9865326cb91 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1567 microversion: 2.1 time: 0.242761 Aug 25 14:36:04.444553 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3703/7488] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:04 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:05.111487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e926be8-fcd2-4c8b-a3eb-c80bb4925661", "name": "network-vif-deleted", "tag": "62c310b4-13d9-478d-ab96-196d06517e02"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:05.124163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:05.124762 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:05.125418 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:05.139042 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] Creating event network-vif-deleted:62c310b4-13d9-478d-ab96-196d06517e02 for instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 on n-h2-850468-18 Aug 25 14:36:05.144479 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-27fe2a4a-ac98-4f9a-801b-ae49ac83ee18 req-e86b77d5-f285-4a2b-a60b-b75567a5fad7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036620 Aug 25 14:36:05.145222 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3786/7489] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:36:05.468281 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:05.468920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:05.477924 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:05.478437 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:05.478895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:05.479633 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:05.480105 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:05.480862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:05.550676 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:05.565387 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7482aa18-e7dd-424e-9073-eb09b665899d tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1219 microversion: 2.1 time: 0.101397 Aug 25 14:36:05.566159 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3704/7490] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:05 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:36:06.591177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:06.591827 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:06.600564 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:06.601062 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:06.601502 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:06.602220 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:06.602682 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:06.603172 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:06.675439 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:06.684314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-32399f47-4cee-4783-9b04-722776290f67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1219 microversion: 2.1 time: 0.098428 Aug 25 14:36:06.684903 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3787/7491] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:06 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:07.706262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:07.706895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:07.713899 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:07.714406 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:07.714856 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:07.715576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:07.716051 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:07.716528 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:07.781005 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:07.789506 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-6e451ea1-8961-4c23-80f1-685581cf7b67 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1219 microversion: 2.1 time: 0.087398 Aug 25 14:36:07.790094 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3705/7492] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:07 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:08.810165 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:08.810712 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:08.817485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:08.817969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:08.819508 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:08.820255 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:08.820738 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:08.821166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:08.894780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8771618bf9e47659aa49faec597a783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c3358e63964645b8eea1556d488d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:08.903777 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-f110e2ad-8afe-4f9e-b2d4-c19ac8eb79e4 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 200 len: 1219 microversion: 2.1 time: 0.097621 Aug 25 14:36:08.904381 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3788/7493] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:08 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:09.924930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:09.925536 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] [instance: 5e926be8-fcd2-4c8b-a3eb-c80bb4925661] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:09.933141 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:09.933646 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:09.934086 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:09.934803 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:09.935262 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:09.935702 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:09.949819 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] HTTP exception thrown: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Request method failure captured: Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 HTTP/1.1 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4bGBcnEtNJnnGe7QlQq-0Gp_wsKy8hR1PQR7_RokXzgx-d4MOXVdjHaA86LB6FKtktLQbByCFLPJvgZIJ1dNO03_GidZpIeAeSHe5rv8ZWB45bry48jkafdCYlCpk6RH_hFS2-ZpdinjYEkxU--3RsM313mFgVnhxTHAeCloFsjv9A Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: b3c3358e63964645b8eea1556d488d92 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestShelveInstance-914822136 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b3c3358e63964645b8eea1556d488d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b3c3358e63964645b8eea1556d488d92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestShelveInstance-914822136 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: b3c3358e63964645b8eea1556d488d92 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestShelveInstance-914822136 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestShelveInstance-914822136-project Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: e8771618bf9e47659aa49faec597a783 Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestShelveInstance-914822136-project Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '5e926be8-fcd2-4c8b-a3eb-c80bb4925661'} Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:36:09.951606 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Returning 404 to user: Instance 5e926be8-fcd2-4c8b-a3eb-c80bb4925661 could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3d25fa3e-74ac-4e54-9f8e-5224a8ea7f1c tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661" status: 404 len: 111 microversion: 2.1 time: 0.032030 Aug 25 14:36:09.956778 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3706/7494] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:09 2022] GET /compute/v2.1/servers/5e926be8-fcd2-4c8b-a3eb-c80bb4925661 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:36:10.135992 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cac30c49-754c-4f75-a19c-0e7abea45338 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] Calling method '.version_select at 0x7fc6c42a75e0>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:10.185617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cac30c49-754c-4f75-a19c-0e7abea45338 tempest-TestShelveInstance-914822136 tempest-TestShelveInstance-914822136-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1519564787" status: 202 len: 0 microversion: 2.1 time: 0.053464 Aug 25 14:36:10.186229 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3789/7495] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 14:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1519564787 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 14:36:29.019407 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:29.020312 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:29.223338 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0b9d684b-b923-470b-9e39-274f133b7b81 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Action: 'create', calling method: .version_select at 0x7fc6c0655ee0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-293538351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpm4c8x7ulfG3nQl22e8H85Oc34WexoT2u9OY9iMnm0fpDxV2Vn+sub/KeLnAW+G1yJHXNHZEWltJDknMOgAWUe9JMptkpBSr2sz7TTvyoaPg/TSGcnyD+PFXRUWb+x2w=="}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:29.243153 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0b9d684b-b923-470b-9e39-274f133b7b81 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:36:29.249133 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-0b9d684b-b923-470b-9e39-274f133b7b81 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for user 40b697ecb23b4216837e20b11283ac07 and project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'key_pairs'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:36:29.281304 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0b9d684b-b923-470b-9e39-274f133b7b81 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.272958 Aug 25 14:36:29.281918 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3707/7496] 10.222.0.60 () {60 vars in 1159 bytes} [Thu Aug 25 14:36:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:30.370687 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=22 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:30.371521 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:30.376071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-542477372", "imageRef": "3f4244a5-c143-4666-878e-6ff8b102f5a5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-293538351", "security_groups": [{"name": "tempest-secgroup-smoke-30096414"}], "networks": [{"uuid": "2be28046-3fab-4a52-8a30-6f3adbae8ca2"}]}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:30.498795 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.network.neutron [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] validate_networks() for [('2be28046-3fab-4a52-8a30-6f3adbae8ca2', None, None, None, None, None)] {{(pid=122701) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:36:31.049354 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Flavor limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:36:31.049786 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Image limits 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:36:31.050440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Flavor pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:36:31.051036 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Image pref 0:0:0 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:36:31.051460 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.virt.hardware [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122701) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:36:31.062263 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:31.062816 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:31.063245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:31.063998 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:31.064488 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:31.064924 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:31.086448 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:36:31.092392 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.quota [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for user 40b697ecb23b4216837e20b11283ac07 and project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122701) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:36:31.106773 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Going to run 1 instances... {{(pid=122701) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:36:31.109123 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4244a5-c143-4666-878e-6ff8b102f5a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122701) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:36:31.160271 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-cb86c6b0-9dd0-486d-982f-12354f2c96f7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.791345 Aug 25 14:36:31.161188 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3790/7497] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:36:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:36:31.173471 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fa02775d-ecd8-4bed-871d-2ca05ce0001a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:31.174121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fa02775d-ecd8-4bed-871d-2ca05ce0001a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:31.234934 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fa02775d-ecd8-4bed-871d-2ca05ce0001a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:31.244945 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fa02775d-ecd8-4bed-871d-2ca05ce0001a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1247 microversion: 2.1 time: 0.076014 Aug 25 14:36:31.245573 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3708/7498] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:31 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:32.272207 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:32.273483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:32.284106 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:32.285201 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:32.286097 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:32.288003 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:32.289018 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:32.289581 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:32.372772 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:32.384002 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6271360a-0b00-4364-943b-5950f06ca365 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1317 microversion: 2.1 time: 0.117672 Aug 25 14:36:32.385076 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3791/7499] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:32 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1317 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:33.409678 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:33.410345 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:33.422775 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:33.423295 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:33.423943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:33.424704 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:33.425177 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:33.425616 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:33.640800 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:33.654621 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a9f2fc0f-7e92-4ce3-aa6e-8db25c28cc7c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.251005 Aug 25 14:36:33.655189 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3709/7500] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:33 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:34.199228 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:34.214833 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:34.215282 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:34.215723 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:34.229906 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] Creating event network-changed:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:36:34.235767 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-47c27aa5-6dcf-4704-a3f3-5432df7f1a54 req-78310988-bd5b-4eeb-b85e-305edd87d100 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041892 Aug 25 14:36:34.236439 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3792/7501] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:34.676883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:34.677583 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:34.685791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:34.686240 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:34.686699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:34.687428 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:34.687895 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:34.688989 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:34.829835 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:34.838922 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-7bdc73e7-e10e-4b78-b246-339dbca762cb tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.166246 Aug 25 14:36:34.839501 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3710/7502] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:34 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:35.861603 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:35.862334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:35.869965 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:35.870828 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:35.871278 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:35.872009 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:35.872496 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:35.872929 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:36.064048 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:36.072881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-eafd6101-4b0d-455b-8a85-dd8e0c19430b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.215770 Aug 25 14:36:36.073487 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3793/7503] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:35 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:37.094619 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:37.095246 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:37.103140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:37.103664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:37.104145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:37.104914 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:37.105374 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:37.105813 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:37.239766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:37.248580 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-808a1c97-1616-41fb-8ff7-660bc027f195 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.157890 Aug 25 14:36:37.249165 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3711/7504] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:37 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:38.269842 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:38.270470 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:38.277555 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:38.278047 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:38.278492 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:38.279198 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:38.279659 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:38.280092 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:38.424243 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:38.433139 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3f46146c-9275-4db5-81f2-4ac7c14b8bce tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.167186 Aug 25 14:36:38.433741 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3794/7505] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:38 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:39.455233 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:39.455806 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:39.463422 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:39.463920 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:39.464412 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:39.465121 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:39.465586 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:39.466028 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:39.602239 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:39.610177 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-fae129fb-2ef7-42df-b8c9-9f2c5882942d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.159219 Aug 25 14:36:39.610755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3712/7506] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:39 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:40.632343 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:40.632981 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:40.640835 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:40.641338 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:40.641799 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:40.642504 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:40.642969 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:40.643396 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:40.677588 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "name": "network-vif-plugged", "status": "completed", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:40.690341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:40.690940 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:40.691796 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:40.705165 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] Creating event network-vif-plugged:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:36:40.711573 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-60730124-b4f0-4d3d-ba15-72619f01f357 req-a9f771eb-09b0-425c-804c-479839bf8595 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037662 Aug 25 14:36:40.712484 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3713/7507] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:36:40.802485 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:40.811719 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-3d6a81e1-484a-4e68-b831-7474f4269499 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.183797 Aug 25 14:36:40.812989 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3795/7508] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:40 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:41.834488 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:41.839520 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:41.840278 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:41.847170 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:41.847690 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:41.848173 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:41.848915 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:41.849387 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:41.850342 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:42.010415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:42.021347 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-b949ec5c-a546-4171-bcaa-9962fe395217 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1371 microversion: 2.1 time: 0.187778 Aug 25 14:36:42.022699 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3714/7509] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:41 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:43.042976 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:43.043642 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:43.045671 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.046334 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=6 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:36:43.054530 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.055038 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.055481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.056238 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.056704 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.057138 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.214644 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:43.228096 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-68f0f235-4951-479d-8957-3d13efdcaf5f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1556 microversion: 2.1 time: 0.188813 Aug 25 14:36:43.228819 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3796/7510] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:43 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:43.250840 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:36:43.251558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:36:43.261145 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.261918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.262617 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.263764 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:43.264582 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:43.265319 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:43.424743 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:36:43.433283 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bdc00614-0e84-4ed2-b4d0-6b42c4dfe9fe tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1556 microversion: 2.1 time: 0.186816 Aug 25 14:36:43.433903 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3715/7511] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:36:43 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:36:45.796433 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:36:45.812474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:36:45.812968 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:36:45.813780 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:36:45.827310 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] Creating event network-changed:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:36:45.833053 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-7dcbde58-fad2-4124-9312-a8d981cd3749 req-9b09ace1-bba6-4d53-9c1e-736947244fdf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142830 Aug 25 14:36:45.833681 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3797/7512] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:41.346898 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:38:41.347802 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 14:38:41.348701 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:41.349548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=38 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:41.350743 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:38:41.350957 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e/action (ip 10.222.0.60) !!! Aug 25 14:38:41.363648 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2073985061"}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:41.366096 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:41.375107 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:41.375612 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:41.376069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:41.376829 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:41.377301 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:41.377737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:41.842809 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-3b09f23b-ed28-4dbf-bad9-1dd85fd31d9d tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "POST /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e/action" status: 202 len: 0 microversion: 2.1 time: 0.498009 Aug 25 14:38:41.843489 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3716/7513] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:38:41 2022] POST /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 25 14:38:47.348057 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:38:47.350171 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:38:47.350995 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:47.352547 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=36 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:47.355868 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:38:47.356607 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 14:38:47.359425 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 14:38:47.359618 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 14:38:47.389566 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "name": "network-vif-plugged", "status": "completed", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:47.408173 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:47.409506 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:47.411598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:47.433785 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] Creating event network-vif-plugged:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:38:47.443881 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-9513c23b-2dc0-431e-b967-dd99737898d9 req-3dbdbfe0-ce1b-4570-a1ec-65eb3c870880 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097326 Aug 25 14:38:47.445402 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3798/7514] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:55.519015 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:55.520197 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:55.526314 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1188150462", "imageRef": "4670da81-ad20-41a3-aafa-b202176986e8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-293538351", "security_groups": [{"name": "tempest-secgroup-smoke-30096414"}], "networks": [{"uuid": "2be28046-3fab-4a52-8a30-6f3adbae8ca2"}]}} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:55.553446 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56958. Aug 25 14:38:55.553841 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56956. Aug 25 14:38:55.648966 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.network.neutron [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] validate_networks() for [('2be28046-3fab-4a52-8a30-6f3adbae8ca2', None, None, None, None, None)] {{(pid=122700) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 14:38:56.128299 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Flavor limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 14:38:56.129054 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Image limits 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 14:38:56.129229 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Flavor pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 14:38:56.129664 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Image pref 0:0:0 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 14:38:56.130119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.virt.hardware [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122700) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 14:38:56.142206 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:56.142705 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:56.143225 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:56.143932 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:56.144448 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:56.145227 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:56.175917 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 14:38:56.182562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.quota [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Getting quotas for user 40b697ecb23b4216837e20b11283ac07 and project 7a60a6b7e62349ab98ce1ee5d04d15e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122700) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 14:38:56.196784 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Going to run 1 instances... {{(pid=122700) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 14:38:56.199357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4670da81-ad20-41a3-aafa-b202176986e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122700) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 14:38:56.251778 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-4538c4eb-9d65-4868-9658-08f3f49b20f4 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.734994 Aug 25 14:38:56.252485 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3717/7515] 10.222.0.60 () {60 vars in 1147 bytes} [Thu Aug 25 14:38:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 14:38:56.265440 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-e12f8241-0346-4e9f-acfd-53a9bc64c407 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:56.266519 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-e12f8241-0346-4e9f-acfd-53a9bc64c407 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:56.281912 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [43c04007-9232-434f-9045-a2009b3ad226] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56976. Aug 25 14:38:56.284158 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] [9f3740c4-969f-4e57-8429-d4bf7687acea] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56974. Aug 25 14:38:56.407789 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-e12f8241-0346-4e9f-acfd-53a9bc64c407 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:56.416522 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-e12f8241-0346-4e9f-acfd-53a9bc64c407 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1248 microversion: 2.1 time: 0.155067 Aug 25 14:38:56.417116 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3799/7516] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:56 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1248 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:57.438809 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:57.439681 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:57.448078 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.448639 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.449129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.449883 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:57.450357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:57.450798 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:57.528346 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:57.536427 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-be284ffd-1fb5-4301-b2d4-b9a90e0c6dae tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1318 microversion: 2.1 time: 0.102438 Aug 25 14:38:57.537028 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3718/7517] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:57 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:58.559657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:58.560681 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:58.564876 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:38:58.576792 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:58.577342 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:58.577851 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:58.579084 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:58.580246 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:58.580571 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:58.821894 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:38:58.831570 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-95b600a8-270f-46c0-a92d-53d7d4af42d1 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.277141 Aug 25 14:38:58.832484 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3800/7518] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:58 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:38:59.273663 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "name": "network-vif-unplugged", "status": "completed", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:38:59.290948 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:59.291469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:59.292259 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:59.305782 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] Creating event network-vif-unplugged:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:38:59.332226 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-1b48e9cc-2954-4e66-a7d5-b61436920783 req-47bcf2f1-0ed7-4fe9-9420-da28a5f9f6d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045026 Aug 25 14:38:59.332951 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3719/7519] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:38:59.853887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:38:59.854589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:38:59.862231 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:59.862766 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:59.863217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:38:59.863943 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:38:59.864751 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:38:59.864888 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:00.049114 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:00.061817 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-5acb4211-0eca-475e-90fc-6aa9d507afbc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.211907 Aug 25 14:39:00.063683 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3801/7520] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:38:59 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:01.091891 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:01.093670 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:01.101120 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:01.102524 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:01.103454 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:01.104403 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:01.105591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:01.106497 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:01.299862 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:01.310827 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-f90d64c9-8665-4dc8-bf92-b32b1e97208f tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.224695 Aug 25 14:39:01.311813 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3720/7521] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:01 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:39:02.332809 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:02.333368 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:02.340441 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:02.340936 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:02.341474 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:02.342217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:02.342688 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:02.343177 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:02.495475 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:02.503268 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d3f5d07a-783d-482f-a4a0-7720b9b710e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.174786 Aug 25 14:39:02.503865 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3802/7522] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:02 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:03.524808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:03.525694 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:03.534073 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:03.534925 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:03.535447 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:03.536273 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:03.537092 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:03.537595 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:03.688069 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:03.695895 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-36c19936-e089-4bb4-b3f9-bc51771c44d9 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.175688 Aug 25 14:39:03.697220 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3721/7523] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:03 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:04.717577 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:04.718307 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:04.725399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:04.725887 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:04.726663 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:04.727870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:04.728863 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:04.729330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:04.890487 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:04.901314 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4285f988-cb0d-4336-b75b-963b24d6d42e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.187461 Aug 25 14:39:04.917830 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3803/7524] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:04 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:05.926492 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:05.927127 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:05.934791 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:05.935659 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:05.936140 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:05.937076 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:05.937553 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:05.938003 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:06.113761 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:06.122505 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-1edf2428-4853-49f0-88e2-32533ef7550b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.200320 Aug 25 14:39:06.123091 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3722/7525] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:05 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:07.146383 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:07.147012 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:07.149657 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell0:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:39:07.155800 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:07.156332 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:07.156779 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:07.157483 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:07.157938 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:07.158361 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:07.299845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:07.308690 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-513d877b-c276-41a3-9a54-9580afcec8e0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.166162 Aug 25 14:39:07.309286 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3804/7526] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:07 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:08.329894 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:08.330881 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:08.332918 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:39:08.333611 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell0:SELECT=6 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:39:08.343607 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:08.344093 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:08.344626 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:08.345423 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:08.345890 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:08.346325 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:08.485548 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:08.493673 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-0f26a603-7b22-46ff-ae4f-56f7b365a2be tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.167944 Aug 25 14:39:08.494261 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3723/7527] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:08 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:09.514741 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:09.515346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:09.523304 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:09.523811 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:09.524294 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:09.526217 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:09.527014 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:09.527454 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:09.636708 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:39:09.649847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:09.650354 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:09.651620 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:09.664648 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] Creating event network-changed:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:39:09.670570 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-e8fd6d15-60d1-4211-8ecc-ec353c653b18 req-85b3892d-064b-41df-a0f3-fd5417bf5ea1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039678 Aug 25 14:39:09.671206 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3724/7528] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:39:09.795967 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:09.804942 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-310a66fb-992e-4b05-90f7-f956a47c638e tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.294026 Aug 25 14:39:09.805533 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3805/7529] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:09 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:10.828324 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:10.829045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:10.835541 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:10.836036 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:10.836510 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:10.837211 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:10.837677 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:10.838495 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:10.974863 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:10.983652 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-78a0c708-631a-4a05-9619-4084e940db79 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.160711 Aug 25 14:39:10.984268 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3725/7530] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:10 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:12.004595 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:12.005166 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:12.013133 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:12.013633 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:12.014071 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:12.014822 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:12.015347 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:12.015821 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:12.150300 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:12.158974 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-0da857bb-2eb9-4420-8854-7f1a1cc04f76 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.158316 Aug 25 14:39:12.159552 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3806/7531] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:11 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:13.180938 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:13.183409 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:13.191896 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:13.192700 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:13.193440 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:13.194203 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:13.194683 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:13.195129 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:13.341959 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:13.351296 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-c86a65bc-a427-4505-814c-04bb45529a00 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.174234 Aug 25 14:39:13.352706 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3726/7532] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:13 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:14.373824 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:14.374560 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:14.381406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:14.381895 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:14.382335 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:14.383041 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:14.383498 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:14.383917 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:14.519623 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:14.528437 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-4c028e5f-89b2-464e-991d-b61aad1f112b tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.158968 Aug 25 14:39:14.529026 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3807/7533] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:14 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:15.550044 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:15.550634 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:15.557852 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:15.558371 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:15.559059 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:15.559565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:15.560045 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:15.560521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:15.703311 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:15.711369 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-2636612f-8752-43e8-994f-da3794fbcfc0 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.165346 Aug 25 14:39:15.711954 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3727/7534] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:15 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:16.392021 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "name": "network-vif-plugged", "status": "completed", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:39:16.403707 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:16.404445 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:16.404889 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:16.416436 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] Creating event network-vif-plugged:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:39:16.422443 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-d9ddb334-6160-48b3-a3e1-31933bde6ee7 req-3187a0c9-0df9-43d6-833a-24e46dfe530e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Aug 25 14:39:16.423295 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3808/7535] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:39:16.734143 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:16.734716 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:16.741341 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:16.741844 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:16.742297 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:16.743011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:16.743480 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:16.743921 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:16.890665 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:16.898769 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a4798d01-639e-426f-9d4f-5cef6515069a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.169857 Aug 25 14:39:16.899388 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3728/7536] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:16 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 14:39:17.924528 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:17.925763 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:17.928906 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=25 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:39:17.937366 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:17.937807 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:17.938262 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:17.938986 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:17.939446 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:17.939870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:18.102308 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:18.112511 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-ee9aacdb-3ec8-4a4b-ad78-36508aba2001 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1372 microversion: 2.1 time: 0.195776 Aug 25 14:39:18.113555 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3809/7537] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:17 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:19.135241 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:19.135930 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:19.143565 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:19.144067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:19.144551 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:19.145257 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:19.145719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:19.146157 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:19.279365 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:19.287245 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-179ab224-2aa1-4392-bb77-4c1c4ed042c7 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1557 microversion: 2.1 time: 0.155985 Aug 25 14:39:19.287827 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3729/7538] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:19 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:19.307543 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:39:19.308771 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:39:19.316233 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:19.316720 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:19.317160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:19.317860 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:19.318316 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:19.318737 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:19.803037 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:39:19.811606 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d9bf81b4-2439-4d50-9d56-e7a236e125a8 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1557 microversion: 2.1 time: 0.508046 Aug 25 14:39:19.812208 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3810/7539] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:39:19 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1557 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:39:21.478909 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:39:21.490130 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:39:21.490651 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:39:21.491103 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:39:21.502885 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] Creating event network-changed:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:39:21.508139 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-788efe34-ba45-4645-b5f1-52236cd589fe req-824f0de5-c436-4143-ade3-cbc6b1a7e2ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033030 Aug 25 14:39:21.508755 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3730/7540] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:24.530069 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=3 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:24.530793 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=62 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:24.532442 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:41:24.532620 n-d-850468-18 devstack@n-api.service[122701]: Thu Aug 25 14:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9/action (ip 10.222.0.60) !!! Aug 25 14:41:24.539360 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1678098473"}} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:24.541708 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:24.549852 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:24.550330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:24.550768 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:24.551467 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:24.551921 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:24.552373 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:24.757959 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-57e0f970-f306-49cc-9f09-eea8f51f6bd3 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "POST /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9/action" status: 202 len: 0 microversion: 2.1 time: 0.229508 Aug 25 14:41:24.758625 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3811/7541] 10.222.0.60 () {60 vars in 1278 bytes} [Thu Aug 25 14:41:24 2022] POST /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 25 14:41:31.000588 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 14:41:31.002763 n-d-850468-18 devstack@n-api.service[122700]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 14:41:31.003864 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:31.005808 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=68 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:31.008662 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 14:41:31.008831 n-d-850468-18 devstack@n-api.service[122700]: Thu Aug 25 14:41:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 25 14:41:31.102479 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "name": "network-vif-plugged", "status": "completed", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:31.112576 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:31.113071 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:31.113521 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:31.125878 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] Creating event network-vif-plugged:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:41:31.132364 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-82e532ef-7324-4487-8a68-f853016b61f5 req-5d6113ea-426f-41f2-8d6b-d6dd954e5308 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135629 Aug 25 14:41:31.132987 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3731/7542] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:44.064940 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_api:SELECT=2 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:44.066399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG dbcounter [-] [122701] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:44.072844 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:44.073399 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:44.074099 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:44.081562 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.082589 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.084889 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_api:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:44.085117 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.085730 n-d-850468-18 devstack@n-api.service[122700]: DEBUG dbcounter [-] [122700] Writing DB stats nova_cell1:SELECT=2 {{(pid=122700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 14:41:44.086653 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.087381 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.087591 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.088222 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.088357 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.088766 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.103464 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.compute.server_external_events [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] Creating event network-changed:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:41:44.110801 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [req-ee1bfb54-3f32-45b1-8a54-d9a6d81a2e25 req-ac829ad6-3c43-464d-b685-b800b821d709 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041715 Aug 25 14:41:44.111691 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3732/7543] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 14:41:44.128163 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Going to try to terminate instance {{(pid=122701) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:41:44.223144 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-bf1a47f3-ad39-4776-9286-257613c6c087 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "DELETE /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 204 len: 0 microversion: 2.1 time: 0.160865 Aug 25 14:41:44.224641 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3812/7544] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:41:44 2022] DELETE /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:41:44.235011 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:44.236210 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:44.244885 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.245719 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.246361 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.247224 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:44.247699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:44.248161 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:44.256321 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f21b464-0649-453e-91d6-20f97a686535] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57312. Aug 25 14:41:44.256321 n-d-850468-18 devstack@n-api.service[122700]: INFO oslo.messaging._drivers.impl_rabbit [-] [a1ba161d-34e7-431f-9832-db5fa0d0be1a] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57314. Aug 25 14:41:44.426079 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:44.434806 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-367dcf8b-54b0-4bac-8dfc-fce0aec55966 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1682 microversion: 2.1 time: 0.205512 Aug 25 14:41:44.435399 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3733/7545] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:44 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:45.008028 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "name": "network-vif-unplugged", "status": "completed", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:45.018928 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:45.019592 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:45.019857 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:45.034302 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] Creating event network-vif-unplugged:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:41:45.040707 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-88c01cb5-32f6-4739-b973-ef01ad4d59e6 req-59dac07e-cc6b-4e59-9822-cc4719f7a8d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038229 Aug 25 14:41:45.041488 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3813/7546] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:45.458693 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:45.459558 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:45.465951 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:45.466469 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:45.466931 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:45.467667 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:45.468176 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:45.468718 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:45.695660 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:45.704039 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-bd22a556-da42-4f9a-a9fb-d3f7f44ea6fc tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1682 microversion: 2.1 time: 0.251112 Aug 25 14:41:45.704675 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3734/7547] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:45 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:46.592363 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141f93a3-709e-43ca-ba2e-116363dd0ae9", "name": "network-vif-deleted", "tag": "9d7fb558-d164-44c7-9442-78759d591044"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:46.604691 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.605175 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.605621 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.618624 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] Creating event network-vif-deleted:9d7fb558-d164-44c7-9442-78759d591044 for instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 on n-h1-850468-18 Aug 25 14:41:46.623963 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-8ce7c894-ac4e-41fa-90cb-7d348a38e49c req-2fd0fec0-7da1-46fd-839b-3268c7340553 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096670 Aug 25 14:41:46.624628 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3814/7548] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:46.728091 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:46.728688 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:46.735737 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.736202 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.736655 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.737476 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.737943 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.738417 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.779256 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:46.779753 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:46.780231 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:46.780699 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.objects.instance [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lazy-loading 'fault' on Instance uuid 141f93a3-709e-43ca-ba2e-116363dd0ae9 {{(pid=122700) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 14:41:46.825400 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:46.834189 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e80b34b5-9ee5-4c5d-9c78-28838f2affd2 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 200 len: 1338 microversion: 2.1 time: 0.110801 Aug 25 14:41:46.834804 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3735/7549] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:46 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:47.856129 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:47.856845 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 141f93a3-709e-43ca-ba2e-116363dd0ae9] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:47.864249 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:47.865346 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:47.865699 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:47.866415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:47.866880 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:47.867314 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:47.882170 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.wsgi [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] HTTP exception thrown: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Request method failure captured: Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: request: GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 HTTP/1.1 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Accept: application/json Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Accept-Encoding: identity Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Connection: close Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Content-Length: 0 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Content-Type: application/json Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Host: 10.222.0.60 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: Openstack-System-Scope: None Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: User-Agent: python-urllib3/1.26.11 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Auth-Token: gAAAAABjB4jn22qFsr_GwuJ5IQDImY3Jp1r3JoMY0WBIPmhIadR8-WzsJL1dgrsSBV6fXFc-y5G7IDMUsbfoJkkdFSpZztET4cdbOarmkit028L0-eypKW0NuxXhkXnzKu_D5uPAQiGARMlwiH-6w1-JFq0SJpzWheAR4Sad-Q1lTCmStqDK6ms Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Id: None Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Domain-Name: None Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Identity-Status: Confirmed Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Is-Admin-Project: True Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Id: default Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Domain-Name: Default Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Id: 7a60a6b7e62349ab98ce1ee5d04d15e5 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Project-Name: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Role: reader,member Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Roles: reader,member Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Id: 7a60a6b7e62349ab98ce1ee5d04d15e5 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-Tenant-Name: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-User: tempest-TestSnapshotPattern-1152245302-project Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Id: default Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Domain-Name: Default Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Id: 40b697ecb23b4216837e20b11283ac07 Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: X-User-Name: tempest-TestSnapshotPattern-1152245302-project Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: method: > Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: exception: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: action_args: {'id': '141f93a3-709e-43ca-ba2e-116363dd0ae9'} Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:41:47.886250 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: ERROR nova.api.openstack.wsgi Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Returning 404 to user: Instance 141f93a3-709e-43ca-ba2e-116363dd0ae9 could not be found. {{(pid=122701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-d309214a-f0a8-4b6f-b569-8d900b8348e5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9" status: 404 len: 111 microversion: 2.1 time: 0.033736 Aug 25 14:41:47.892164 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3815/7550] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:47 2022] GET /compute/v2.1/servers/141f93a3-709e-43ca-ba2e-116363dd0ae9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:41:49.441119 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:49.442075 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:49.456067 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.457710 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.458780 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.459562 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.460307 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.461381 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.499783 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Going to try to terminate instance {{(pid=122700) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 14:41:49.507070 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:49.518362 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.518850 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.519505 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.535444 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] Creating event network-changed:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:41:49.541475 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-29c3969a-a976-4292-8ee6-76a4841245ef req-684143f0-854a-4114-b31d-a06b7e32d7c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102218 Aug 25 14:41:49.542131 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3816/7551] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:49.612707 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a53bc639-731d-4873-8d00-8f36c02822d5 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 204 len: 0 microversion: 2.1 time: 0.178719 Aug 25 14:41:49.613555 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3736/7552] 10.222.0.60 () {58 vars in 1239 bytes} [Thu Aug 25 14:41:49 2022] DELETE /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 14:41:49.629406 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:49.632245 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.compute.api [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122701) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:49.643330 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.644481 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.645904 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.647160 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:49.648422 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:49.649415 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:49.859870 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.policy [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122701) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:49.872641 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-6677e34f-365a-444f-b4a8-e0d307a2da4c tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1681 microversion: 2.1 time: 0.252948 Aug 25 14:41:49.873584 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3817/7553] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:49 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:50.900265 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:50.902389 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:50.908847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:50.908847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:50.908847 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:50.909363 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:50.909836 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:50.910283 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:51.012223 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.policy [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40b697ecb23b4216837e20b11283ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a60a6b7e62349ab98ce1ee5d04d15e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122700) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 14:41:51.023014 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-e4c21d63-d940-4e2d-9f56-fbaf2b63cd22 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 200 len: 1496 microversion: 2.1 time: 0.128752 Aug 25 14:41:51.023962 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3737/7554] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:50 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 1496 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 14:41:51.561065 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc8762b-df7f-4751-89f0-d5ef78f6e03e", "name": "network-vif-deleted", "tag": "121fddd9-0888-4059-a257-7bc663ad75f4"}]} {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 14:41:51.574125 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:51.574812 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:51.575598 n-d-850468-18 devstack@n-api.service[122701]: DEBUG oslo_concurrency.lockutils [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:51.591101 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.compute.server_external_events [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] Creating event network-vif-deleted:121fddd9-0888-4059-a257-7bc663ad75f4 for instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e on n-h2-850468-18 Aug 25 14:41:51.596731 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [req-f31951cb-6230-47d0-8776-e61a03549f69 req-17d37467-1c4d-4e12-acfe-e899d2667992 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039499 Aug 25 14:41:51.597350 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3818/7555] 10.222.0.60 () {64 vars in 1317 bytes} [Thu Aug 25 14:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 14:41:52.046744 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '>' {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:52.047415 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.compute.api [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [instance: 2cc8762b-df7f-4751-89f0-d5ef78f6e03e] Fetching instance by UUID {{(pid=122700) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 14:41:52.055827 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:52.056494 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:52.057126 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:52.057922 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Acquiring lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 14:41:52.058413 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 14:41:52.058873 n-d-850468-18 devstack@n-api.service[122700]: DEBUG oslo_concurrency.lockutils [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Lock "caa1cbfc-061c-405c-b05c-317f7d63a7f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 14:41:52.075320 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.wsgi [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] HTTP exception thrown: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Request method failure captured: Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: request: GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e HTTP/1.1 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Accept: application/json Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Accept-Encoding: identity Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Connection: close Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Content-Length: 0 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Content-Type: application/json Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Host: 10.222.0.60 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: Openstack-System-Scope: None Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: User-Agent: python-urllib3/1.26.11 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Auth-Token: gAAAAABjB4jn22qFsr_GwuJ5IQDImY3Jp1r3JoMY0WBIPmhIadR8-WzsJL1dgrsSBV6fXFc-y5G7IDMUsbfoJkkdFSpZztET4cdbOarmkit028L0-eypKW0NuxXhkXnzKu_D5uPAQiGARMlwiH-6w1-JFq0SJpzWheAR4Sad-Q1lTCmStqDK6ms Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Id: None Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Domain-Name: None Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Identity-Status: Confirmed Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Is-Admin-Project: True Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Id: default Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Domain-Name: Default Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Id: 7a60a6b7e62349ab98ce1ee5d04d15e5 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Project-Name: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Role: reader,member Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Roles: reader,member Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7a60a6b7e62349ab98ce1ee5d04d15e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Id: 7a60a6b7e62349ab98ce1ee5d04d15e5 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-Tenant-Name: tempest-TestSnapshotPattern-1152245302 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-User: tempest-TestSnapshotPattern-1152245302-project Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Id: default Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-User-Domain-Name: Default Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-User-Id: 40b697ecb23b4216837e20b11283ac07 Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: X-User-Name: tempest-TestSnapshotPattern-1152245302-project Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: method: > Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: exception: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: action_args: {'id': '2cc8762b-df7f-4751-89f0-d5ef78f6e03e'} Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: {{(pid=122700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 14:41:52.077125 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: ERROR nova.api.openstack.wsgi Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: DEBUG nova.api.openstack.wsgi [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Returning 404 to user: Instance 2cc8762b-df7f-4751-89f0-d5ef78f6e03e could not be found. {{(pid=122700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: INFO nova.api.openstack.requestlog [None req-a8ef7fc8-f944-45ad-96cc-c5b06e961a2a tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e" status: 404 len: 111 microversion: 2.1 time: 0.037554 Aug 25 14:41:52.088260 n-d-850468-18 devstack@n-api.service[122700]: [pid: 122700|app: 0|req: 3738/7556] 10.222.0.60 () {58 vars in 1236 bytes} [Thu Aug 25 14:41:52 2022] GET /compute/v2.1/servers/2cc8762b-df7f-4751-89f0-d5ef78f6e03e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 14:41:52.297750 n-d-850468-18 devstack@n-api.service[122701]: DEBUG nova.api.openstack.wsgi [None req-1ba7530f-b15f-4428-b834-71bccf88bb85 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] Calling method '.version_select at 0x7fc6c6b79e50>' {{(pid=122701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 14:41:52.304362 n-d-850468-18 devstack@n-api.service[122701]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ba7530f-b15f-4428-b834-71bccf88bb85 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [240fb10b-69ec-4ee0-811e-acdb72400662] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 14:41:53.312608 n-d-850468-18 devstack@n-api.service[122701]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ba7530f-b15f-4428-b834-71bccf88bb85 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] [240fb10b-69ec-4ee0-811e-acdb72400662] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57392. Aug 25 14:41:53.339617 n-d-850468-18 devstack@n-api.service[122701]: INFO nova.api.openstack.requestlog [None req-1ba7530f-b15f-4428-b834-71bccf88bb85 tempest-TestSnapshotPattern-1152245302 tempest-TestSnapshotPattern-1152245302-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-293538351" status: 202 len: 0 microversion: 2.1 time: 1.046434 Aug 25 14:41:53.340446 n-d-850468-18 devstack@n-api.service[122701]: [pid: 122701|app: 0|req: 3819/7557] 10.222.0.60 () {58 vars in 1254 bytes} [Thu Aug 25 14:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-293538351 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)